00000001:02000400:3.0F:1784043850.081748:0:3293:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg240-server.virtnet: executing set_hostid 00000001:02000400:3.0:1784043863.169618:0:3515:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg240-server.virtnet: executing load_modules_local 00000001:01000000:2.0F:1784043864.687067:0:3578:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 951 MB/s 00000001:01000000:1.0F:1784043864.937603:0:3578:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 1039 MB/s 00000001:01000000:2.0:1784043865.187533:0:3578:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 4963 MB/s 00000020:02000000:0.0F:1784043865.739732:0:3607:0:(class_obd.c:804:obdclass_init()) Lustre: Build Version: 2.17.54_162_gf04e30c 00000400:02000000:1.0:1784043866.554063:0:3622:0:(api-ni.c:2768:lnet_startup_lndni()) Added LNI 192.168.202.140@tcp [8/256/0/180] 00008000:02000000:2.0:1784043869.788241:0:3772:0:(echo_client.c:2574:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:2.0:1784043930.057094:0:5738:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg240-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1784043945.418821:0:6488:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1784043945.418829:0:6488:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:2.0:1784043945.418830:0:6488:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1784043945.418965:0:6488:0:(super25.c:130:lustre_fill_super()) VFS Op: sb 000000009b9ccbf1 00000080:02000400:2.0:1784043945.418976:0:6488:0:(super25.c:148:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:2.0:1784043945.434987:0:6488:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200065, mountfl=0 00000020:01000004:2.0:1784043945.435002:0:6488:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1784043945.445287:0:6488:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (000000001de4d826) 00000020:00000080:3.0:1784043945.445313:0:6488:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1784043945.534966:0:6488:0:(scrub.c:229:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:2.0:1784043945.535033:0:6488:0:(scrub.c:229:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00080000:01000000:3.0:1784043945.579522:0:6488:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1784043945.580908:0:6488:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1784043945.582241:0:6488:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:3.0:1784043945.582257:0:6488:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x89871fc3aba17a5a 00000020:01000004:3.0:1784043945.582266:0:6488:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:3.0:1784043945.582271:0:6488:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1784043945.582278:0:6488:0:(tgt_mount.c:101:server_register_mount()) register mount 000000009b9ccbf1 from MGS 00000020:01000004:3.0:1784043945.582282:0:6488:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1784043945.582295:0:6488:0:(genops.c:413:class_newdev()) Allocate new device MGS (000000008f894d60) 00000020:00000080:3.0:1784043945.582306:0:6488:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1784043945.582391:0:6488:0:(tgt_mount.c:153:server_get_mount()) get mount 000000009b9ccbf1 from MGS, refs=2 00080000:01000000:3.0:1784043945.582396:0:6488:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:3.0:1784043945.582400:0:6488:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x89871fc3aba17a68 00000100:00100000:3.0:1784043945.582558:0:6488:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1784043945.582677:0:6488:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1784043945.582683:0:6488:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1784043945.584626:0:6488:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1784043945.584640:0:6488:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1784043945.585333:0:6488:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1784043945.585528:0:6488:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1784043945.585534:0:6488:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1784043945.586779:0:6488:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1784043945.586790:0:6488:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:3.0:1784043945.590572:0:6488:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:3.0:1784043945.590589:0:6488:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:1.0:1784043945.591643:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784043945.591648:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784043945.591650:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784043945.591985:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784043945.591988:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784043945.591989:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784043945.592884:0:6488:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1784043945.595781:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:2.0:1784043945.843706:0:6488:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 2267 MB/s 00000001:01000000:2.0:1784043946.098950:0:6488:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 2082 MB/s 00000001:01000000:0.0:1784043946.349292:0:6488:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 390 MB/s 00000001:01000000:3.0:1784043946.599739:0:6488:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 771 MB/s 00080000:10000000:2.0:1784043946.606605:0:6488:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00000040:01000000:2.0:1784043946.635143:0:6488:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:2.0:1784043946.639545:0:6503:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1784043946.639622:0:6488:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1784043946.639684:0:6488:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:3.0:1784043946.639944:0:6488:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:3.0:1784043946.639977:0:6488:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1784043946.640342:0:6488:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1784043946.640623:0:6488:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1784043946.640630:0:6488:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00010000:00010000:0.0:1784043946.640918:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784043946.650826:0:6488:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1784043946.650965:0:6488:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:2.0:1784043946.654103:0:6488:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:2.0:1784043946.654114:0:6488:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000100:00080000:1.0:1784043946.667499:0:6507:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000020:00000080:2.0:1784043946.667515:0:6488:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1784043946.667538:0:6488:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.202.140@tcp' 00000020:01000004:2.0:1784043946.667540:0:6488:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:2.0:1784043946.667588:0:6488:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.202.140@tcp (typ=mgc) 00000020:00000080:2.0:1784043946.667608:0:6488:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.202.140@tcp (0000000028819ee5) 00000020:00000080:2.0:1784043946.667625:0:6488:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:2.0:1784043946.667722:0:6488:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000b8eef076@MGC192.168.202.140@tcp: add connection 192.168.202.140@tcp at head 00010000:00010000:2.0:1784043946.667887:0:6488:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.202.140@tcp-0 is initialized 00000040:01000000:2.0:1784043946.667894:0:6488:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.140@tcp ctxt 1 is initialized 10000000:01000000:2.0:1784043946.672207:0:6508:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:0.0:1784043946.672315:0:6488:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.202.140@tcp (uuid 8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9) 00000020:00000080:0.0:1784043946.672343:0:6488:0:(genops.c:1406:class_connect()) connect: client 8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9, cookie 0x89871fc3aba17a76 00000100:00080000:0.0:1784043946.672355:0:6488:0:(import.c:510:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1784043946.672360:0:6488:0:(import.c:624:import_select_connection()) MGC192.168.202.140@tcp: import 00000000b8eef076 using connection 192.168.202.140@tcp/0@lo 00000100:00100000:1.0:1784043946.683796:0:6488:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000a95c65f5 x1870705580834944/t0(0) o250->MGC192.168.202.140@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1784043946.684001:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000a95c65f5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:3637:1870705580834944:0@lo:250: 00000100:00100000:3.0:1784043946.684090:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784043946.686070:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580834944 00000100:00100000:0.0:1784043946.686085:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580834944 00000100:00100000:0.0:1784043946.686157:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1784043946.686165:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000edd60308 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:3637:x1870705580834944:12345-0@lo:250: 00010000:00080000:0.0:1784043946.686209:0:6505:0:(ldlm_lib.c:1445:target_handle_connect()) MGS: connection from 8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9@0@lo t0 exp 0000000000000000 cur 139 last 0 00000020:00000080:0.0:1784043946.686242:0:6505:0:(genops.c:1406:class_connect()) connect: client 8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9, cookie 0x89871fc3aba17a7d 00000100:00080000:0.0:1784043946.686399:0:6505:0:(import.c:65:import_set_state_nolock()) 0000000039f3a410 : changing import state from RECOVER to FULL 00000100:00080000:1.0:1784043946.686718:0:6488:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9->MGS 00000020:01000004:1.0:1784043946.686753:0:6488:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1784043946.686760:0:6488:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:1.0:1784043946.686784:0:6488:0:(genops.c:413:class_newdev()) Allocate new device MDS (000000005de1f246) 00000020:00000080:1.0:1784043946.686797:0:6488:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1784043946.686827:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000edd60308 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+5:3637:x1870705580834944:12345-0@lo:250: Request processed in 661us (2736us total) trans 0 rc 0/0 00000100:00100000:0.0:1784043946.686835:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1784043946.686937:0:3637:0:(client.c:3112:ptlrpc_free_committed()) MGC192.168.202.140@tcp: committing for last_committed 0 gen 1 00000100:00080000:3.0:1784043946.686947:0:3637:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.202.140@tcp: connect to target with instance 0 00000100:00080000:3.0:1784043946.686954:0:3637:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.202.140@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1784043946.686959:0:3637:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1784043946.686962:0:3637:0:(import.c:65:import_set_state_nolock()) 00000000b8eef076 MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1784043946.686967:0:3637:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1784043946.687014:0:3637:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1784043946.687020:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000a95c65f5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:3637:1870705580834944:0@lo:250: 00000100:00100000:1.0:1784043946.704464:0:6488:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1784043946.705349:0:6488:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1784043946.705360:0:6488:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:1.0:1784043946.710661:0:6488:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:1.0:1784043946.710677:0:6488:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:1.0:1784043946.711134:0:6488:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:1.0:1784043946.711140:0:6488:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:1.0:1784043946.712955:0:6488:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1784043946.713128:0:6488:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:1.0:1784043946.713134:0:6488:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:1.0:1784043946.714038:0:6488:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:1.0:1784043946.714047:0:6488:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:0.0:1784043946.766129:0:6488:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1784043946.766625:0:6488:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:0.0:1784043946.766632:0:6488:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:0.0:1784043946.768761:0:6488:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:0.0:1784043946.768777:0:6488:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:0.0:1784043946.769952:0:6488:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1784043946.770122:0:6488:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:0.0:1784043946.770128:0:6488:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:0.0:1784043946.770939:0:6488:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:0.0:1784043946.770946:0:6488:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:1.0:1784043946.771868:0:6488:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1784043946.772011:0:6488:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:1.0:1784043946.772016:0:6488:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:1.0:1784043946.772652:0:6488:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:1.0:1784043946.772659:0:6488:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1784043946.773592:0:6488:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1784043946.773758:0:6488:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1784043946.773777:0:6488:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1784043946.777487:0:6488:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1784043946.777515:0:6488:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:0.0:1784043946.801678:0:6488:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1784043946.801930:0:6488:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1784043946.801937:0:6488:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:2.0:1784043946.805939:0:6488:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1784043946.805954:0:6488:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1784043946.806880:0:6488:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1784043946.806889:0:6488:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1784043946.811291:0:6488:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1784043946.811322:0:6488:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:2.0:1784043946.811328:0:6488:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.140@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1784043946.811453:0:6488:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.140@tcp ctxt 0 is initialized 00000020:01000004:2.0:1784043946.811486:0:6488:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.202.140@tcp, index=0000, flags=0x20065 00000020:01000004:2.0:1784043946.811593:0:6488:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1784043946.811595:0:6488:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1784043946.811596:0:6488:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784043946.811597:0:6488:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784043946.811599:0:6488:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784043946.811600:0:6488:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784043946.811601:0:6488:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1784043946.811603:0:6488:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1784043946.811604:0:6488:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1784043946.811605:0:6488:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1784043946.811607:0:6488:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784043946.811608:0:6488:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1784043946.811610:0:6488:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:2.0:1784043946.811613:0:6488:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1784043946.811614:0:6488:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1784043946.811615:0:6488:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784043946.811616:0:6488:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784043946.811617:0:6488:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784043946.811618:0:6488:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784043946.811619:0:6488:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1784043946.811620:0:6488:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1784043946.811621:0:6488:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1784043946.811622:0:6488:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1784043946.811623:0:6488:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784043946.811624:0:6488:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1784043946.811667:0:6488:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1784043946.811685:0:6488:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000007b057368 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6488:1870705580835072:0@lo:253: 00000100:00100000:2.0:1784043946.811778:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784043946.811889:0:6488:0:(client.c:2702:ptlrpc_set_wait()) set 000000002b7b11a1 going to sleep for 11 seconds 00000100:00100000:1.0:1784043946.812088:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580835072 00000100:00100000:1.0:1784043946.812095:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580835072 00000100:00100000:1.0:1784043946.812246:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1784043946.812255:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000058ffcfb2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+5:6488:x1870705580835072:12345-0@lo:253: 20000000:01000000:1.0:1784043946.812301:0:6506:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1784043946.812304:0:6506:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:3.0:1784043946.812883:0:6527:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1784043946.812926:0:6506:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:1.0:1784043946.813450:0:6506:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1784043946.814438:0:6528:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:1.0:1784043946.814855:0:6506:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1784043946.814860:0:6506:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:1.0:1784043946.814865:0:6506:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:1.0:1784043946.814868:0:6506:0:(mgs_llog.c:3608:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:1.0:1784043946.814878:0:6506:0:(mgs_llog.c:3168:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:1.0:1784043946.815018:0:6506:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1784043946.817370:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:1.0:1784043946.817475:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1784043946.817622:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:1.0:1784043946.817642:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:1.0:1784043946.817656:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:1.0:1784043946.817752:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:1.0:1784043946.817762:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:1.0:1784043946.817793:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:1.0:1784043946.817800:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:1.0:1784043946.817813:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:1.0:1784043946.817817:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:1.0:1784043946.817828:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:1.0:1784043946.817841:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:1.0:1784043946.817874:0:6506:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:1.0:1784043946.817881:0:6506:0:(mgs_llog.c:3168:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:1.0:1784043946.817888:0:6506:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1784043946.818010:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:1.0:1784043946.818020:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1784043946.818042:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:1.0:1784043946.818058:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:1.0:1784043946.818072:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:1.0:1784043946.818081:0:6506:0:(mgs_llog.c:3125:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:1.0:1784043946.818104:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:1.0:1784043946.818112:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:1.0:1784043946.818124:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:1.0:1784043946.818140:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:1.0:1784043946.818154:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:1.0:1784043946.818162:0:6506:0:(mgs_llog.c:3090:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:0.0:1784043946.819021:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:0.0:1784043946.819037:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:0.0:1784043946.819053:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:0.0:1784043946.819070:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:0.0:1784043946.819137:0:6506:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:0.0:1784043946.819161:0:6506:0:(mgs_llog.c:3305:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:0.0:1784043946.819168:0:6506:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:0.0:1784043946.819920:0:6529:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:3.0:1784043946.820112:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:3.0:1784043946.820133:0:6506:0:(mgs_llog.c:3351:mgs_write_log_mdc_to_lmv()) add nid 192.168.202.140@tcp for mdt 20000000:01000000:3.0:1784043946.820135:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.140@tcp (null) (null) (null) 00000040:00080000:3.0:1784043946.820150:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:3.0:1784043946.820155:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:3.0:1784043946.820166:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:3.0:1784043946.820171:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.202.140@tcp (null) (null) 00000040:00080000:3.0:1784043946.820226:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:3.0:1784043946.820234:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:3.0:1784043946.820263:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:3.0:1784043946.820281:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:3.0:1784043946.820311:0:6506:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:3.0:1784043946.820319:0:6506:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1784043946.820323:0:6506:0:(mgs_llog.c:4177:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1784043946.820630:0:6506:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1784043946.820634:0:6506:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:0.0:1784043946.821019:0:6530:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:3.0:1784043946.821162:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:3.0:1784043946.821210:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:3.0:1784043946.821227:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 20000000:01000000:3.0:1784043946.821238:0:6506:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1784043946.821240:0:6506:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:0.0:1784043946.822790:0:6531:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:3.0:1784043946.822995:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:3.0:1784043946.823021:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:3.0:1784043946.823037:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 00000020:00000080:3.0:1784043946.823047:0:6506:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1784043946.823049:0:6506:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:3.0:1784043946.823054:0:6506:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1784043946.823056:0:6506:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1784043946.823060:0:6506:0:(mgs_llog.c:5068:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:3.0:1784043946.823067:0:6506:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:3.0:1784043946.826009:0:6532:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:0.0:1784043946.826171:0:6506:0:(mgs_llog.c:4116:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:1.0:1784043946.839476:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:1.0:1784043946.839522:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:1.0:1784043946.839539:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:1.0:1784043946.839560:0:6506:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1784043946.839582:0:6506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000003d9de477/0x89871fc3aba17a8b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784043946.839598:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000003d9de477/0x89871fc3aba17a8b lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784043946.839608:0:6506:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000003d9de477/0x89871fc3aba17a8b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784043946.839614:0:6506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000003d9de477/0x89871fc3aba17a8b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784043946.839619:0:6506:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000003d9de477/0x89871fc3aba17a8b lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784043946.839625:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000003d9de477/0x89871fc3aba17a8b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784043946.839791:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000003d9de477 already unused, calling callback (00000000622db14d) 00010000:00010000:1.0:1784043946.839808:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000003d9de477/0x89871fc3aba17a8b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784043946.839816:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000003d9de477/0x89871fc3aba17a8b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784043946.839830:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000003d9de477/0x89871fc3aba17a8b lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784043946.839837:0:6506:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000003d9de477/0x89871fc3aba17a8b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784043946.839842:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000003d9de477/0x89871fc3aba17a8b lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1784043946.839860:0:6506:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1784043946.848759:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000058ffcfb2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+5:6488:x1870705580835072:12345-0@lo:253: Request processed in 36498us (36973us total) trans 0 rc 0/0 00000100:00100000:1.0:1784043946.848777:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1784043946.848876:0:6488:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000007b057368 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6488:1870705580835072:0@lo:253: 10000000:01000000:2.0:1784043946.848891:0:6488:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1784043946.848895:0:6488:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1784043946.848897:0:6488:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1784043946.848898:0:6488:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784043946.848899:0:6488:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:2.0:1784043946.848901:0:6488:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784043946.848902:0:6488:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784043946.848903:0:6488:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1784043946.848904:0:6488:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1784043946.848905:0:6488:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1784043946.848907:0:6488:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784043946.848908:0:6488:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1784043946.848931:0:6488:0:(tgt_mount.c:101:server_register_mount()) register mount 000000009b9ccbf1 from lustre-MDT0000 10000000:01000000:2.0:1784043946.848960:0:6488:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1784043946.848963:0:6488:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1784043946.848967:0:6488:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9b394402b380 10000000:01000000:2.0:1784043946.848971:0:6488:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1784043946.848977:0:6488:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff9b394402b380 from 1 10000000:01000000:2.0:1784043946.848980:0:6488:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1784043946.849013:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: 0000000001bcae1a/0x89871fc3aba17a92 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784043946.849023:0:6488:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: 0000000001bcae1a/0x89871fc3aba17a92 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784043946.849032:0:6488:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: 0000000001bcae1a/0x89871fc3aba17a92 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784043946.849049:0:6488:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000007b057368 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6488:1870705580835200:0@lo:101: 00000100:00100000:2.0:1784043946.849084:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784043946.849125:0:6488:0:(client.c:2702:ptlrpc_set_wait()) set 0000000062f7f6b7 going to sleep for 11 seconds 00000100:00100000:0.0:1784043946.849134:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580835200 00000100:00100000:0.0:1784043946.849143:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580835200 00000100:00100000:0.0:1784043946.849220:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1784043946.849229:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000021c79fa8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+5:6488:x1870705580835200:12345-0@lo:101: 00010000:00010000:0.0:1784043946.849244:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784043946.849370:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000075608ee/0x89871fc3aba17a99 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x89871fc3aba17a92 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784043946.849403:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000075608ee/0x89871fc3aba17a99 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x89871fc3aba17a92 expref: 6 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784043946.849414:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000075608ee/0x89871fc3aba17a99 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x89871fc3aba17a92 expref: 6 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784043946.849422:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000075608ee, rc 0) 00000100:00100000:0.0:1784043946.849459:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000021c79fa8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+6:6488:x1870705580835200:12345-0@lo:101: Request processed in 231us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1784043946.849465:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1784043946.849502:0:6488:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000007b057368 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6488:1870705580835200:0@lo:101: 00010000:00010000:2.0:1784043946.849517:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: 0000000001bcae1a/0x89871fc3aba17a92 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba17a99 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784043946.849524:0:6488:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: 0000000001bcae1a/0x89871fc3aba17a92 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x89871fc3aba17a99 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784043946.849695:0:6488:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000007b057368 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6488:1870705580835328:0@lo:501: 00000100:00100000:2.0:1784043946.849722:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784043946.849754:0:6488:0:(client.c:2702:ptlrpc_set_wait()) set 0000000062f7f6b7 going to sleep for 11 seconds 00000100:00100000:1.0:1784043946.849776:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580835328 00000100:00100000:1.0:1784043946.849782:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580835328 00000100:00100000:1.0:1784043946.849817:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1784043946.849824:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b54794f7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+6:6488:x1870705580835328:12345-0@lo:501: 00000100:00100000:1.0:1784043946.849914:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b54794f7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+6:6488:x1870705580835328:12345-0@lo:501: Request processed in 90us (191us total) trans 0 rc -2/-2 00000100:00100000:1.0:1784043946.849921:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1784043946.850127:0:6488:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000007b057368 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6488:1870705580835328:0@lo:501: 10000000:01000000:2.0:1784043946.850155:0:6488:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1784043946.850322:0:6488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: 0000000001bcae1a/0x89871fc3aba17a92 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba17a99 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784043946.850330:0:6488:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: 0000000001bcae1a/0x89871fc3aba17a92 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba17a99 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784043946.850337:0:6488:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9b397418c800 10000000:01000000:2.0:1784043946.850341:0:6488:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1784043946.850345:0:6488:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9b397418c800 10000000:01000000:2.0:1784043946.850348:0:6488:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1784043946.850350:0:6488:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff9b397418c800 from 1 10000000:01000000:2.0:1784043946.850352:0:6488:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1784043946.850369:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: 000000008c22e143/0x89871fc3aba17aa0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784043946.850375:0:6488:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: 000000008c22e143/0x89871fc3aba17aa0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784043946.850394:0:6488:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: 000000008c22e143/0x89871fc3aba17aa0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784043946.850405:0:6488:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000007b057368 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6488:1870705580835456:0@lo:101: 00000100:00100000:2.0:1784043946.850431:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784043946.850457:0:6488:0:(client.c:2702:ptlrpc_set_wait()) set 0000000062f7f6b7 going to sleep for 11 seconds 00000100:00100000:0.0:1784043946.850480:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580835456 00000100:00100000:0.0:1784043946.850485:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580835456 00000100:00100000:0.0:1784043946.850519:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1784043946.850524:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000eb45ac72 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+6:6488:x1870705580835456:12345-0@lo:101: 00010000:00010000:0.0:1784043946.850532:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784043946.850541:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000048441bef/0x89871fc3aba17aa7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x89871fc3aba17aa0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784043946.850556:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000048441bef/0x89871fc3aba17aa7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x89871fc3aba17aa0 expref: 7 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784043946.850563:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000048441bef/0x89871fc3aba17aa7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x89871fc3aba17aa0 expref: 7 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784043946.850570:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000048441bef, rc 0) 00000100:00100000:0.0:1784043946.850663:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000eb45ac72 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+7:6488:x1870705580835456:12345-0@lo:101: Request processed in 139us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1784043946.850669:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1784043946.854716:0:6488:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000007b057368 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6488:1870705580835456:0@lo:101: 00010000:00010000:2.0:1784043946.854755:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: 000000008c22e143/0x89871fc3aba17aa0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba17aa7 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784043946.854766:0:6488:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: 000000008c22e143/0x89871fc3aba17aa0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x89871fc3aba17aa7 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784043946.854785:0:6488:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1784043946.854800:0:6488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: 000000008c22e143/0x89871fc3aba17aa0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba17aa7 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784043946.854807:0:6488:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: 000000008c22e143/0x89871fc3aba17aa0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba17aa7 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784043946.854814:0:6488:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1784043946.854951:0:6488:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1784043946.854958:0:6488:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9b397418c800 10000000:01000000:3.0:1784043946.854961:0:6488:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1784043946.854964:0:6488:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1784043946.854968:0:6488:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1784043946.855022:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: 0000000017dbd489/0x89871fc3aba17aae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043946.855029:0:6488:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: 0000000017dbd489/0x89871fc3aba17aae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043946.855037:0:6488:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: 0000000017dbd489/0x89871fc3aba17aae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784043946.855062:0:6488:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000a66635dd pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6488:1870705580835584:0@lo:101: 00000100:00100000:3.0:1784043946.855119:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784043946.855166:0:6488:0:(client.c:2702:ptlrpc_set_wait()) set 0000000009a2ea34 going to sleep for 11 seconds 00000100:00100000:2.0:1784043946.855634:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580835584 00000100:00100000:2.0:1784043946.855641:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580835584 00000100:00100000:2.0:1784043946.855687:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1784043946.855695:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005c0f0db0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+7:6488:x1870705580835584:12345-0@lo:101: 00010000:00010000:2.0:1784043946.855708:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784043946.855721:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000006675d783/0x89871fc3aba17ab5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x89871fc3aba17aae expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784043946.855762:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000006675d783/0x89871fc3aba17ab5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x89871fc3aba17aae expref: 8 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784043946.855770:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000006675d783/0x89871fc3aba17ab5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x89871fc3aba17aae expref: 8 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784043946.855779:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000006675d783, rc 0) 00000100:00100000:2.0:1784043946.855828:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005c0f0db0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+8:6488:x1870705580835584:12345-0@lo:101: Request processed in 135us (710us total) trans 0 rc 0/0 00000100:00100000:2.0:1784043946.855834:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1784043946.856592:0:6488:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000a66635dd pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6488:1870705580835584:0@lo:101: 00010000:00010000:3.0:1784043946.856608:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: 0000000017dbd489/0x89871fc3aba17aae lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba17ab5 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043946.856616:0:6488:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: 0000000017dbd489/0x89871fc3aba17aae lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x89871fc3aba17ab5 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784043946.856695:0:6488:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000a66635dd pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6488:1870705580835712:0@lo:501: 00000100:00100000:3.0:1784043946.856743:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784043946.856776:0:6488:0:(client.c:2702:ptlrpc_set_wait()) set 0000000009a2ea34 going to sleep for 11 seconds 00000100:00100000:1.0:1784043946.856984:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580835712 00000100:00100000:1.0:1784043946.856990:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580835712 00000100:00100000:1.0:1784043946.857031:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1784043946.857038:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bbcb6d2c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+8:6488:x1870705580835712:12345-0@lo:501: 00000100:00100000:1.0:1784043946.857167:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bbcb6d2c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+9:6488:x1870705580835712:12345-0@lo:501: Request processed in 130us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1784043946.857195:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1784043946.857517:0:6488:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000a66635dd pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6488:1870705580835712:0@lo:501: 00000100:00100000:3.0:1784043946.857553:0:6488:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000a66635dd pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6488:1870705580835840:0@lo:503: 00000100:00100000:3.0:1784043946.857594:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784043946.857672:0:6488:0:(client.c:2702:ptlrpc_set_wait()) set 0000000009a2ea34 going to sleep for 11 seconds 00000100:00100000:0.0:1784043946.858589:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580835840 00000100:00100000:0.0:1784043946.858597:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580835840 00000100:00100000:1.0:1784043946.858848:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1784043946.858858:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007d5f5fe3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+9:6488:x1870705580835840:12345-0@lo:503: 00000100:00100000:1.0:1784043946.858988:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007d5f5fe3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+9:6488:x1870705580835840:12345-0@lo:503: Request processed in 131us (1393us total) trans 0 rc 0/0 00000100:00100000:1.0:1784043946.858996:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1784043946.859082:0:6488:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000a66635dd pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6488:1870705580835840:0@lo:503: 00000100:00100000:0.0:1784043946.859749:0:6533:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000cb56f5b3 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6533:1870705580835968:0@lo:502: 00000100:00100000:0.0:1784043946.859800:0:6533:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784043946.860101:0:6533:0:(client.c:2702:ptlrpc_set_wait()) set 00000000794182dd going to sleep for 11 seconds 00000100:00100000:3.0:1784043946.860204:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580835968 00000100:00100000:3.0:1784043946.860209:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580835968 00000100:00100000:3.0:1784043946.860247:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1784043946.860253:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000082ecb36b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+9:6533:x1870705580835968:12345-0@lo:502: 00000100:00100000:3.0:1784043946.860346:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000082ecb36b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+9:6533:x1870705580835968:12345-0@lo:502: Request processed in 93us (547us total) trans 0 rc 0/0 00000100:00100000:3.0:1784043946.860352:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1784043946.862696:0:6533:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000cb56f5b3 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6533:1870705580835968:0@lo:502: 00000020:01000000:0.0:1784043946.862787:0:6533:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784043946.862801:0:6533:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784043946.862803:0:6533:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1784043946.862807:0:6533:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1784043946.862819:0:6533:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1784043946.862846:0:6533:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (0000000077563112) 00000020:00000080:0.0:1784043946.862869:0:6533:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:0.0:1784043946.862875:0:6533:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1784043946.863005:0:6533:0:(osd_handler.c:8929:osd_obd_connect()) connect #2 00000020:00000080:0.0:1784043946.863013:0:6533:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x89871fc3aba17ac3 00000020:00000080:0.0:1784043946.863274:0:6533:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1784043946.863278:0:6533:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784043946.863282:0:6533:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784043946.863283:0:6533:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1784043946.863285:0:6533:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784043946.863289:0:6533:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784043946.863290:0:6533:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1784043946.863293:0:6533:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1784043946.863299:0:6533:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (000000008c47d804) 00000020:00000080:0.0:1784043946.863308:0:6533:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:0.0:1784043946.863312:0:6533:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1784043946.863314:0:6533:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1784043946.863316:0:6533:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1784043946.863322:0:6533:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1784043946.863386:0:6533:0:(tgt_mount.c:153:server_get_mount()) get mount 000000009b9ccbf1 from lustre-MDT0000, refs=3 00000020:00000080:0.0:1784043946.863399:0:6533:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (000000007e020d9f) 00000020:00000080:0.0:1784043946.863407:0:6533:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:0.0:1784043946.863482:0:6533:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1784043946.863488:0:6533:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x89871fc3aba17ad8 00000020:00000080:0.0:1784043946.864223:0:6533:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:0.0:1784043946.864230:0:6533:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1784043946.864237:0:6533:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x89871fc3aba17adf 00080000:01000000:0.0:1784043946.864242:0:6533:0:(osd_handler.c:8929:osd_obd_connect()) connect #3 00000020:00000080:0.0:1784043946.864246:0:6533:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x89871fc3aba17ae6 00080000:10000000:1.0:1784043946.867016:0:6533:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:1.0:1784043946.867215:0:6533:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:1.0:1784043946.875127:0:6533:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:0.0:1784043946.972020:0:6533:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:0.0:1784043946.972748:0:6533:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:0.0:1784043946.975989:0:6533:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:0.0:1784043946.976673:0:6533:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1784043946.981106:0:6533:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (0000000093ffbd97) 00000020:00000080:2.0:1784043946.981131:0:6533:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1784043946.981261:0:6533:0:(osd_handler.c:8929:osd_obd_connect()) connect #4 00000020:00000080:2.0:1784043946.981268:0:6533:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x89871fc3aba17af4 00000020:00000080:3.0:1784043946.990940:0:6533:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:3.0:1784043946.997013:0:6533:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00080000:10000000:3.0:1784043947.000701:0:6533:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00080000:10000000:2.0:1784043947.003716:0:6533:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00080000:10000000:2.0:1784043947.009683:0:6533:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00080000:10000000:2.0:1784043947.013998:0:6533:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00080000:10000000:3.0:1784043947.017735:0:6533:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00000020:00000080:3.0:1784043947.020964:0:6533:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x89871fc3aba17afb 00000020:00000080:3.0:1784043947.022495:0:6533:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1784043947.022519:0:6533:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784043947.022527:0:6533:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784043947.022530:0:6533:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1784043947.022533:0:6533:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784043947.022537:0:6533:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784043947.022538:0:6533:0:(obd_config.c:1561:class_process_config()) marker 8 (0x1) lustre sys.timeout 00000020:00000080:3.0:1784043947.022541:0:6533:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1784043947.022542:0:6533:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1784043947.022545:0:6533:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784043947.022547:0:6533:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784043947.022548:0:6533:0:(obd_config.c:1561:class_process_config()) marker 8 (0x2) lustre sys.timeout 00000020:01000000:3.0:1784043947.022551:0:6533:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784043947.022555:0:6533:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784043947.022557:0:6533:0:(obd_config.c:1561:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1784043947.022561:0:6533:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1784043947.022623:0:6533:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:3.0:1784043947.022695:0:6533:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000019726bed pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6533:1870705580836096:0@lo:502: 00000100:00100000:3.0:1784043947.022843:0:6533:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784043947.022936:0:6533:0:(client.c:2702:ptlrpc_set_wait()) set 00000000d12cc102 going to sleep for 11 seconds 00000100:00100000:0.0:1784043947.023204:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580836096 00000100:00100000:0.0:1784043947.023213:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580836096 00000100:00100000:0.0:1784043947.023267:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1784043947.023277:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f504ec11 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+9:6533:x1870705580836096:12345-0@lo:502: 00000100:00100000:0.0:1784043947.023422:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f504ec11 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+9:6533:x1870705580836096:12345-0@lo:502: Request processed in 147us (580us total) trans 0 rc 0/0 00000100:00100000:0.0:1784043947.023429:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1784043947.023753:0:6533:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000019726bed pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6533:1870705580836096:0@lo:502: 00000020:01000000:3.0:1784043947.023781:0:6533:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784043947.023787:0:6533:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784043947.023790:0:6533:0:(obd_config.c:1561:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:3.0:1784043947.023793:0:6533:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:0.0:1784043947.024330:0:6488:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:0.0:1784043947.024354:0:6488:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1784043947.024370:0:6488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: 0000000017dbd489/0x89871fc3aba17aae lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba17ab5 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784043947.024380:0:6488:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: 0000000017dbd489/0x89871fc3aba17aae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba17ab5 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784043947.024387:0:6488:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9b397418c800 from 1 10000000:01000000:0.0:1784043947.024390:0:6488:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1784043947.024424:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: 0000000049b75748/0x89871fc3aba17b02 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784043947.024432:0:6488:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: 0000000049b75748/0x89871fc3aba17b02 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784043947.024441:0:6488:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: 0000000049b75748/0x89871fc3aba17b02 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784043947.024460:0:6488:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000cb56f5b3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6488:1870705580836224:0@lo:101: 00000100:00100000:0.0:1784043947.024524:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784043947.024723:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580836224 00000100:00100000:2.0:1784043947.024739:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580836224 00000100:00100000:2.0:1784043947.025261:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1784043947.025272:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ccee4e08 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+9:6488:x1870705580836224:12345-0@lo:101: 00010000:00010000:2.0:1784043947.025285:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784043947.025307:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000ddbfebf1/0x89871fc3aba17b09 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x89871fc3aba17b02 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784043947.025330:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ddbfebf1/0x89871fc3aba17b09 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x89871fc3aba17b02 expref: 10 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784043947.025353:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000ddbfebf1/0x89871fc3aba17b09 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x89871fc3aba17b02 expref: 10 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784043947.025362:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000ddbfebf1, rc 0) 00000100:00100000:2.0:1784043947.025400:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ccee4e08 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+10:6488:x1870705580836224:12345-0@lo:101: Request processed in 132us (877us total) trans 0 rc 0/0 00000100:00100000:2.0:1784043947.025406:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1784043947.026126:0:6488:0:(client.c:2702:ptlrpc_set_wait()) set 0000000012217a8f going to sleep for 11 seconds 00000100:00100000:0.0:1784043947.026334:0:6488:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000cb56f5b3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6488:1870705580836224:0@lo:101: 00010000:00010000:0.0:1784043947.026357:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: 0000000049b75748/0x89871fc3aba17b02 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba17b09 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784043947.026367:0:6488:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: 0000000049b75748/0x89871fc3aba17b02 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x89871fc3aba17b09 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784043947.027447:0:6488:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000cb56f5b3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6488:1870705580836352:0@lo:256: 00000100:00100000:0.0:1784043947.027758:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784043947.027874:0:6488:0:(client.c:2702:ptlrpc_set_wait()) set 0000000012217a8f going to sleep for 11 seconds 00000100:00100000:2.0:1784043947.028131:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580836352 00000100:00100000:2.0:1784043947.028141:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580836352 00000100:00100000:2.0:1784043947.028475:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1784043947.028484:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000072e31e55 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+10:6488:x1870705580836352:12345-0@lo:256: 20000000:01000000:2.0:1784043947.028522:0:6504:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1784043947.028529:0:6504:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:2.0:1784043947.028625:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000072e31e55 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+10:6488:x1870705580836352:12345-0@lo:256: Request processed in 142us (867us total) trans 0 rc 0/0 00000100:00100000:2.0:1784043947.028633:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1784043947.028715:0:6488:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000cb56f5b3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6488:1870705580836352:0@lo:256: 10000000:01000000:1.0:1784043947.029817:0:6488:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1784043947.030001:0:6488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: 0000000049b75748/0x89871fc3aba17b02 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba17b09 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784043947.030017:0:6488:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: 0000000049b75748/0x89871fc3aba17b02 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba17b09 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784043947.030026:0:6488:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9b397418c800 from 1 10000000:01000000:1.0:1784043947.030030:0:6488:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1784043947.030097:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: 000000003d9de477/0x89871fc3aba17b10 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784043947.030106:0:6488:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: 000000003d9de477/0x89871fc3aba17b10 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784043947.030116:0:6488:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: 000000003d9de477/0x89871fc3aba17b10 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784043947.030156:0:6488:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000daaa0793 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6488:1870705580836480:0@lo:101: 00000100:00100000:1.0:1784043947.030233:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784043947.031030:0:6488:0:(client.c:2702:ptlrpc_set_wait()) set 00000000185248ae going to sleep for 11 seconds 00000100:00100000:0.0:1784043947.031128:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580836480 00000100:00100000:0.0:1784043947.031136:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580836480 00000100:00100000:0.0:1784043947.031205:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1784043947.031214:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000262a24d7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+10:6488:x1870705580836480:12345-0@lo:101: 00010000:00010000:0.0:1784043947.031230:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784043947.031249:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000325f393c/0x89871fc3aba17b17 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x89871fc3aba17b10 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784043947.031274:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000325f393c/0x89871fc3aba17b17 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x89871fc3aba17b10 expref: 11 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784043947.031284:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000325f393c/0x89871fc3aba17b17 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x89871fc3aba17b10 expref: 11 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784043947.031292:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000325f393c, rc 0) 00000100:00100000:0.0:1784043947.031355:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000262a24d7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+11:6488:x1870705580836480:12345-0@lo:101: Request processed in 142us (1123us total) trans 0 rc 0/0 00000100:00100000:0.0:1784043947.031362:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1784043947.031490:0:6488:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000daaa0793 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6488:1870705580836480:0@lo:101: 00010000:00010000:1.0:1784043947.031514:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: 000000003d9de477/0x89871fc3aba17b10 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba17b17 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784043947.031523:0:6488:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: 000000003d9de477/0x89871fc3aba17b10 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x89871fc3aba17b17 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784043947.031599:0:6488:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000daaa0793 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6488:1870705580836608:0@lo:501: 00000100:00100000:1.0:1784043947.031628:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784043947.031653:0:6488:0:(client.c:2702:ptlrpc_set_wait()) set 00000000185248ae going to sleep for 11 seconds 00000100:00100000:0.0:1784043947.032088:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580836608 00000100:00100000:0.0:1784043947.032094:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580836608 00000100:00100000:0.0:1784043947.032114:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1784043947.032119:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000d39a4e0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+11:6488:x1870705580836608:12345-0@lo:501: 00000100:00100000:0.0:1784043947.032305:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000d39a4e0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+11:6488:x1870705580836608:12345-0@lo:501: Request processed in 185us (676us total) trans 0 rc 0/0 00000100:00100000:0.0:1784043947.032313:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1784043947.032510:0:6488:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000daaa0793 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6488:1870705580836608:0@lo:501: 00000100:00100000:1.0:1784043947.032546:0:6488:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000daaa0793 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6488:1870705580836736:0@lo:503: 00000100:00100000:1.0:1784043947.032601:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784043947.032630:0:6488:0:(client.c:2702:ptlrpc_set_wait()) set 00000000185248ae going to sleep for 11 seconds 00000100:00100000:0.0:1784043947.033060:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580836736 00000100:00100000:0.0:1784043947.033066:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580836736 00000100:00100000:0.0:1784043947.033091:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1784043947.033098:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000234a5840 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+11:6488:x1870705580836736:12345-0@lo:503: 00000040:00080000:0.0:1784043947.033132:0:6505:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1784043947.033219:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000234a5840 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+11:6488:x1870705580836736:12345-0@lo:503: Request processed in 122us (617us total) trans 0 rc 0/0 00000100:00100000:0.0:1784043947.033226:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1784043947.033419:0:6488:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000daaa0793 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6488:1870705580836736:0@lo:503: 00000040:00080000:1.0:1784043947.034938:0:6537:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:0.0:1784043947.035157:0:6488:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:0.0:1784043947.035201:0:6488:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1784043947.035222:0:6488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: 000000003d9de477/0x89871fc3aba17b10 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba17b17 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784043947.035235:0:6488:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: 000000003d9de477/0x89871fc3aba17b10 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba17b17 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784043947.035315:0:6488:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1784043947.035319:0:6488:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9b397418c800 10000000:01000000:0.0:1784043947.035323:0:6488:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9b397418c800 10000000:01000000:0.0:1784043947.035327:0:6488:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1784043947.035333:0:6488:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9b397418c800 from 1 10000000:01000000:0.0:1784043947.035336:0:6488:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1784043947.035373:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: 000000000d0d828f/0x89871fc3aba17b1e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784043947.035381:0:6488:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: 000000000d0d828f/0x89871fc3aba17b1e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784043947.035390:0:6488:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: 000000000d0d828f/0x89871fc3aba17b1e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784043947.035417:0:6488:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000f39256e4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6488:1870705580836864:0@lo:101: 00000100:00100000:0.0:1784043947.035479:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784043947.035530:0:6488:0:(client.c:2702:ptlrpc_set_wait()) set 00000000c73ac93f going to sleep for 11 seconds 00000100:00100000:0.0:1784043947.035553:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580836864 00000100:00100000:0.0:1784043947.035558:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580836864 00000100:00100000:0.0:1784043947.035805:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1784043947.035814:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000072ed7585 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+11:6488:x1870705580836864:12345-0@lo:101: 00010000:00010000:0.0:1784043947.035825:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784043947.035835:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000000081fd5/0x89871fc3aba17b25 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x89871fc3aba17b1e expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784043947.035856:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000000081fd5/0x89871fc3aba17b25 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x89871fc3aba17b1e expref: 12 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784043947.035930:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000000081fd5/0x89871fc3aba17b25 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x89871fc3aba17b1e expref: 12 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784043947.035939:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000000081fd5, rc 0) 00000100:00100000:0.0:1784043947.035974:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000072ed7585 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+12:6488:x1870705580836864:12345-0@lo:101: Request processed in 161us (496us total) trans 0 rc 0/0 00000100:00100000:0.0:1784043947.035981:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1784043947.036030:0:6488:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000f39256e4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6488:1870705580836864:0@lo:101: 00010000:00010000:0.0:1784043947.036043:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: 000000000d0d828f/0x89871fc3aba17b1e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba17b25 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784043947.036053:0:6488:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: 000000000d0d828f/0x89871fc3aba17b1e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x89871fc3aba17b25 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784043947.036105:0:6488:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000f39256e4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6488:1870705580836992:0@lo:501: 00000100:00100000:0.0:1784043947.036130:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784043947.036226:0:6488:0:(client.c:2702:ptlrpc_set_wait()) set 00000000c73ac93f going to sleep for 11 seconds 00000100:00100000:0.0:1784043947.036240:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580836992 00000100:00100000:0.0:1784043947.036243:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580836992 00000100:00100000:0.0:1784043947.036261:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1784043947.036266:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d1dfc730 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+12:6488:x1870705580836992:12345-0@lo:501: 00000100:00100000:0.0:1784043947.036739:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d1dfc730 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+12:6488:x1870705580836992:12345-0@lo:501: Request processed in 472us (608us total) trans 0 rc 0/0 00000100:00100000:0.0:1784043947.036747:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1784043947.037142:0:6488:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000f39256e4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6488:1870705580836992:0@lo:501: 00000100:00100000:1.0:1784043947.037275:0:6488:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000daaa0793 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6488:1870705580837120:0@lo:503: 00000100:00100000:1.0:1784043947.037393:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784043947.037412:0:6488:0:(client.c:2702:ptlrpc_set_wait()) set 000000000b7139fd going to sleep for 11 seconds 00000100:00100000:0.0:1784043947.037478:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580837120 00000100:00100000:0.0:1784043947.037484:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580837120 00000100:00100000:0.0:1784043947.037646:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1784043947.037654:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000101c0557 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+12:6488:x1870705580837120:12345-0@lo:503: 00000100:00100000:0.0:1784043947.037759:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000101c0557 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+12:6488:x1870705580837120:12345-0@lo:503: Request processed in 107us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1784043947.037766:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1784043947.038032:0:6488:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000daaa0793 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6488:1870705580837120:0@lo:503: 00000100:00100000:1.0:1784043947.039461:0:6538:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000daaa0793 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6538:1870705580837248:0@lo:502: 00000100:00100000:1.0:1784043947.039720:0:6538:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784043947.039808:0:6538:0:(client.c:2702:ptlrpc_set_wait()) set 00000000afdb14bf going to sleep for 11 seconds 00000100:00100000:0.0:1784043947.039848:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580837248 00000100:00100000:0.0:1784043947.039855:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580837248 00000100:00100000:0.0:1784043947.040023:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1784043947.040033:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ee9c4f14 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+12:6538:x1870705580837248:12345-0@lo:502: 00000100:00100000:0.0:1784043947.040216:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ee9c4f14 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+12:6538:x1870705580837248:12345-0@lo:502: Request processed in 185us (497us total) trans 0 rc 0/0 00000100:00100000:0.0:1784043947.040224:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1784043947.040321:0:6538:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000daaa0793 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6538:1870705580837248:0@lo:502: 00000020:01000004:1.0:1784043947.040386:0:6538:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1784043947.040402:0:6538:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (0000000021c89215) 00000020:00000080:1.0:1784043947.040425:0:6538:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:1.0:1784043947.040655:0:6538:0:(tgt_mount.c:153:server_get_mount()) get mount 000000009b9ccbf1 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1784043947.040659:0:6538:0:(tgt_mount.c:187:server_put_mount()) put mount 000000009b9ccbf1 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1784043947.040662:0:6538:0:(obd_mount.c:710:lustre_put_lsi()) put 000000009b9ccbf1 4 00010000:00080000:1.0:1784043947.040692:0:6538:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000079b3567c@lustre-MDT0000-lwp-MDT0000: add connection 192.168.202.140@tcp at head 00010000:00010000:1.0:1784043947.042996:0:6538:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:1.0:1784043947.043149:0:6538:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1784043947.043211:0:6538:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1784043947.043227:0:6538:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x89871fc3aba17b33 00000100:00080000:1.0:1784043947.043237:0:6538:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1784043947.043242:0:6538:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 0000000079b3567c using connection 192.168.202.140@tcp/0@lo 00000100:00100000:1.0:1784043947.043286:0:6538:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000daaa0793 x1870705580837376/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1784043947.049046:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000daaa0793 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3637:1870705580837376:0@lo:38: 00000100:00100000:2.0:1784043947.049135:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1784043947.049292:0:6538:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1784043947.052074:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580837376 00000100:00100000:0.0:1784043947.052092:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580837376 00000100:00100000:0.0:1784043947.052142:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1784043947.052160:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007b057368 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3637:x1870705580837376:12345-0@lo:38: 00000100:00100000:0.0:1784043947.052289:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007b057368 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3637:x1870705580837376:12345-0@lo:38: Request processed in 128us (3153us total) trans 0 rc -11/-11 00000100:00100000:0.0:1784043947.052296:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1784043947.052945:0:3637:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1784043947.052960:0:3637:0:(import.c:65:import_set_state_nolock()) 0000000079b3567c lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1784043947.052965:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1784043947.052970:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000daaa0793 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3637:1870705580837376:0@lo:38: 00000100:00100000:0.0:1784043947.053716:0:6538:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000d69d1044 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6538:1870705580837504:0@lo:502: 00000100:00100000:0.0:1784043947.053801:0:6538:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784043947.053842:0:6538:0:(client.c:2702:ptlrpc_set_wait()) set 00000000cb907d9f going to sleep for 11 seconds 00000100:00100000:3.0:1784043947.053969:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580837504 00000100:00100000:3.0:1784043947.053975:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580837504 00000100:00100000:3.0:1784043947.054010:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1784043947.054016:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000781ac33b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+12:6538:x1870705580837504:12345-0@lo:502: 00000100:00100000:3.0:1784043947.054137:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000781ac33b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+12:6538:x1870705580837504:12345-0@lo:502: Request processed in 120us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1784043947.054144:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1784043947.054393:0:6538:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000d69d1044 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6538:1870705580837504:0@lo:502: 00000040:00080000:0.0:1784043947.054421:0:6538:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:2.0:1784043947.059401:0:6488:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:2.0:1784043947.059441:0:6488:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1784043947.059463:0:6488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: 000000000d0d828f/0x89871fc3aba17b1e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba17b25 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784043947.060007:0:6488:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: 000000000d0d828f/0x89871fc3aba17b1e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba17b25 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1784043947.060089:0:6488:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1784043947.060096:0:6488:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1784043947.060098:0:6488:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784043947.060099:0:6488:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784043947.060100:0:6488:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784043947.060101:0:6488:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784043947.060103:0:6488:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1784043947.060104:0:6488:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1784043947.060105:0:6488:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1784043947.060107:0:6488:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1784043947.060108:0:6488:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784043947.060109:0:6488:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1784043947.060113:0:6488:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:2.0:1784043947.060115:0:6488:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1784043947.060116:0:6488:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1784043947.060117:0:6488:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784043947.060118:0:6488:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784043947.060119:0:6488:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784043947.060120:0:6488:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784043947.060121:0:6488:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1784043947.060122:0:6488:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1784043947.060122:0:6488:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1784043947.060123:0:6488:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1784043947.060124:0:6488:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784043947.060125:0:6488:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1784043947.060432:0:6488:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1784043947.060453:0:6488:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000010506563 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6488:1870705580837632:0@lo:253: 00000100:00100000:2.0:1784043947.060736:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784043947.060829:0:6488:0:(client.c:2702:ptlrpc_set_wait()) set 00000000374810c2 going to sleep for 11 seconds 00000100:00100000:0.0:1784043947.060938:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580837632 00000100:00100000:0.0:1784043947.060948:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580837632 00000100:00100000:0.0:1784043947.061035:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1784043947.061044:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001aaa2b42 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+12:6488:x1870705580837632:12345-0@lo:253: 20000000:01000000:0.0:1784043947.061077:0:6505:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1784043947.061092:0:6505:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1784043947.077791:0:6505:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1784043947.077851:0:6505:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1784043947.081750:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001aaa2b42 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+12:6488:x1870705580837632:12345-0@lo:253: Request processed in 20699us (21018us total) trans 0 rc 0/0 00000100:00100000:0.0:1784043947.081767:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1784043947.081912:0:6488:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000010506563 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6488:1870705580837632:0@lo:253: 10000000:01000000:2.0:1784043947.081928:0:6488:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1784043947.081931:0:6488:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1784043947.081933:0:6488:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1784043947.081934:0:6488:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784043947.081935:0:6488:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784043947.081936:0:6488:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784043947.081937:0:6488:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784043947.081939:0:6488:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1784043947.081940:0:6488:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1784043947.081955:0:6488:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1784043947.081956:0:6488:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1784043947.081958:0:6488:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784043947.081959:0:6488:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1784043947.081974:0:6488:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:3.0:1784043947.084561:0:6527:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1784043947.084775:0:6527:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1784043947.084806:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000223ad1ac/0x89871fc3aba17b3a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043947.084827:0:6527:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000ddbfebf1/0x89871fc3aba17b09 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x89871fc3aba17b02 expref: 11 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043947.084836:0:6527:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000223ad1ac/0x89871fc3aba17b3a lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043947.084894:0:6527:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000ddbfebf1/0x89871fc3aba17b09 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x89871fc3aba17b02 expref: 11 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043947.084913:0:6527:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000ddbfebf1/0x89871fc3aba17b09 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x89871fc3aba17b02 expref: 11 pid: 6505 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784043947.084930:0:6527:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000019726bed pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6527:1870705580837760:0@lo:104: 00000100:00100000:3.0:1784043947.084996:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784043947.085066:0:6527:0:(client.c:2702:ptlrpc_set_wait()) set 0000000007f33124 going to sleep for 11 seconds 00000100:00100000:1.0:1784043947.085227:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580837760 00000100:00100000:1.0:1784043947.085235:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580837760 00000100:00100000:1.0:1784043947.085288:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1784043947.085296:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000ef184fe pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+3:6527:x1870705580837760:12345-0@lo:104: 00010000:00010000:1.0:1784043947.085319:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.140@tcp lock: 0000000049b75748/0x89871fc3aba17b02 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x89871fc3aba17b09 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784043947.085391:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1784043947.085396:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000ef184fe pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+3:6527:x1870705580837760:12345-0@lo:104: Request processed in 101us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1784043947.085403:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:1.0:1784043947.085427:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784043947.085433:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: 0000000049b75748/0x89871fc3aba17b02 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x89871fc3aba17b09 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784043947.085440:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000049b75748 already unused, calling callback (00000000c6a82693) 10000000:00010000:1.0:1784043947.085443:0:6499:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: 0000000049b75748/0x89871fc3aba17b02 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x89871fc3aba17b09 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784043947.085451:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: 0000000049b75748/0x89871fc3aba17b02 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x89871fc3aba17b09 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784043947.085458:0:6499:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: 0000000049b75748/0x89871fc3aba17b02 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x89871fc3aba17b09 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784043947.085476:0:6499:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1784043947.085511:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.140@tcp lock: 0000000049b75748/0x89871fc3aba17b02 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x89871fc3aba17b09 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784043947.085519:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784043947.085535:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: 0000000049b75748/0x89871fc3aba17b02 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x89871fc3aba17b09 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784043947.085541:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: 0000000049b75748/0x89871fc3aba17b02 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x89871fc3aba17b09 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784043947.085827:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784043947.085830:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784043947.085832:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784043947.085899:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784043947.085912:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000082f1c680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:3638:1870705580837888:0@lo:103: 00000100:00100000:1.0:1784043947.085952:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784043947.086000:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580837888 00000100:00100000:1.0:1784043947.086005:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580837888 00010000:00010000:1.0:1784043947.086024:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000ddbfebf1/0x89871fc3aba17b09 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x89871fc3aba17b02 expref: 12 pid: 6505 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784043947.086050:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1784043947.086057:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000032b9c978 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+12:3638:x1870705580837888:12345-0@lo:103: 00010000:00010000:1.0:1784043947.086069:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784043947.086073:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000ddbfebf1/0x89871fc3aba17b09 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x89871fc3aba17b02 expref: 12 pid: 6505 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784043947.086084:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000ddbfebf1/0x89871fc3aba17b09 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x89871fc3aba17b02 expref: 12 pid: 6505 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784043947.086099:0:6496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000223ad1ac/0x89871fc3aba17b3a lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784043947.086106:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000223ad1ac/0x89871fc3aba17b3a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1784043947.086120:0:6496:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001344818s 00010000:00010000:1.0:1784043947.086123:0:6496:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000223ad1ac/0x89871fc3aba17b3a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784043947.086140:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000223ad1ac/0x89871fc3aba17b3a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784043947.086146:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000223ad1ac/0x89871fc3aba17b3a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784043947.086152:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000223ad1ac/0x89871fc3aba17b3a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784043947.086157:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000223ad1ac already unused, calling callback (00000000622db14d) 00010000:00010000:1.0:1784043947.086160:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000223ad1ac/0x89871fc3aba17b3a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784043947.086166:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000223ad1ac/0x89871fc3aba17b3a lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784043947.086199:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000223ad1ac/0x89871fc3aba17b3a lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784043947.086210:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784043947.086239:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000032b9c978 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+12:3638:x1870705580837888:12345-0@lo:103: Request processed in 183us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1784043947.086245:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1784043947.086281:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000082f1c680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:3638:1870705580837888:0@lo:103: 00010000:00010000:0.0:1784043947.086893:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000ddbfebf1/0x89871fc3aba17b09 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x89871fc3aba17b02 expref: 11 pid: 6505 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784043947.086913:0:6527:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000019726bed pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6527:1870705580837760:0@lo:104: 00010000:00010000:0.0:1784043947.086927:0:6527:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000223ad1ac/0x89871fc3aba17b3a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784043947.086935:0:6527:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000223ad1ac/0x89871fc3aba17b3a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784043947.086941:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000223ad1ac/0x89871fc3aba17b3a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784043947.086948:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000223ad1ac/0x89871fc3aba17b3a lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:3.0:1784043947.099170:0:6488:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00080000:10000000:0.0:1784043947.106990:0:6488:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:0.0:1784043947.107704:0:6488:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00080000:10000000:0.0:1784043947.109744:0:6488:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:0.0:1784043947.110139:0:6488:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00080000:10000000:0.0:1784043947.112735:0:6488:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:10000000:0.0:1784043947.125401:0:6488:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00080000:10000000:2.0:1784043947.133239:0:6488:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:2.0:1784043947.133962:0:6488:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00080000:10000000:2.0:1784043947.134144:0:6488:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:2.0:1784043947.134913:0:6488:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00080000:10000000:2.0:1784043947.135097:0:6488:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 40000000:02000000:2.0:1784043947.144908:0:6488:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:3.0:1784043947.172985:0:6488:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:3.0:1784043947.175069:0:6545:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:0.0:1784043947.182405:0:6488:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1784043947.182551:0:6488:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000020:00080000:1.0:1784043947.183976:0:6544:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:1.0:1784043947.183983:0:6544:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:00080000:3.0:1784043947.186713:0:6545:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1784043947.189252:0:6488:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1784043947.189273:0:6488:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1784043947.191798:0:6488:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1784043947.195338:0:6488:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1784043947.199426:0:6488:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1784043947.201100:0:6488:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:1.0:1784043947.202077:0:6488:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:1.0:1784043947.202767:0:6488:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x10:0x0] (8/32) registered 00100000:10000000:1.0:1784043947.219360:0:6488:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:1.0:1784043947.224267:0:6488:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00000040:00080000:3.0:1784043947.227095:0:6545:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1784043947.227217:0:6545:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1784043947.227222:0:6545:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00100000:10000000:1.0:1784043947.227594:0:6488:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:1.0:1784043947.227782:0:6488:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:1.0:1784043947.227920:0:6488:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:1.0:1784043947.228055:0:6488:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:1.0:1784043947.228257:0:6488:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:1.0:1784043947.228394:0:6488:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:1.0:1784043947.228535:0:6488:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:1.0:1784043947.228663:0:6488:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:1.0:1784043947.228827:0:6488:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:1.0:1784043947.228988:0:6488:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:1.0:1784043947.229127:0:6488:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:1.0:1784043947.229300:0:6488:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:1.0:1784043947.229462:0:6488:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:1.0:1784043947.229595:0:6488:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:0.0:1784043947.240368:0:6488:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:0.0:1784043947.240740:0:6488:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:0.0:1784043947.240880:0:6488:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:0.0:1784043947.241069:0:6488:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:0.0:1784043947.241223:0:6488:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:0.0:1784043947.241392:0:6488:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:0.0:1784043947.241523:0:6488:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:0.0:1784043947.241660:0:6488:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:0.0:1784043947.241789:0:6488:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:0.0:1784043947.241922:0:6488:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:0.0:1784043947.242059:0:6488:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:0.0:1784043947.242221:0:6488:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:0.0:1784043947.242368:0:6488:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:0.0:1784043947.242517:0:6488:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:0.0:1784043947.242652:0:6488:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:0.0:1784043947.242810:0:6488:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:0.0:1784043947.243021:0:6488:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000001:00080000:0.0:1784043947.260693:0:6488:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1784043947.260757:0:6488:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb73bc1c77988 00100000:10000000:0.0:1784043947.260768:0:6488:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:3.0:1784043947.263246:0:6488:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1784043947.263264:0:6488:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.140@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1784043947.263287:0:6488:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:3.0:1784043947.263315:0:6488:0:(super25.c:181:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:3.0:1784043947.264914:0:6488:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1784043947.265064:0:6488:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:0.0:1784043947.661768:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784043948.685702:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784043949.709378:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784043950.740734:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784043951.757346:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1784043952.205434:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1784043952.205444:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1784043952.205446:0:8:0:(import.c:65:import_set_state_nolock()) 0000000079b3567c lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784043952.205458:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 0000000079b3567c using connection 192.168.202.140@tcp/0@lo 00000100:00100000:2.0:1784043952.205479:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000026c68162 x1870705580838144/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1784043952.205520:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000026c68162 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3637:1870705580838144:0@lo:38: 00000100:00100000:2.0:1784043952.205587:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784043952.205819:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784043952.205828:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000010506563 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:3641:1870705580838016:0@lo:400: 00000100:00100000:0.0:1784043952.205865:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784043952.205907:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580838144 00000100:00100000:0.0:1784043952.205914:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580838144 00000100:00100000:0.0:1784043952.205952:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1784043952.205957:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d6678297 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3637:x1870705580838144:12345-0@lo:38: 00010000:00080000:0.0:1784043952.205990:0:6513:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 145 last 0 00000020:00000080:0.0:1784043952.206039:0:6513:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x89871fc3aba17b41 00000004:00100000:0.0:1784043952.206080:0:6513:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1784043952.206218:0:6513:0:(import.c:65:import_set_state_nolock()) 000000006efcdd74 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1784043952.206267:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d6678297 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1870705580838144:12345-0@lo:38: Request processed in 308us (680us total) trans 0 rc 0/0 00000100:00100000:0.0:1784043952.206275:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1784043952.206501:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580838016 00000100:00100000:2.0:1784043952.206505:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580838016 00000100:00100000:2.0:1784043952.206547:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1784043952.206553:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bba55baf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+11:3641:x1870705580838016:12345-0@lo:400: 00000100:00100000:2.0:1784043952.206593:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bba55baf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+11:3641:x1870705580838016:12345-0@lo:400: Request processed in 41us (728us total) trans 0 rc 0/0 00000100:00100000:2.0:1784043952.206600:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:2.0:1784043952.206639:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000026c68162 x1870705580838144/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784043962 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1784043952.206664:0:3637:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1784043952.206670:0:3637:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1784043952.206674:0:3637:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1784043952.206676:0:3637:0:(import.c:65:import_set_state_nolock()) 0000000079b3567c lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1784043952.206693:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000026c68162 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3637:1870705580838144:0@lo:38: 00000100:00100000:2.0:1784043952.206724:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000010506563 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:3641:1870705580838016:0@lo:400: 00000001:02000400:3.0:1784043952.684480:0:6789:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg240-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1784043952.781342:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784043953.811477:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1784043954.166012:0:6841:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1784043954.166872:0:6841:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1784043954.833566:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784043955.856634:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1784043956.303908:0:6508:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1784043956.303916:0:6508:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9b397418c800 from 3 10000000:01000000:3.0:1784043956.303922:0:6508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1784043956.303973:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: 00000000223ad1ac/0x89871fc3aba17b48 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043956.303986:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: 00000000223ad1ac/0x89871fc3aba17b48 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043956.304007:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: 00000000223ad1ac/0x89871fc3aba17b48 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784043956.304030:0:6508:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000c5d3aaaa pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580838272:0@lo:101: 00000100:00100000:3.0:1784043956.304101:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784043956.304209:0:6508:0:(client.c:2702:ptlrpc_set_wait()) set 00000000d179cd1b going to sleep for 11 seconds 00000100:00100000:0.0:1784043956.304299:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580838272 00000100:00100000:0.0:1784043956.304306:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580838272 00000100:00100000:0.0:1784043956.304370:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1784043956.304378:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000907b0c4d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+11:6508:x1870705580838272:12345-0@lo:101: 00010000:00010000:0.0:1784043956.304392:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784043956.304404:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000585760e8/0x89871fc3aba17b4f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x89871fc3aba17b48 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784043956.304425:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000585760e8/0x89871fc3aba17b4f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x89871fc3aba17b48 expref: 12 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784043956.304435:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000585760e8/0x89871fc3aba17b4f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x89871fc3aba17b48 expref: 12 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784043956.304443:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000585760e8, rc 0) 00000100:00100000:0.0:1784043956.304497:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000907b0c4d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+12:6508:x1870705580838272:12345-0@lo:101: Request processed in 119us (395us total) trans 0 rc 0/0 00000100:00100000:0.0:1784043956.304503:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1784043956.305025:0:6508:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000c5d3aaaa pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580838272:0@lo:101: 00010000:00010000:3.0:1784043956.305056:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: 00000000223ad1ac/0x89871fc3aba17b48 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba17b4f expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043956.305064:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: 00000000223ad1ac/0x89871fc3aba17b48 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x89871fc3aba17b4f expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784043956.305114:0:6508:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000c5d3aaaa pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580838400:0@lo:256: 00000100:00100000:3.0:1784043956.305160:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784043956.305207:0:6508:0:(client.c:2702:ptlrpc_set_wait()) set 00000000d179cd1b going to sleep for 11 seconds 00000100:00100000:0.0:1784043956.305719:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580838400 00000100:00100000:0.0:1784043956.305731:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580838400 00000100:00100000:0.0:1784043956.305766:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1784043956.305773:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c356e712 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+12:6508:x1870705580838400:12345-0@lo:256: 20000000:01000000:0.0:1784043956.305788:0:6504:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1784043956.305805:0:6504:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1784043956.305808:0:6504:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:0.0:1784043956.305899:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c356e712 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+12:6508:x1870705580838400:12345-0@lo:256: Request processed in 126us (750us total) trans 0 rc 0/0 00000100:00100000:0.0:1784043956.305907:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1784043956.306208:0:6508:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000c5d3aaaa pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580838400:0@lo:256: 10000000:01000000:3.0:1784043956.306260:0:6508:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1784043956.306267:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: 00000000223ad1ac/0x89871fc3aba17b48 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba17b4f expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043956.306275:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: 00000000223ad1ac/0x89871fc3aba17b48 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba17b4f expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784043956.885938:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784043957.326054:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784043957.326088:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000003a03e1a0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3639:1870705580838656:0@lo:400: 00000100:00100000:0.0:1784043957.326221:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784043957.327085:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784043957.327106:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000d69d1044 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:3640:1870705580838528:0@lo:400: 00000100:00100000:1.0:1784043957.327167:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784043957.327746:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580838528 00000100:00100000:0.0:1784043957.327758:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580838528 00000100:00100000:0.0:1784043957.327837:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1784043957.327847:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005e879422 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+12:3640:x1870705580838528:12345-0@lo:400: 00000100:00100000:0.0:1784043957.327928:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005e879422 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+12:3640:x1870705580838528:12345-0@lo:400: Request processed in 82us (760us total) trans 0 rc 0/0 00000100:00100000:0.0:1784043957.327937:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1784043957.328068:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000d69d1044 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:3640:1870705580838528:0@lo:400: 00000100:00100000:2.0:1784043957.328524:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580838656 00000100:00100000:2.0:1784043957.328531:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580838656 00000100:00100000:2.0:1784043957.328575:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1784043957.328581:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000062bff2a6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1870705580838656:12345-0@lo:400: 00000100:00100000:2.0:1784043957.328729:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000062bff2a6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1870705580838656:12345-0@lo:400: Request processed in 148us (2508us total) trans 0 rc 0/0 00000100:00100000:2.0:1784043957.328737:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1784043957.328849:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000003a03e1a0 x1870705580838656/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784043973 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784043957.328881:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000003a03e1a0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3639:1870705580838656:0@lo:400: 00000020:00000004:1.0:1784043957.657156:0:6943:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1784043957.657496:0:6943:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1784043957.901562:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784043958.927724:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784043959.949986:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784043960.981961:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784043961.998567:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784043962.446557:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000000b7cd25d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:3639:1870705580838784:0@lo:400: 00000100:00100000:0.0:1784043962.446646:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784043962.446715:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000077f84d32 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1870705580838912:0@lo:400: 00000100:00100000:0.0:1784043962.446744:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784043962.446781:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580838784 00000100:00100000:0.0:1784043962.446789:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580838784 00000100:00100000:0.0:1784043962.446841:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1784043962.446848:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000097979123 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+12:3639:x1870705580838784:12345-0@lo:400: 00000100:00100000:0.0:1784043962.446899:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000097979123 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+12:3639:x1870705580838784:12345-0@lo:400: Request processed in 51us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1784043962.446906:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1784043962.446937:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580838912 00000100:00100000:0.0:1784043962.446941:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580838912 00000100:00100000:0.0:1784043962.446968:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1784043962.446973:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009c654ea7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1870705580838912:12345-0@lo:400: 00000100:00100000:0.0:1784043962.447008:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009c654ea7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1870705580838912:12345-0@lo:400: Request processed in 35us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1784043962.447014:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1784043962.447053:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000077f84d32 x1870705580838912/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784043978 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784043962.447068:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000077f84d32 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1870705580838912:0@lo:400: 00000100:00100000:0.0:1784043962.447092:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000000b7cd25d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:3639:1870705580838784:0@lo:400: 00010000:00010000:1.0:1784043963.022544:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784043964.052799:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784043965.070415:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784043966.093483:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784043967.117807:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784043967.566126:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000010506563 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:3641:1870705580839040:0@lo:400: 00000100:00100000:2.0:1784043967.566220:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784043967.566299:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000026c68162 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1870705580839168:0@lo:400: 00000100:00100000:2.0:1784043967.566331:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784043967.566371:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580839168 00000100:00100000:2.0:1784043967.566393:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580839168 00000100:00100000:2.0:1784043967.566440:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1784043967.566448:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000872ccc56 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1870705580839168:12345-0@lo:400: 00000100:00100000:2.0:1784043967.566497:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000872ccc56 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1870705580839168:12345-0@lo:400: Request processed in 50us (166us total) trans 0 rc 0/0 00000100:00100000:2.0:1784043967.566517:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1784043967.566573:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000026c68162 x1870705580839168/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784043983 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784043967.566586:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000026c68162 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1870705580839168:0@lo:400: 00000100:00100000:0.0:1784043967.568508:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580839040 00000100:00100000:0.0:1784043967.568520:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580839040 00000100:00100000:0.0:1784043967.568626:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1784043967.568636:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000091788804 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+12:3641:x1870705580839040:12345-0@lo:400: 00000100:00100000:0.0:1784043967.568849:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000091788804 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+12:3641:x1870705580839040:12345-0@lo:400: Request processed in 213us (2628us total) trans 0 rc 0/0 00000100:00100000:0.0:1784043967.568857:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1784043967.569511:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000010506563 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:3641:1870705580839040:0@lo:400: 00000020:01000004:0.0:1784043967.985146:0:7441:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1784043967.985150:0:7441:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:0.0:1784043967.985151:0:7441:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:0.0:1784043967.985762:0:7441:0:(super25.c:130:lustre_fill_super()) VFS Op: sb 00000000d57c954a 00000020:01000004:0.0:1784043967.985780:0:7441:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200061, mountfl=0 00000020:01000004:0.0:1784043967.985793:0:7441:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1784043967.985807:0:7441:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (00000000e0dab3ec) 00000020:00000080:0.0:1784043967.985824:0:7441:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1784043968.056365:0:7441:0:(scrub.c:229:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00100000:10000000:0.0:1784043968.056441:0:7441:0:(scrub.c:229:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00080000:01000000:0.0:1784043968.082650:0:7441:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1784043968.083009:0:7441:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:0.0:1784043968.083021:0:7441:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:0.0:1784043968.083033:0:7441:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x89871fc3aba17b5d 00000020:01000004:0.0:1784043968.083040:0:7441:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:0.0:1784043968.083061:0:7441:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.140@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1784043968.083064:0:7441:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.140@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1784043968.083070:0:7441:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:0.0:1784043968.083097:0:7441:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:0.0:1784043968.083101:0:7441:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.140@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:3.0:1784043968.116246:0:7441:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.140@tcp ctxt 0 is initialized 00000020:01000004:3.0:1784043968.116297:0:7441:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.202.140@tcp, index=0001, flags=0x20061 00000020:01000004:3.0:1784043968.116301:0:7441:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1784043968.116303:0:7441:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1784043968.116304:0:7441:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1784043968.116305:0:7441:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1784043968.116307:0:7441:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1784043968.116308:0:7441:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1784043968.116309:0:7441:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1784043968.116310:0:7441:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1784043968.116311:0:7441:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1784043968.116317:0:7441:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1784043968.116318:0:7441:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1784043968.116321:0:7441:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020061 00000020:01000004:3.0:1784043968.116324:0:7441:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1784043968.116325:0:7441:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1784043968.116326:0:7441:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1784043968.116327:0:7441:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1784043968.116328:0:7441:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1784043968.116329:0:7441:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1784043968.116330:0:7441:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1784043968.116331:0:7441:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1784043968.116331:0:7441:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1784043968.116332:0:7441:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1784043968.116333:0:7441:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1784043968.116359:0:7441:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:3.0:1784043968.116377:0:7441:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000c5d3aaaa pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:7441:1870705580839296:0@lo:253: 00000100:00100000:3.0:1784043968.116445:0:7441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784043968.116491:0:7441:0:(client.c:2702:ptlrpc_set_wait()) set 0000000011da9b11 going to sleep for 11 seconds 00000100:00100000:0.0:1784043968.116802:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580839296 00000100:00100000:0.0:1784043968.116812:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580839296 00000100:00100000:0.0:1784043968.116870:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1784043968.116879:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000060988355 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+12:7441:x1870705580839296:12345-0@lo:253: 20000000:01000000:0.0:1784043968.116935:0:6504:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1784043968.116940:0:6504:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0001, index=1 20000000:01000000:0.0:1784043968.116945:0:6504:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0001 to 1 20000000:01000000:0.0:1784043968.116949:0:6504:0:(mgs_llog.c:3608:mgs_write_log_mdt()) writing new mdt lustre-MDT0001 20000000:01000000:0.0:1784043968.116985:0:6504:0:(mgs_llog.c:3168:mgs_write_log_lov()) Writing lov(lustre-MDT0001-mdtlov) log for lustre-MDT0001 00000040:00080000:0.0:1784043968.117221:0:6504:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1784043968.117477:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:0.0:1784043968.117491:0:6504:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf001 lov lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1784043968.117509:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:0.0:1784043968.117525:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:0.0:1784043968.117565:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:0.0:1784043968.117627:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 20000000:01000000:0.0:1784043968.117636:0:6504:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf001 mdt lustre-MDT0001_UUID (null) (null) 00000040:00080000:0.0:1784043968.117651:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 20000000:01000000:0.0:1784043968.117657:0:6504:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0001 lustre-MDT0001-mdtlov (null) (null) 00000040:00080000:0.0:1784043968.117670:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 20000000:01000000:0.0:1784043968.117676:0:6504:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf003 lustre-MDT0001_UUID 1 lustre-MDT0001-mdtlov f 00000040:00080000:0.0:1784043968.117690:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:0.0:1784043968.117707:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:0.0:1784043968.117814:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 20000000:01000000:0.0:1784043968.117824:0:6504:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.140@tcp (null) (null) (null) 00000040:00080000:0.0:1784043968.117838:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 20000000:01000000:0.0:1784043968.117846:0:6504:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf001 osp lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1784043968.117861:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 20000000:01000000:0.0:1784043968.117867:0:6504:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf003 lustre-MDT0000_UUID 192.168.202.140@tcp (null) (null) 00000040:00080000:0.0:1784043968.117881:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 20000000:01000000:0.0:1784043968.117888:0:6504:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:0.0:1784043968.117904:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:0.0:1784043968.117923:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:0.0:1784043968.117935:0:6504:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:0.0:1784043968.118376:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 20000000:01000000:0.0:1784043968.118387:0:6504:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf009 sys.timeout=20 (null) (null) (null) 00000040:00080000:0.0:1784043968.118400:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:0.0:1784043968.118416:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:0.0:1784043968.118432:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 20000000:01000000:0.0:1784043968.118437:0:6504:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf00f mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (null) (null) (null) 00000040:00080000:0.0:1784043968.118448:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:0.0:1784043968.118468:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:0.0:1784043968.118474:0:6504:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 20000000:01000000:0.0:1784043968.118498:0:6504:0:(mgs_llog.c:3305:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0001 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:0.0:1784043968.118511:0:6504:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0001/add mdc fl=4 00000040:00080000:3.0:1784043968.119123:0:7447:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:2.0:1784043968.120358:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:2.0:1784043968.120645:0:6504:0:(mgs_llog.c:3351:mgs_write_log_mdc_to_lmv()) add nid 192.168.202.140@tcp for mdt 20000000:01000000:2.0:1784043968.120648:0:6504:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.140@tcp (null) (null) (null) 00000040:00080000:2.0:1784043968.120670:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:2.0:1784043968.120677:0:6504:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:2.0:1784043968.120690:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:2.0:1784043968.120696:0:6504:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf003 lustre-MDT0001_UUID 192.168.202.140@tcp (null) (null) 00000040:00080000:2.0:1784043968.120713:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:2.0:1784043968.120721:0:6504:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0001_UUID 1 1 lustre-MDT0001-mdc_UUID 00000040:00080000:2.0:1784043968.120735:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 160 off12472 00000040:00080000:2.0:1784043968.120751:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12696 20000000:01000000:2.0:1784043968.120841:0:6504:0:(mgs_llog.c:3431:mgs_write_log_osp_to_mdt()) adding osp index 1 to lustre-MDT0000 20000000:01000000:2.0:1784043968.120850:0:6504:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre-MDT0001/add osp fl=4 00000040:00080000:0.0:1784043968.121838:0:7448:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000040:00080000:2.0:1784043968.122486:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:2.0:1784043968.122508:0:6504:0:(mgs_llog.c:3489:mgs_write_log_osp_to_mdt()) add nid 192.168.202.140@tcp for mdt 20000000:01000000:2.0:1784043968.122510:0:6504:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.140@tcp (null) (null) (null) 00000040:00080000:2.0:1784043968.122522:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:2.0:1784043968.122527:0:6504:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf001 osp lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1784043968.122548:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:2.0:1784043968.122554:0:6504:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf003 lustre-MDT0001_UUID 192.168.202.140@tcp (null) (null) 00000040:00080000:2.0:1784043968.122565:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:2.0:1784043968.122570:0:6504:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf014 lustre-MDT0001_UUID 1 1 (null) 00000040:00080000:2.0:1784043968.122580:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:2.0:1784043968.122591:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 20000000:01000000:2.0:1784043968.122623:0:6504:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:2.0:1784043968.122627:0:6504:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1784043968.122630:0:6504:0:(mgs_llog.c:4177:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1784043968.122672:0:6504:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1784043968.122674:0:6504:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1784043968.123106:0:7449:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 8 1->4: lustre sys.timeout 20000000:01000000:1.0:1784043968.123125:0:7449:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 8 2->4: lustre sys.timeout 00000040:00080000:1.0:1784043968.123136:0:7449:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:2.0:1784043968.123605:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:2.0:1784043968.123626:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:2.0:1784043968.123644:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:2.0:1784043968.123655:0:6504:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:2.0:1784043968.123657:0:6504:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:0.0:1784043968.124086:0:7450:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 16 marker 14 1->4: lustre sys.timeout 20000000:01000000:0.0:1784043968.124111:0:7450:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 14 2->4: lustre sys.timeout 00000040:00080000:0.0:1784043968.124128:0:7450:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 22 count 22 00000040:00080000:2.0:1784043968.124576:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:2.0:1784043968.124594:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:2.0:1784043968.124608:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 20000000:01000000:2.0:1784043968.124616:0:6504:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1784043968.124618:0:6504:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1784043968.124868:0:7451:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 9 1->4: lustre sys.timeout 20000000:01000000:0.0:1784043968.124967:0:7451:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 9 2->4: lustre sys.timeout 00000040:00080000:0.0:1784043968.124991:0:7451:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:2.0:1784043968.125451:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12920 00000040:00080000:2.0:1784043968.125471:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off13000 00000040:00080000:2.0:1784043968.125488:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13224 20000000:01000000:2.0:1784043968.125500:0:6504:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1784043968.125502:0:6504:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1784043968.125507:0:6504:0:(mgs_llog.c:5068:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:2.0:1784043968.125514:0:6504:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0001/lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:1.0:1784043968.126367:0:7452:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 20 count 25 20000000:00000400:2.0:1784043968.126489:0:6504:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 10000000:01000000:2.0:1784043968.134707:0:6504:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1784043968.134807:0:6504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000007abbfdbf/0x89871fc3aba17b64 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043968.134826:0:6504:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000075608ee/0x89871fc3aba17a99 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x89871fc3aba17a92 expref: 12 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043968.134832:0:6504:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000006675d783/0x89871fc3aba17ab5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x89871fc3aba17aae expref: 12 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043968.134837:0:6504:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000000081fd5/0x89871fc3aba17b25 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x89871fc3aba17b1e expref: 12 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043968.134843:0:6504:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000007abbfdbf/0x89871fc3aba17b64 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043968.134881:0:6504:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000000081fd5/0x89871fc3aba17b25 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x89871fc3aba17b1e expref: 12 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043968.134963:0:6504:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000000081fd5/0x89871fc3aba17b25 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x89871fc3aba17b1e expref: 12 pid: 6505 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784043968.134976:0:6504:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000001127ed1d pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6504:1870705580839424:0@lo:104: 00000100:00100000:3.0:1784043968.135097:0:6504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1784043968.135212:0:6504:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000006675d783/0x89871fc3aba17ab5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x89871fc3aba17aae expref: 12 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043968.135219:0:6504:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000006675d783/0x89871fc3aba17ab5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x89871fc3aba17aae expref: 12 pid: 6505 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784043968.135226:0:6504:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000054f985b pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6504:1870705580839552:0@lo:104: 00000100:00100000:3.0:1784043968.135244:0:6504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1784043968.135772:0:6504:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000075608ee/0x89871fc3aba17a99 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x89871fc3aba17a92 expref: 12 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043968.135780:0:6504:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000075608ee/0x89871fc3aba17a99 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x89871fc3aba17a92 expref: 12 pid: 6504 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784043968.135787:0:6504:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000007a6e663b pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6504:1870705580839680:0@lo:104: 00000100:00100000:3.0:1784043968.135805:0:6504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784043968.135868:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580839424 00000100:00100000:1.0:1784043968.135875:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580839424 00000100:00100000:1.0:1784043968.135915:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580839552 00000100:00100000:1.0:1784043968.135918:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580839552 00000100:00100000:1.0:1784043968.135928:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1784043968.135933:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000021cc6b4b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+4:6504:x1870705580839424:12345-0@lo:104: 00010000:00010000:1.0:1784043968.135944:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.140@tcp lock: 000000000d0d828f/0x89871fc3aba17b1e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x89871fc3aba17b25 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784043968.135999:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1784043968.136003:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000021cc6b4b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+4:6504:x1870705580839424:12345-0@lo:104: Request processed in 70us (907us total) trans 0 rc 0/0 00000100:00100000:1.0:1784043968.136009:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1784043968.136026:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1784043968.136031:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000495a249f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+3:6504:x1870705580839552:12345-0@lo:104: 00010000:00010000:1.0:1784043968.136038:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.140@tcp lock: 0000000017dbd489/0x89871fc3aba17aae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x89871fc3aba17ab5 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784043968.136073:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1784043968.136076:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000495a249f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+3:6504:x1870705580839552:12345-0@lo:104: Request processed in 46us (833us total) trans 0 rc 0/0 00000100:00100000:1.0:1784043968.136081:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:1.0:1784043968.136095:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1784043968.136099:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: 000000000d0d828f/0x89871fc3aba17b1e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x89871fc3aba17b25 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784043968.136105:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000000d0d828f already unused, calling callback (00000000c6a82693) 10000000:00010000:1.0:1784043968.136108:0:6499:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: 000000000d0d828f/0x89871fc3aba17b1e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x89871fc3aba17b25 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784043968.136114:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: 000000000d0d828f/0x89871fc3aba17b1e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x89871fc3aba17b25 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784043968.136120:0:6499:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: 000000000d0d828f/0x89871fc3aba17b1e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x89871fc3aba17b25 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784043968.136124:0:6499:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1784043968.136145:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.140@tcp lock: 000000000d0d828f/0x89871fc3aba17b1e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x89871fc3aba17b25 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784043968.136150:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784043968.136164:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: 000000000d0d828f/0x89871fc3aba17b1e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x89871fc3aba17b25 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784043968.136169:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: 000000000d0d828f/0x89871fc3aba17b1e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x89871fc3aba17b25 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784043968.136215:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784043968.136217:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: 0000000017dbd489/0x89871fc3aba17aae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x89871fc3aba17ab5 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784043968.136222:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000017dbd489 already unused, calling callback (00000000c6a82693) 10000000:00010000:1.0:1784043968.136223:0:6499:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: 0000000017dbd489/0x89871fc3aba17aae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x89871fc3aba17ab5 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784043968.136228:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: 0000000017dbd489/0x89871fc3aba17aae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x89871fc3aba17ab5 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784043968.136233:0:6499:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: 0000000017dbd489/0x89871fc3aba17aae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x89871fc3aba17ab5 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784043968.136237:0:6499:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1784043968.136246:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.140@tcp lock: 0000000017dbd489/0x89871fc3aba17aae lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x89871fc3aba17ab5 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784043968.136250:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784043968.136266:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: 0000000017dbd489/0x89871fc3aba17aae lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x89871fc3aba17ab5 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784043968.136371:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: 0000000017dbd489/0x89871fc3aba17aae lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x89871fc3aba17ab5 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784043968.136381:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784043968.136382:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784043968.136384:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784043968.136441:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784043968.136712:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1784043968.136725:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000007c4c8a71 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:3641:1870705580839936:0@lo:103: 00000100:00100000:3.0:1784043968.136755:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784043968.136805:0:6504:0:(client.c:2702:ptlrpc_set_wait()) set 0000000003b24a1b going to sleep for 11 seconds 00000100:00100000:3.0:1784043968.136825:0:6504:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000001127ed1d pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6504:1870705580839424:0@lo:104: 00000100:00100000:3.0:1784043968.136833:0:6504:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000054f985b pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6504:1870705580839552:0@lo:104: 00000100:00100000:0.0:1784043968.136891:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580839936 00000100:00100000:0.0:1784043968.136896:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580839936 00010000:00010000:0.0:1784043968.136916:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000006675d783/0x89871fc3aba17ab5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x89871fc3aba17aae expref: 13 pid: 6505 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784043968.136950:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1784043968.136956:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000087dc51f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+13:3641:x1870705580839936:12345-0@lo:103: 00010000:00010000:0.0:1784043968.136966:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784043968.136970:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000006675d783/0x89871fc3aba17ab5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x89871fc3aba17aae expref: 13 pid: 6505 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784043968.136977:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000006675d783/0x89871fc3aba17ab5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x89871fc3aba17aae expref: 13 pid: 6505 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784043968.136989:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000006675d783/0x89871fc3aba17ab5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x89871fc3aba17aae expref: 13 pid: 6505 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784043968.137012:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784043968.137043:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000087dc51f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+12:3641:x1870705580839936:12345-0@lo:103: Request processed in 88us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1784043968.137050:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1784043968.137082:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000007c4c8a71 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:3641:1870705580839936:0@lo:103: 00000100:00100000:1.0:1784043968.137270:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580839680 00000100:00100000:1.0:1784043968.137338:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580839680 00000100:00100000:1.0:1784043968.137359:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1784043968.137364:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009bde8c4e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+3:6504:x1870705580839680:12345-0@lo:104: 00010000:00010000:1.0:1784043968.137372:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.140@tcp lock: 0000000001bcae1a/0x89871fc3aba17a92 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x89871fc3aba17a99 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784043968.137415:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1784043968.137419:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009bde8c4e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+3:6504:x1870705580839680:12345-0@lo:104: Request processed in 56us (1614us total) trans 0 rc 0/0 00000100:00100000:1.0:1784043968.137426:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:1.0:1784043968.137441:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784043968.137444:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: 0000000001bcae1a/0x89871fc3aba17a92 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x89871fc3aba17a99 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784043968.137450:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000001bcae1a already unused, calling callback (00000000c6a82693) 10000000:00010000:1.0:1784043968.137452:0:6499:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: 0000000001bcae1a/0x89871fc3aba17a92 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x89871fc3aba17a99 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784043968.137457:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: 0000000001bcae1a/0x89871fc3aba17a92 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x89871fc3aba17a99 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784043968.137462:0:6499:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: 0000000001bcae1a/0x89871fc3aba17a92 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x89871fc3aba17a99 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784043968.137467:0:6499:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1784043968.137485:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.140@tcp lock: 0000000001bcae1a/0x89871fc3aba17a92 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x89871fc3aba17a99 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784043968.137490:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784043968.137497:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: 0000000001bcae1a/0x89871fc3aba17a92 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x89871fc3aba17a99 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784043968.137509:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: 0000000001bcae1a/0x89871fc3aba17a92 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x89871fc3aba17a99 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784043968.137521:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784043968.137523:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784043968.137524:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784043968.137638:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000eccecfda pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:3641:1870705580840064:0@lo:103: 00000100:00100000:0.0:1784043968.137668:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784043968.137720:0:6504:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000007a6e663b pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6504:1870705580839680:0@lo:104: 00010000:00010000:0.0:1784043968.137739:0:6504:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000007abbfdbf/0x89871fc3aba17b64 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784043968.137788:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580840064 00000100:00100000:1.0:1784043968.137792:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580840064 00010000:00010000:1.0:1784043968.137808:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000075608ee/0x89871fc3aba17a99 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x89871fc3aba17a92 expref: 12 pid: 6504 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784043968.137837:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1784043968.137844:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000b7cd25d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+12:3641:x1870705580840064:12345-0@lo:103: 00010000:00010000:1.0:1784043968.137853:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784043968.137856:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000075608ee/0x89871fc3aba17a99 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x89871fc3aba17a92 expref: 12 pid: 6504 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784043968.137863:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000075608ee/0x89871fc3aba17a99 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x89871fc3aba17a92 expref: 12 pid: 6504 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784043968.137875:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000075608ee/0x89871fc3aba17a99 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x89871fc3aba17a92 expref: 12 pid: 6504 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784043968.137885:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784043968.137971:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000b7cd25d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+11:3641:x1870705580840064:12345-0@lo:103: Request processed in 127us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1784043968.137978:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1784043968.138220:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000082f1c680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:3639:1870705580839808:0@lo:103: 00000100:00100000:2.0:1784043968.138253:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784043968.138432:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580839808 00000100:00100000:1.0:1784043968.138445:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580839808 00010000:00010000:1.0:1784043968.138460:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000000081fd5/0x89871fc3aba17b25 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x89871fc3aba17b1e expref: 11 pid: 6505 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784043968.138490:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1784043968.138497:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000026c68162 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+11:3639:x1870705580839808:12345-0@lo:103: 00010000:00010000:1.0:1784043968.138506:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784043968.138509:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000000081fd5/0x89871fc3aba17b25 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x89871fc3aba17b1e expref: 11 pid: 6505 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784043968.138518:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000000081fd5/0x89871fc3aba17b25 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x89871fc3aba17b1e expref: 11 pid: 6505 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784043968.138530:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000000081fd5/0x89871fc3aba17b25 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x89871fc3aba17b1e expref: 11 pid: 6505 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784043968.138553:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000007abbfdbf/0x89871fc3aba17b64 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784043968.138562:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000007abbfdbf/0x89871fc3aba17b64 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784043968.138576:0:6497:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000007abbfdbf/0x89871fc3aba17b64 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784043968.138583:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000007abbfdbf/0x89871fc3aba17b64 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784043968.138589:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000007abbfdbf/0x89871fc3aba17b64 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784043968.138595:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000007abbfdbf/0x89871fc3aba17b64 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784043968.138608:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000007abbfdbf already unused, calling callback (00000000622db14d) 00010000:00010000:1.0:1784043968.138612:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000007abbfdbf/0x89871fc3aba17b64 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784043968.138619:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000007abbfdbf/0x89871fc3aba17b64 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784043968.138777:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000eccecfda pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:3641:1870705580840064:0@lo:103: 00010000:00010000:0.0:1784043968.138877:0:6504:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000007abbfdbf/0x89871fc3aba17b64 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784043968.138897:0:6504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000007abbfdbf/0x89871fc3aba17b64 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1784043968.138911:0:6504:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00010000:00010000:1.0:1784043968.139127:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000007abbfdbf/0x89871fc3aba17b64 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784043968.139138:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000007abbfdbf/0x89871fc3aba17b64 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784043968.139154:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784043968.139227:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000026c68162 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+10:3639:x1870705580839808:12345-0@lo:103: Request processed in 731us (974us total) trans 0 rc 0/0 00000100:00100000:1.0:1784043968.139235:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1784043968.141265:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000082f1c680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:3639:1870705580839808:0@lo:103: 00010000:00010000:2.0:1784043968.141468:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784043968.141854:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000060988355 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+9:7441:x1870705580839296:12345-0@lo:253: Request processed in 24975us (25407us total) trans 0 rc 0/0 00000100:00100000:0.0:1784043968.141866:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1784043968.142083:0:7441:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000c5d3aaaa pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:7441:1870705580839296:0@lo:253: 10000000:01000000:3.0:1784043968.142098:0:7441:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:3.0:1784043968.142101:0:7441:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1784043968.142103:0:7441:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1784043968.142104:0:7441:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1784043968.142105:0:7441:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0001_UUID 00000020:01000004:3.0:1784043968.142106:0:7441:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1784043968.142108:0:7441:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1784043968.142109:0:7441:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1784043968.142110:0:7441:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1784043968.142112:0:7441:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1784043968.142113:0:7441:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1784043968.142133:0:7441:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000d57c954a from lustre-MDT0001 10000000:01000000:3.0:1784043968.142162:0:7441:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:3.0:1784043968.142165:0:7441:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:3.0:1784043968.142488:0:7441:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9b394402b380 local copy 10000000:01000000:3.0:1784043968.142494:0:7441:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1784043968.142529:0:7441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: 0000000050e869a7/0x89871fc3aba17b6b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043968.142549:0:7441:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.202.140@tcp lock: 0000000050e869a7/0x89871fc3aba17b6b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043968.142557:0:7441:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: 0000000050e869a7/0x89871fc3aba17b6b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784043968.142575:0:7441:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000c5d3aaaa pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:7441:1870705580840192:0@lo:101: 00000100:00100000:3.0:1784043968.142614:0:7441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784043968.142652:0:7441:0:(client.c:2702:ptlrpc_set_wait()) set 0000000007f33124 going to sleep for 11 seconds 00000100:00100000:0.0:1784043968.142711:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580840192 00000100:00100000:0.0:1784043968.142718:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580840192 00000100:00100000:0.0:1784043968.142766:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1784043968.142774:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b39808b2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+9:7441:x1870705580840192:12345-0@lo:101: 00010000:00010000:0.0:1784043968.142786:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784043968.142798:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000003791ae2a/0x89871fc3aba17b72 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x89871fc3aba17b6b expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784043968.142819:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000003791ae2a/0x89871fc3aba17b72 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x89871fc3aba17b6b expref: 10 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784043968.142829:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000003791ae2a/0x89871fc3aba17b72 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x89871fc3aba17b6b expref: 10 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784043968.142843:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000003791ae2a, rc 0) 00000100:00100000:0.0:1784043968.142883:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b39808b2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+10:7441:x1870705580840192:12345-0@lo:101: Request processed in 110us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1784043968.142889:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1784043968.143133:0:7441:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000c5d3aaaa pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:7441:1870705580840192:0@lo:101: 00010000:00010000:3.0:1784043968.143146:0:7441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: 0000000050e869a7/0x89871fc3aba17b6b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x89871fc3aba17b72 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043968.143154:0:7441:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: 0000000050e869a7/0x89871fc3aba17b6b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x89871fc3aba17b72 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784043968.143298:0:7441:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000c5d3aaaa pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:7441:1870705580840320:0@lo:501: 00000100:00100000:3.0:1784043968.143323:0:7441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784043968.143346:0:7441:0:(client.c:2702:ptlrpc_set_wait()) set 0000000007f33124 going to sleep for 11 seconds 00000100:00100000:0.0:1784043968.143507:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580840320 00000100:00100000:0.0:1784043968.143512:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580840320 00000100:00100000:0.0:1784043968.143560:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1784043968.143567:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000107defc8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+10:7441:x1870705580840320:12345-0@lo:501: 00000100:00100000:0.0:1784043968.143636:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000107defc8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+10:7441:x1870705580840320:12345-0@lo:501: Request processed in 70us (312us total) trans 0 rc -2/-2 00000100:00100000:0.0:1784043968.143642:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1784043968.143748:0:7441:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000c5d3aaaa pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:7441:1870705580840320:0@lo:501: 10000000:01000000:3.0:1784043968.143762:0:7441:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.140@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1784043968.143780:0:7441:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.140@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1784043968.143785:0:7441:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: 0000000050e869a7/0x89871fc3aba17b6b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x89871fc3aba17b72 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043968.143792:0:7441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: 0000000050e869a7/0x89871fc3aba17b6b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x89871fc3aba17b72 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043968.143798:0:7441:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.140@tcp lock: 0000000050e869a7/0x89871fc3aba17b6b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x89871fc3aba17b72 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043968.143820:0:7441:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1784043968.143850:0:7441:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9b396f3cf800 10000000:01000000:3.0:1784043968.143855:0:7441:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1784043968.143859:0:7441:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9b394402b380 10000000:01000000:3.0:1784043968.143861:0:7441:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:3.0:1784043968.143864:0:7441:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff9b394402b380 from 1 10000000:01000000:3.0:1784043968.143874:0:7441:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1784043968.143980:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784043968.143986:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: 0000000050e869a7/0x89871fc3aba17b6b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x89871fc3aba17b72 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784043968.144011:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000050e869a7 already unused, calling callback (00000000c6a82693) 10000000:00010000:2.0:1784043968.144013:0:6499:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: 0000000050e869a7/0x89871fc3aba17b6b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x89871fc3aba17b72 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784043968.144020:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: 0000000050e869a7/0x89871fc3aba17b6b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0x89871fc3aba17b72 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784043968.144027:0:6499:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: 0000000050e869a7/0x89871fc3aba17b6b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0x89871fc3aba17b72 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784043968.144032:0:6499:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1784043968.144051:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.140@tcp lock: 0000000050e869a7/0x89871fc3aba17b6b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x89871fc3aba17b72 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784043968.144057:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784043968.144085:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: 0000000050e869a7/0x89871fc3aba17b6b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x89871fc3aba17b72 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784043968.144092:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: 0000000050e869a7/0x89871fc3aba17b6b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x89871fc3aba17b72 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784043968.144107:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784043968.144108:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784043968.144110:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784043968.144117:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1784043968.144129:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000004665bde6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:3639:1870705580840576:0@lo:103: 00000100:00100000:2.0:1784043968.144161:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784043968.144219:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580840576 00000100:00100000:2.0:1784043968.144223:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580840576 00000100:00100000:2.0:1784043968.144265:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1784043968.144271:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009c7cab6a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+10:3639:x1870705580840576:12345-0@lo:103: 00010000:00010000:2.0:1784043968.144291:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784043968.144303:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000003791ae2a/0x89871fc3aba17b72 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x89871fc3aba17b6b expref: 10 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784043968.144315:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784043968.144341:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009c7cab6a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+9:3639:x1870705580840576:12345-0@lo:103: Request processed in 70us (179us total) trans 0 rc 0/0 00000100:00100000:2.0:1784043968.144348:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1784043968.144374:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000004665bde6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:3639:1870705580840576:0@lo:103: 00010000:00010000:3.0:1784043968.144612:0:7441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: 0000000065436175/0x89871fc3aba17b79 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043968.144621:0:7441:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: 0000000065436175/0x89871fc3aba17b79 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043968.144629:0:7441:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: 0000000065436175/0x89871fc3aba17b79 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784043968.144644:0:7441:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000c5d3aaaa pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:7441:1870705580840448:0@lo:101: 00000100:00100000:3.0:1784043968.144673:0:7441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784043968.144703:0:7441:0:(client.c:2702:ptlrpc_set_wait()) set 00000000f46353b0 going to sleep for 11 seconds 00000100:00100000:2.0:1784043968.144747:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580840448 00000100:00100000:2.0:1784043968.144751:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580840448 00000100:00100000:2.0:1784043968.144902:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1784043968.144911:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000077f7aee4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+9:7441:x1870705580840448:12345-0@lo:101: 00010000:00010000:2.0:1784043968.144920:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784043968.144931:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000003034c33b/0x89871fc3aba17b80 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x89871fc3aba17b79 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784043968.144949:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000003034c33b/0x89871fc3aba17b80 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x89871fc3aba17b79 expref: 10 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784043968.144959:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000003034c33b/0x89871fc3aba17b80 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x89871fc3aba17b79 expref: 10 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784043968.144965:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000003034c33b, rc 0) 00000100:00100000:2.0:1784043968.145156:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000077f7aee4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+10:7441:x1870705580840448:12345-0@lo:101: Request processed in 247us (482us total) trans 0 rc 0/0 00000100:00100000:2.0:1784043968.145211:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1784043968.145427:0:7441:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000c5d3aaaa pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:7441:1870705580840448:0@lo:101: 00010000:00010000:3.0:1784043968.145441:0:7441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: 0000000065436175/0x89871fc3aba17b79 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba17b80 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043968.145449:0:7441:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: 0000000065436175/0x89871fc3aba17b79 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x89871fc3aba17b80 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784043968.145466:0:7441:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1784043968.145514:0:7441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: 0000000065436175/0x89871fc3aba17b79 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba17b80 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043968.145521:0:7441:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: 0000000065436175/0x89871fc3aba17b79 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba17b80 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784043968.145530:0:7441:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9b396f3cf800 10000000:01000000:3.0:1784043968.145544:0:7441:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1784043968.145549:0:7441:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff9b396f3cf800 from 1 10000000:01000000:3.0:1784043968.145558:0:7441:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1784043968.145578:0:7441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: 00000000db0b2bd0/0x89871fc3aba17b87 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043968.145585:0:7441:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: 00000000db0b2bd0/0x89871fc3aba17b87 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043968.145591:0:7441:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: 00000000db0b2bd0/0x89871fc3aba17b87 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784043968.145603:0:7441:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000c5d3aaaa pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:7441:1870705580840704:0@lo:101: 00000100:00100000:3.0:1784043968.145633:0:7441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784043968.145665:0:7441:0:(client.c:2702:ptlrpc_set_wait()) set 00000000f46353b0 going to sleep for 11 seconds 00000100:00100000:1.0:1784043968.145736:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580840704 00000100:00100000:1.0:1784043968.145741:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580840704 00000100:00100000:1.0:1784043968.145779:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1784043968.145785:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000008e878c2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+10:7441:x1870705580840704:12345-0@lo:101: 00010000:00010000:1.0:1784043968.145792:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784043968.145800:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000045f0f23b/0x89871fc3aba17b8e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x89871fc3aba17b87 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784043968.145814:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000045f0f23b/0x89871fc3aba17b8e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x89871fc3aba17b87 expref: 11 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784043968.145821:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000045f0f23b/0x89871fc3aba17b8e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x89871fc3aba17b87 expref: 11 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784043968.145833:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000045f0f23b, rc 0) 00000100:00100000:1.0:1784043968.145863:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000008e878c2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+11:7441:x1870705580840704:12345-0@lo:101: Request processed in 78us (229us total) trans 0 rc 0/0 00000100:00100000:1.0:1784043968.145869:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1784043968.146070:0:7441:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000c5d3aaaa pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:7441:1870705580840704:0@lo:101: 00010000:00010000:3.0:1784043968.146078:0:7441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: 00000000db0b2bd0/0x89871fc3aba17b87 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba17b8e expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043968.146084:0:7441:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: 00000000db0b2bd0/0x89871fc3aba17b87 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x89871fc3aba17b8e expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784043968.146094:0:7441:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1784043968.146162:0:7441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: 00000000db0b2bd0/0x89871fc3aba17b87 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba17b8e expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043968.146168:0:7441:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: 00000000db0b2bd0/0x89871fc3aba17b87 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba17b8e expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784043968.146198:0:7441:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:3.0:1784043968.146201:0:7441:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1784043968.146205:0:7441:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9b396f3cf800 10000000:01000000:3.0:1784043968.146213:0:7441:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1784043968.146215:0:7441:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:3.0:1784043968.146217:0:7441:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1784043968.146230:0:7441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: 00000000330181df/0x89871fc3aba17b95 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043968.146235:0:7441:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: 00000000330181df/0x89871fc3aba17b95 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043968.146241:0:7441:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: 00000000330181df/0x89871fc3aba17b95 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784043968.146250:0:7441:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000c5d3aaaa pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:7441:1870705580840832:0@lo:101: 00000100:00100000:3.0:1784043968.146271:0:7441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784043968.146411:0:7441:0:(client.c:2702:ptlrpc_set_wait()) set 00000000f46353b0 going to sleep for 11 seconds 00000100:00100000:1.0:1784043968.146502:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580840832 00000100:00100000:1.0:1784043968.146507:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580840832 00000100:00100000:1.0:1784043968.146548:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1784043968.146554:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008cd2e543 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+11:7441:x1870705580840832:12345-0@lo:101: 00010000:00010000:1.0:1784043968.146562:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784043968.146571:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000d3f761c5/0x89871fc3aba17b9c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x89871fc3aba17b95 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784043968.146586:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d3f761c5/0x89871fc3aba17b9c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x89871fc3aba17b95 expref: 12 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784043968.146593:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000d3f761c5/0x89871fc3aba17b9c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x89871fc3aba17b95 expref: 12 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784043968.146599:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000d3f761c5, rc 0) 00000100:00100000:1.0:1784043968.146626:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008cd2e543 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+12:7441:x1870705580840832:12345-0@lo:101: Request processed in 73us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1784043968.146632:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1784043968.146729:0:7441:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000c5d3aaaa pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:7441:1870705580840832:0@lo:101: 00010000:00010000:3.0:1784043968.146740:0:7441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: 00000000330181df/0x89871fc3aba17b95 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba17b9c expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043968.146746:0:7441:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: 00000000330181df/0x89871fc3aba17b95 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x89871fc3aba17b9c expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784043968.146833:0:7441:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000c5d3aaaa pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:7441:1870705580840960:0@lo:501: 00000100:00100000:3.0:1784043968.146858:0:7441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784043968.146879:0:7441:0:(client.c:2702:ptlrpc_set_wait()) set 00000000f46353b0 going to sleep for 11 seconds 00000100:00100000:2.0:1784043968.146991:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580840960 00000100:00100000:2.0:1784043968.147006:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580840960 00000100:00100000:2.0:1784043968.147041:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1784043968.147048:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b7bd3c33 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+12:7441:x1870705580840960:12345-0@lo:501: 00000100:00100000:2.0:1784043968.147437:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b7bd3c33 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+12:7441:x1870705580840960:12345-0@lo:501: Request processed in 390us (578us total) trans 0 rc 0/0 00000100:00100000:2.0:1784043968.147445:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1784043968.147508:0:7441:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000c5d3aaaa pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:7441:1870705580840960:0@lo:501: 00000100:00100000:3.0:1784043968.147546:0:7441:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000c5d3aaaa pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:7441:1870705580841088:0@lo:503: 00000100:00100000:3.0:1784043968.147585:0:7441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784043968.147614:0:7441:0:(client.c:2702:ptlrpc_set_wait()) set 00000000f46353b0 going to sleep for 11 seconds 00000100:00100000:2.0:1784043968.147654:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580841088 00000100:00100000:2.0:1784043968.147658:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580841088 00000100:00100000:2.0:1784043968.147683:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1784043968.147688:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006457aba1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+12:7441:x1870705580841088:12345-0@lo:503: 00000100:00100000:2.0:1784043968.147758:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006457aba1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+12:7441:x1870705580841088:12345-0@lo:503: Request processed in 69us (172us total) trans 0 rc 0/0 00000100:00100000:2.0:1784043968.147763:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1784043968.147831:0:7441:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000c5d3aaaa pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:7441:1870705580841088:0@lo:503: 00000040:00080000:3.0:1784043968.148239:0:7441:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1784043968.148320:0:7441:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000c5d3aaaa pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:7441:1870705580841216:0@lo:502: 00000100:00100000:3.0:1784043968.148354:0:7441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784043968.148371:0:7441:0:(client.c:2702:ptlrpc_set_wait()) set 00000000f46353b0 going to sleep for 11 seconds 00000100:00100000:2.0:1784043968.148487:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580841216 00000100:00100000:2.0:1784043968.148492:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580841216 00000100:00100000:2.0:1784043968.148546:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1784043968.148552:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000006e308e7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+12:7441:x1870705580841216:12345-0@lo:502: 00000100:00100000:2.0:1784043968.148629:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000006e308e7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+12:7441:x1870705580841216:12345-0@lo:502: Request processed in 77us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1784043968.148636:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1784043968.148817:0:7441:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000c5d3aaaa pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:7441:1870705580841216:0@lo:502: 00000040:00080000:3.0:1784043968.149131:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1784043968.149154:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 136 off8552 00000040:00080000:3.0:1784043968.149164:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 176 off8728 00000040:00080000:3.0:1784043968.149239:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8952 00000040:00080000:3.0:1784043968.149256:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9176 00000040:00080000:3.0:1784043968.149266:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 120 off9296 00000040:00080000:3.0:1784043968.149347:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 112 off9408 00000040:00080000:3.0:1784043968.149364:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 160 off9568 00000040:00080000:3.0:1784043968.149376:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9792 00000040:00080000:3.0:1784043968.149390:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10016 00000040:00080000:3.0:1784043968.149402:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 88 off10104 00000040:00080000:3.0:1784043968.149413:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 144 off10248 00000040:00080000:3.0:1784043968.149425:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].13, 152 off10400 00000040:00080000:3.0:1784043968.149438:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].14, 168 off10568 00000040:00080000:3.0:1784043968.149451:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].15, 224 off10792 00000040:00080000:3.0:1784043968.149466:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].16, 224 off11016 00000040:00080000:3.0:1784043968.149493:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].17, 80 off11096 00000040:00080000:3.0:1784043968.149506:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].18, 224 off11320 00000040:00080000:3.0:1784043968.149517:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].19, 224 off11544 00000040:00080000:3.0:1784043968.149528:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].20, 160 off11704 00000040:00080000:3.0:1784043968.149634:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].21, 224 off11928 00000040:00080000:3.0:1784043968.149650:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].22, 224 off12152 00000040:00080000:3.0:1784043968.149662:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].23, 80 off12232 00000100:00100000:3.0:1784043968.149690:0:7441:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000c5d3aaaa pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:7441:1870705580841344:0@lo:502: 00000100:00100000:3.0:1784043968.149739:0:7441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784043968.149810:0:7441:0:(client.c:2702:ptlrpc_set_wait()) set 00000000f46353b0 going to sleep for 11 seconds 00000100:00100000:2.0:1784043968.150103:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580841344 00000100:00100000:2.0:1784043968.150109:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580841344 00000100:00100000:2.0:1784043968.150215:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1784043968.150224:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a146445f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+12:7441:x1870705580841344:12345-0@lo:502: 00000100:00100000:2.0:1784043968.150345:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a146445f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+12:7441:x1870705580841344:12345-0@lo:502: Request processed in 123us (605us total) trans 0 rc 0/0 00000100:00100000:2.0:1784043968.150353:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1784043968.150439:0:7441:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000c5d3aaaa pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:7441:1870705580841344:0@lo:502: 00000040:00080000:3.0:1784043968.150489:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].24, 224 off12456 00000040:00080000:3.0:1784043968.150498:0:7441:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 24 count 25 00000020:01000000:0.0:1784043968.151055:0:7453:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784043968.151065:0:7453:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784043968.151068:0:7453:0:(obd_config.c:1561:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:0.0:1784043968.151072:0:7453:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:0.0:1784043968.151075:0:7453:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1784043968.151096:0:7453:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (00000000c7b19f5c) 00000020:00000080:0.0:1784043968.151121:0:7453:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lod with refcount 2 00000020:00000080:0.0:1784043968.151126:0:7453:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1784043968.151227:0:7453:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:0.0:1784043968.151233:0:7453:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x89871fc3aba17baa 00000020:00000080:0.0:1784043968.151465:0:7453:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:0.0:1784043968.151470:0:7453:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784043968.151474:0:7453:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784043968.151475:0:7453:0:(obd_config.c:1561:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:0.0:1784043968.151478:0:7453:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784043968.151481:0:7453:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784043968.151483:0:7453:0:(obd_config.c:1561:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:0.0:1784043968.151492:0:7453:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1784043968.151499:0:7453:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (000000006efbb302) 00000020:00000080:0.0:1784043968.151510:0:7453:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type mdt with refcount 2 00000020:00000080:0.0:1784043968.151515:0:7453:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1784043968.151516:0:7453:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:0.0:1784043968.151519:0:7453:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:0.0:1784043968.151526:0:7453:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1784043968.151596:0:7453:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000d57c954a from lustre-MDT0001, refs=2 00000020:00000080:0.0:1784043968.151609:0:7453:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (0000000069ffb01a) 00000020:00000080:0.0:1784043968.151619:0:7453:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type mdd with refcount 2 00000004:01000000:0.0:1784043968.151676:0:7453:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1784043968.151682:0:7453:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x89871fc3aba17bbf 00000020:00000080:0.0:1784043968.151769:0:7453:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:0.0:1784043968.151775:0:7453:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1784043968.151779:0:7453:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0x89871fc3aba17bc6 00080000:01000000:0.0:1784043968.151784:0:7453:0:(osd_handler.c:8929:osd_obd_connect()) connect #2 00000020:00000080:0.0:1784043968.151787:0:7453:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x89871fc3aba17bcd 00080000:10000000:0.0:1784043968.152207:0:7453:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:0.0:1784043968.152338:0:7453:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0001: No data found on store. Initialize space. 00010000:00010000:1.0:1784043968.268838:0:7453:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:02000400:1.0:1784043968.269722:0:7453:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0001: new disk, initializing 00000001:00000004:1.0:1784043968.272239:0:7453:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 0 00000001:00080000:1.0:1784043968.272936:0:7453:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0001: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1784043968.290609:0:7453:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:1.0:1784043968.290633:0:7453:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784043968.290639:0:7453:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784043968.290641:0:7453:0:(obd_config.c:1561:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:1.0:1784043968.290644:0:7453:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1784043968.290650:0:7453:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784043968.290651:0:7453:0:(obd_config.c:1561:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:1.0:1784043968.290654:0:7453:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1784043968.290659:0:7453:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.202.140@tcp to nid 0x20000c0a8ca8c (192.168.202.140@tcp) 00000020:00000080:1.0:1784043968.290690:0:7453:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1784043968.290705:0:7453:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (0000000035aa5abe) 00000020:00000080:1.0:1784043968.290729:0:7453:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:1.0:1784043968.290735:0:7453:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1784043968.290837:0:7453:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:1.0:1784043968.290844:0:7453:0:(osd_handler.c:8929:osd_obd_connect()) connect #3 00000020:00000080:1.0:1784043968.290850:0:7453:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x89871fc3aba17bdb 00010000:00080000:1.0:1784043968.290882:0:7453:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000fc06bd45@lustre-MDT0000-osp-MDT0001: add connection 192.168.202.140@tcp at head 00010000:00010000:1.0:1784043968.293749:0:7453:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-2 is initialized 00000020:00000080:3.0:1784043968.295894:0:7453:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1784043968.295910:0:7453:0:(obd_config.c:1470:class_process_config()) processing cmd: cf014 00000004:01000000:3.0:1784043968.295964:0:7453:0:(lod_lov.c:129:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:3.0:1784043968.295986:0:7453:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x89871fc3aba17be2 00000100:00080000:3.0:1784043968.296076:0:7453:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1784043968.296082:0:7453:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import 00000000fc06bd45 using connection 192.168.202.140@tcp/0@lo 00000100:00100000:3.0:1784043968.296118:0:7453:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000c5d3aaaa x1870705580841472/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1784043968.296169:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000c5d3aaaa pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1870705580841472:0@lo:38: 00000100:00100000:2.0:1784043968.296254:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1784043968.296557:0:7453:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000020:01000000:3.0:1784043968.296626:0:7453:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784043968.296631:0:7453:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784043968.296633:0:7453:0:(obd_config.c:1561:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:3.0:1784043968.296635:0:7453:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1784043968.296638:0:7453:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #14 00000020:01000000:3.0:1784043968.296640:0:7453:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1784043968.296641:0:7453:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1784043968.296642:0:7453:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1784043968.296645:0:7453:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784043968.296646:0:7453:0:(obd_config.c:1561:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:3.0:1784043968.296648:0:7453:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784043968.296652:0:7453:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784043968.296653:0:7453:0:(obd_config.c:1561:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:3.0:1784043968.296656:0:7453:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1784043968.296684:0:7453:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1784043968.296696:0:7453:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784043968.296708:0:7453:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784043968.296709:0:7453:0:(obd_config.c:1561:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:3.0:1784043968.296712:0:7453:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784043968.296714:0:7453:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784043968.296715:0:7453:0:(obd_config.c:1561:class_process_config()) marker 19 (0x1) lustre sys.timeout 00000020:00000080:3.0:1784043968.296718:0:7453:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1784043968.296720:0:7453:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1784043968.296742:0:7453:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784043968.296746:0:7453:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784043968.296747:0:7453:0:(obd_config.c:1561:class_process_config()) marker 19 (0x2) lustre sys.timeout 00000040:00080000:3.0:1784043968.296750:0:7453:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000020:01000000:3.0:1784043968.296816:0:7441:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-24 (rc=0) 10000000:01000000:3.0:1784043968.296852:0:7441:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:3.0:1784043968.296866:0:7441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: 00000000330181df/0x89871fc3aba17b95 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba17b9c expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043968.296877:0:7441:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: 00000000330181df/0x89871fc3aba17b95 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba17b9c expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784043968.296884:0:7441:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9b396f3cf800 from 1 10000000:01000000:3.0:1784043968.296887:0:7441:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1784043968.296911:0:7441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: 000000003673cdfe/0x89871fc3aba17be9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043968.296918:0:7441:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: 000000003673cdfe/0x89871fc3aba17be9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043968.296928:0:7441:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: 000000003673cdfe/0x89871fc3aba17be9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784043968.296942:0:7441:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000001abdd810 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:7441:1870705580841600:0@lo:101: 00000100:00100000:3.0:1784043968.296976:0:7441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784043968.297015:0:7441:0:(client.c:2702:ptlrpc_set_wait()) set 0000000007f33124 going to sleep for 11 seconds 00000100:00100000:3.0:1784043968.297039:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580841600 00000100:00100000:3.0:1784043968.297045:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580841600 00000100:00100000:3.0:1784043968.297084:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1784043968.297092:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000eea7f3c7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+12:7441:x1870705580841600:12345-0@lo:101: 00010000:00010000:3.0:1784043968.297105:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784043968.297116:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000934b724a/0x89871fc3aba17bf0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x89871fc3aba17be9 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043968.297138:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000934b724a/0x89871fc3aba17bf0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x89871fc3aba17be9 expref: 13 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043968.297148:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000934b724a/0x89871fc3aba17bf0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x89871fc3aba17be9 expref: 13 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043968.297155:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000934b724a, rc 0) 00000100:00100000:3.0:1784043968.297214:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000eea7f3c7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+13:7441:x1870705580841600:12345-0@lo:101: Request processed in 122us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1784043968.297220:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1784043968.297270:0:7441:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000001abdd810 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:7441:1870705580841600:0@lo:101: 00010000:00010000:3.0:1784043968.297640:0:7441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: 000000003673cdfe/0x89871fc3aba17be9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba17bf0 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043968.297648:0:7441:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: 000000003673cdfe/0x89871fc3aba17be9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x89871fc3aba17bf0 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784043968.298082:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580841472 00000100:00100000:0.0:1784043968.298087:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580841472 00000100:00100000:0.0:1784043968.298119:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1784043968.298123:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004665bde6 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3637:x1870705580841472:12345-0@lo:38: 00010000:00080000:0.0:1784043968.298141:0:6516:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 161 last 0 00000100:00100000:3.0:1784043968.298967:0:7441:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000001abdd810 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:7441:1870705580841856:0@lo:256: 00000100:00100000:3.0:1784043968.299567:0:7441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784043968.299701:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000ee4d10d6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3639:1870705580841728:0@lo:400: 00000100:00100000:2.0:1784043968.299734:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784043968.299831:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580841856 00000100:00100000:2.0:1784043968.299837:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580841856 00000100:00100000:2.0:1784043968.299879:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1784043968.299886:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007d035abf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+13:7441:x1870705580841856:12345-0@lo:256: 20000000:01000000:2.0:1784043968.299904:0:6504:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1784043968.299925:0:6504:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1784043968.299929:0:6504:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:2.0:1784043968.300019:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007d035abf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+13:7441:x1870705580841856:12345-0@lo:256: Request processed in 133us (453us total) trans 0 rc 0/0 00000100:00100000:2.0:1784043968.300027:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1784043968.300086:0:7441:0:(client.c:2702:ptlrpc_set_wait()) set 0000000007f33124 going to sleep for 11 seconds 00000100:00100000:3.0:1784043968.300112:0:7441:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000001abdd810 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:7441:1870705580841856:0@lo:256: 00000020:00000080:0.0:1784043968.300691:0:6516:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x89871fc3aba17bf7 00000004:00100000:0.0:1784043968.300705:0:6516:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:0.0:1784043968.300711:0:6516:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 10000000:01000000:3.0:1784043968.301039:0:7441:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1784043968.301060:0:7441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: 000000003673cdfe/0x89871fc3aba17be9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba17bf0 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043968.301071:0:7441:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: 000000003673cdfe/0x89871fc3aba17be9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba17bf0 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784043968.301078:0:7441:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9b396f3cf800 from 1 10000000:01000000:3.0:1784043968.301081:0:7441:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1784043968.301105:0:7441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: 00000000f89289b8/0x89871fc3aba17bfe lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043968.301112:0:7441:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: 00000000f89289b8/0x89871fc3aba17bfe lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043968.301121:0:7441:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: 00000000f89289b8/0x89871fc3aba17bfe lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784043968.301135:0:7441:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000001abdd810 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:7441:1870705580841984:0@lo:101: 00000100:00100000:3.0:1784043968.301168:0:7441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784043968.301207:0:7441:0:(client.c:2702:ptlrpc_set_wait()) set 0000000007f33124 going to sleep for 11 seconds 00000100:00100000:3.0:1784043968.301225:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580841984 00000100:00100000:3.0:1784043968.301229:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580841984 00000100:00100000:3.0:1784043968.301252:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1784043968.301256:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000004161762 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+13:7441:x1870705580841984:12345-0@lo:101: 00010000:00010000:3.0:1784043968.301265:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784043968.301285:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000050e869a7/0x89871fc3aba17c05 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x89871fc3aba17bfe expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043968.301317:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000050e869a7/0x89871fc3aba17c05 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x89871fc3aba17bfe expref: 14 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043968.301327:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000050e869a7/0x89871fc3aba17c05 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x89871fc3aba17bfe expref: 14 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043968.301335:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000050e869a7, rc 0) 00000100:00100000:3.0:1784043968.301362:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000004161762 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+14:7441:x1870705580841984:12345-0@lo:101: Request processed in 105us (194us total) trans 0 rc 0/0 00000100:00100000:3.0:1784043968.301367:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1784043968.301733:0:7441:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000001abdd810 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:7441:1870705580841984:0@lo:101: 00010000:00010000:3.0:1784043968.301746:0:7441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: 00000000f89289b8/0x89871fc3aba17bfe lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba17c05 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043968.301754:0:7441:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: 00000000f89289b8/0x89871fc3aba17bfe lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x89871fc3aba17c05 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784043968.301831:0:7441:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000001abdd810 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:7441:1870705580842112:0@lo:501: 00000100:00100000:3.0:1784043968.301857:0:7441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784043968.301877:0:7441:0:(client.c:2702:ptlrpc_set_wait()) set 000000001f689f2a going to sleep for 11 seconds 00000100:00100000:2.0:1784043968.301982:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580842112 00000100:00100000:2.0:1784043968.301987:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580842112 00000100:00100000:2.0:1784043968.302087:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1784043968.302093:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003fc41cbd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+14:7441:x1870705580842112:12345-0@lo:501: 00000100:00100000:2.0:1784043968.302264:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003fc41cbd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+14:7441:x1870705580842112:12345-0@lo:501: Request processed in 171us (406us total) trans 0 rc 0/0 00000100:00100000:2.0:1784043968.302280:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1784043968.302509:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580841728 00000100:00100000:1.0:1784043968.302514:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580841728 00000100:00100000:1.0:1784043968.302558:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1784043968.302564:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000085137f2d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1870705580841728:12345-0@lo:400: 00000100:00100000:1.0:1784043968.302613:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000085137f2d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1870705580841728:12345-0@lo:400: Request processed in 50us (2879us total) trans 0 rc 0/0 00000100:00100000:1.0:1784043968.302619:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1784043968.302777:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000ee4d10d6 x1870705580841728/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784043984 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784043968.302791:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000ee4d10d6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3639:1870705580841728:0@lo:400: 00000100:00100000:0.0:1784043968.302858:0:7441:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000001abdd810 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:7441:1870705580842112:0@lo:501: 00000100:00100000:0.0:1784043968.302889:0:7441:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000077f84d32 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:7441:1870705580842240:0@lo:503: 00000100:00100000:0.0:1784043968.302930:0:7441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784043968.303007:0:7441:0:(client.c:2702:ptlrpc_set_wait()) set 000000002f0f56a9 going to sleep for 11 seconds 00000100:00100000:3.0:1784043968.303105:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580842240 00000100:00100000:3.0:1784043968.303110:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580842240 00000100:00100000:3.0:1784043968.303242:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1784043968.303250:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e0aaf518 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+14:7441:x1870705580842240:12345-0@lo:503: 00000040:00080000:3.0:1784043968.303293:0:6506:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1784043968.303329:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e0aaf518 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+14:7441:x1870705580842240:12345-0@lo:503: Request processed in 81us (399us total) trans 0 rc 0/0 00000100:00100000:3.0:1784043968.303344:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1784043968.303545:0:7441:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000077f84d32 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:7441:1870705580842240:0@lo:503: 00000040:00080000:0.0:1784043968.303809:0:7441:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1784043968.303854:0:7441:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 1 count 1 00000040:00080000:0.0:1784043968.303927:0:7441:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1784043968.305196:0:7458:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 00000020:01000000:1.0:1784043968.305474:0:7441:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:1.0:1784043968.305502:0:7441:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1784043968.305519:0:7441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: 00000000f89289b8/0x89871fc3aba17bfe lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba17c05 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784043968.305530:0:7441:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: 00000000f89289b8/0x89871fc3aba17bfe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba17c05 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784043968.305719:0:7441:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1784043968.305722:0:7441:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9b396f3cf800 10000000:01000000:1.0:1784043968.305725:0:7441:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9b396f3cf800 10000000:01000000:1.0:1784043968.305729:0:7441:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1784043968.305736:0:7441:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9b396f3cf800 from 1 10000000:01000000:1.0:1784043968.305739:0:7441:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1784043968.305771:0:7441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: 000000008c8b1a27/0x89871fc3aba17c0c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784043968.305779:0:7441:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: 000000008c8b1a27/0x89871fc3aba17c0c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784043968.305788:0:7441:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: 000000008c8b1a27/0x89871fc3aba17c0c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784043968.305817:0:7441:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000022d424d4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:7441:1870705580842368:0@lo:101: 00000100:00100000:1.0:1784043968.305874:0:7441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784043968.305963:0:7441:0:(client.c:2702:ptlrpc_set_wait()) set 00000000d8860e08 going to sleep for 11 seconds 00000100:00100000:3.0:1784043968.306102:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580842368 00000100:00100000:3.0:1784043968.306109:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580842368 00000100:00100000:3.0:1784043968.306156:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1784043968.306163:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c5d086d0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+14:7441:x1870705580842368:12345-0@lo:101: 00010000:00010000:3.0:1784043968.306194:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784043968.306207:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000007abbfdbf/0x89871fc3aba17c13 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x89871fc3aba17c0c expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043968.306227:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000007abbfdbf/0x89871fc3aba17c13 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x89871fc3aba17c0c expref: 15 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043968.306236:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000007abbfdbf/0x89871fc3aba17c13 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x89871fc3aba17c0c expref: 15 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043968.306243:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000007abbfdbf, rc 0) 00000100:00100000:3.0:1784043968.306286:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c5d086d0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+15:7441:x1870705580842368:12345-0@lo:101: Request processed in 123us (411us total) trans 0 rc 0/0 00000100:00100000:3.0:1784043968.306292:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1784043968.306478:0:7441:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000022d424d4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:7441:1870705580842368:0@lo:101: 00010000:00010000:1.0:1784043968.306492:0:7441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: 000000008c8b1a27/0x89871fc3aba17c0c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba17c13 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784043968.306500:0:7441:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: 000000008c8b1a27/0x89871fc3aba17c0c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x89871fc3aba17c13 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784043968.306606:0:7441:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000022d424d4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:7441:1870705580842496:0@lo:501: 00000100:00100000:1.0:1784043968.306631:0:7441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784043968.306666:0:7441:0:(client.c:2702:ptlrpc_set_wait()) set 00000000d8860e08 going to sleep for 11 seconds 00000100:00100000:3.0:1784043968.306774:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580842496 00000100:00100000:3.0:1784043968.306779:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580842496 00000100:00100000:3.0:1784043968.306798:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1784043968.306802:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000089f23bec pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+15:7441:x1870705580842496:12345-0@lo:501: 00000100:00100000:3.0:1784043968.306900:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000089f23bec pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+15:7441:x1870705580842496:12345-0@lo:501: Request processed in 98us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1784043968.306907:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1784043968.307091:0:7441:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000022d424d4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:7441:1870705580842496:0@lo:501: 00000100:00100000:1.0:1784043968.307129:0:7441:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000022d424d4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:7441:1870705580842624:0@lo:503: 00000100:00100000:1.0:1784043968.307165:0:7441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784043968.307212:0:7441:0:(client.c:2702:ptlrpc_set_wait()) set 00000000d8860e08 going to sleep for 11 seconds 00000100:00100000:3.0:1784043968.307318:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580842624 00000100:00100000:3.0:1784043968.307323:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580842624 00000100:00100000:3.0:1784043968.307352:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1784043968.307358:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000042df54f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+15:7441:x1870705580842624:12345-0@lo:503: 00000100:00100000:3.0:1784043968.307581:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000042df54f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+15:7441:x1870705580842624:12345-0@lo:503: Request processed in 223us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1784043968.307588:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1784043968.307641:0:7441:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000022d424d4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:7441:1870705580842624:0@lo:503: 00000040:00080000:3.0:1784043968.307913:0:7441:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1784043968.307975:0:7441:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000e8cfe501 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:7441:1870705580842752:0@lo:502: 00000100:00100000:3.0:1784043968.308153:0:7441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784043968.308199:0:7441:0:(client.c:2702:ptlrpc_set_wait()) set 00000000da9d931a going to sleep for 11 seconds 00000100:00100000:3.0:1784043968.308214:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580842752 00000100:00100000:3.0:1784043968.308218:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580842752 00000100:00100000:3.0:1784043968.308238:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1784043968.308243:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006d29b4aa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+15:7441:x1870705580842752:12345-0@lo:502: 00000100:00100000:3.0:1784043968.308562:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006d29b4aa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+15:7441:x1870705580842752:12345-0@lo:502: Request processed in 318us (408us total) trans 0 rc 0/0 00000100:00100000:3.0:1784043968.308569:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1784043968.308751:0:7441:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000e8cfe501 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:7441:1870705580842752:0@lo:502: 00000040:00080000:0.0:1784043968.308936:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1784043968.308965:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1784043968.308979:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1784043968.309068:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1784043968.309088:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1784043968.309102:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1784043968.309115:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1784043968.309128:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1784043968.309142:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1784043968.309155:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1784043968.309166:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1784043968.309226:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1784043968.309241:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1784043968.309252:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:0.0:1784043968.309263:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:0.0:1784043968.309340:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:0.0:1784043968.309358:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:0.0:1784043968.309439:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:0.0:1784043968.309458:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:0.0:1784043968.309473:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:0.0:1784043968.309486:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1784043968.309499:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1784043968.309512:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:0.0:1784043968.309525:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:0.0:1784043968.309566:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:0.0:1784043968.309580:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:0.0:1784043968.311087:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:0.0:1784043968.311145:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000100:00100000:0.0:1784043968.311204:0:7441:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000077f84d32 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:7441:1870705580842880:0@lo:502: 00000100:00100000:0.0:1784043968.311529:0:7441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784043968.311723:0:7441:0:(client.c:2702:ptlrpc_set_wait()) set 00000000af9e2525 going to sleep for 11 seconds 00000100:00100000:2.0:1784043968.311814:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580842880 00000100:00100000:2.0:1784043968.311821:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580842880 00000100:00100000:2.0:1784043968.311904:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1784043968.311912:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005e376a72 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+15:7441:x1870705580842880:12345-0@lo:502: 00000100:00100000:2.0:1784043968.312037:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005e376a72 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+15:7441:x1870705580842880:12345-0@lo:502: Request processed in 126us (509us total) trans 0 rc 0/0 00000100:00100000:2.0:1784043968.312046:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1784043968.312126:0:7441:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000077f84d32 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:7441:1870705580842880:0@lo:502: 00000040:00080000:0.0:1784043968.312206:0:7441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:0.0:1784043968.312215:0:7441:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:0.0:1784043968.312889:0:7459:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:0.0:1784043968.312903:0:7459:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (000000009b95b374) 00000020:00000080:0.0:1784043968.312922:0:7459:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:0.0:1784043968.313112:0:7459:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000d57c954a from lustre-MDT0001, refs=3 00000020:01000004:0.0:1784043968.313117:0:7459:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000d57c954a from lustre-MDT0001, refs=3 00000020:01000004:0.0:1784043968.313119:0:7459:0:(obd_mount.c:710:lustre_put_lsi()) put 00000000d57c954a 3 00010000:00080000:0.0:1784043968.313145:0:7459:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000089622c87@lustre-MDT0000-lwp-MDT0001: add connection 192.168.202.140@tcp at head 00010000:00010000:0.0:1784043968.314807:0:7459:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-3 is initialized 00000020:00000080:0.0:1784043968.314907:0:7459:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:0.0:1784043968.314945:0:7459:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1784043968.314958:0:7459:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0x89871fc3aba17c21 00000100:00080000:0.0:1784043968.314967:0:7459:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1784043968.314972:0:7459:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import 0000000089622c87 using connection 192.168.202.140@tcp/0@lo 00000100:00100000:0.0:1784043968.315005:0:7459:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000077f84d32 x1870705580843008/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1784043968.315030:0:7459:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000040:00080000:0.0:1784043968.317989:0:7459:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 40000000:00080000:1.0:1784043968.318493:0:7460:0:(fid_handler.c:282:seq_server_check_and_alloc_super()) srv-lustre-MDT0001: Can't allocate super-sequence: rc = -115 00000020:01000000:3.0:1784043968.318793:0:7441:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:3.0:1784043968.318824:0:7441:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1784043968.318844:0:7441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: 000000008c8b1a27/0x89871fc3aba17c0c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba17c13 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043968.318857:0:7441:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: 000000008c8b1a27/0x89871fc3aba17c0c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba17c13 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1784043968.318906:0:7441:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1784043968.318908:0:7441:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1784043968.318910:0:7441:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1784043968.318915:0:7441:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1784043968.318916:0:7441:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1784043968.318917:0:7441:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1784043968.318918:0:7441:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1784043968.318919:0:7441:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1784043968.318920:0:7441:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1784043968.318921:0:7441:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1784043968.318922:0:7441:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1784043968.318925:0:7441:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020061 00000020:01000004:3.0:1784043968.318927:0:7441:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1784043968.318928:0:7441:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1784043968.318929:0:7441:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1784043968.318930:0:7441:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1784043968.318931:0:7441:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1784043968.318932:0:7441:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1784043968.318933:0:7441:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1784043968.318933:0:7441:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1784043968.318934:0:7441:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1784043968.318935:0:7441:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1784043968.318936:0:7441:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1784043968.318959:0:7441:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:3.0:1784043968.318976:0:7441:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000009aad85ce pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:7441:1870705580843136:0@lo:253: 00000100:00100000:0.0:1784043968.319658:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000077f84d32 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3637:1870705580843008:0@lo:38: 00000100:00100000:0.0:1784043968.319731:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784043968.320150:0:7441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784043968.320187:0:7441:0:(client.c:2702:ptlrpc_set_wait()) set 0000000030df05be going to sleep for 11 seconds 00000100:00100000:1.0:1784043968.320655:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580843008 00000100:00100000:1.0:1784043968.320664:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580843008 00000100:00100000:1.0:1784043968.320706:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1784043968.320712:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000096f536b0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3637:x1870705580843008:12345-0@lo:38: 00010000:00080000:1.0:1784043968.320737:0:6511:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 161 last 0 00000020:00000080:1.0:1784043968.320769:0:6511:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x89871fc3aba17c28 00000004:00100000:1.0:1784043968.320781:0:6511:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1784043968.320809:0:6511:0:(import.c:65:import_set_state_nolock()) 000000009f831f9d : changing import state from RECOVER to FULL 00000100:00100000:1.0:1784043968.320862:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000096f536b0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1870705580843008:12345-0@lo:38: Request processed in 148us (1131us total) trans 0 rc 0/0 00000100:00100000:1.0:1784043968.320868:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1784043968.321558:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580843136 00000100:00100000:3.0:1784043968.321566:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580843136 00000100:00100000:3.0:1784043968.322706:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1784043968.322718:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000085939b9b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+15:7441:x1870705580843136:12345-0@lo:253: 20000000:01000000:3.0:1784043968.322749:0:6505:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1784043968.322764:0:6505:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00010000:00080000:0.0:1784043968.322897:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000077f84d32 x1870705580843008/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784043978 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784043968.322911:0:3637:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1784043968.322921:0:3637:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 1 00000100:00080000:0.0:1784043968.322932:0:3637:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1784043968.322937:0:3637:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1784043968.322940:0:3637:0:(import.c:65:import_set_state_nolock()) 0000000089622c87 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1784043968.322947:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000077f84d32 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3637:1870705580843008:0@lo:38: 00000100:00080000:1.0:1784043968.323324:0:6516:0:(import.c:65:import_set_state_nolock()) 00000000f187c530 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1784043968.323764:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004665bde6 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3637:x1870705580841472:12345-0@lo:38: Request processed in 25637us (27508us total) trans 0 rc 0/0 00000100:00100000:1.0:1784043968.323778:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1784043968.324109:0:3637:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1784043968.324118:0:3637:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 1 00000100:00080000:2.0:1784043968.324126:0:3637:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:2.0:1784043968.324131:0:3637:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1784043968.324133:0:3637:0:(import.c:65:import_set_state_nolock()) 00000000fc06bd45 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1784043968.324153:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000c5d3aaaa pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1870705580841472:0@lo:38: 00000100:00100000:3.0:1784043968.324481:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1784043968.324494:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000052695aa2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1870705580843264:0@lo:41: 00000100:00100000:3.0:1784043968.324550:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784043968.325118:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580843264 00000100:00100000:1.0:1784043968.325126:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580843264 00000100:00100000:1.0:1784043968.325162:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1784043968.325168:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000197e9077 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3641:x1870705580843264:12345-0@lo:41: 00000004:00000024:1.0:1784043968.325216:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:1.0:1784043968.325255:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000197e9077 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3641:x1870705580843264:12345-0@lo:41: Request processed in 87us (705us total) trans 0 rc 0/0 00000100:00100000:1.0:1784043968.325268:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1784043968.325498:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000052695aa2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1870705580843264:0@lo:41: 00000001:00100000:2.0:1784043968.334857:0:6490:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:1.0:1784043968.335112:0:6505:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1784043968.335166:0:6505:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:0.0:1784043968.335726:0:6527:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1784043968.335733:0:6527:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1784043968.335755:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000003791ae2a/0x89871fc3aba17c2f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784043968.335773:0:6527:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000585760e8/0x89871fc3aba17b4f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x89871fc3aba17b48 expref: 15 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784043968.335780:0:6527:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000934b724a/0x89871fc3aba17bf0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x89871fc3aba17be9 expref: 15 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784043968.335787:0:6527:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000003791ae2a/0x89871fc3aba17c2f lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784043968.335825:0:6527:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000934b724a/0x89871fc3aba17bf0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x89871fc3aba17be9 expref: 15 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784043968.335837:0:6527:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000934b724a/0x89871fc3aba17bf0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x89871fc3aba17be9 expref: 15 pid: 6505 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784043968.335869:0:6527:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000077f84d32 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6527:1870705580843392:0@lo:104: 00000100:00100000:0.0:1784043968.335930:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784043968.336140:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000085939b9b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+15:7441:x1870705580843136:12345-0@lo:253: Request processed in 13425us (15989us total) trans 0 rc 0/0 00000100:00100000:1.0:1784043968.336150:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1784043968.336300:0:7441:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000009aad85ce pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:7441:1870705580843136:0@lo:253: 10000000:01000000:2.0:1784043968.336314:0:7441:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:2.0:1784043968.336318:0:7441:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1784043968.336320:0:7441:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1784043968.336321:0:7441:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784043968.336323:0:7441:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784043968.336324:0:7441:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784043968.336325:0:7441:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784043968.336326:0:7441:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1784043968.336328:0:7441:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1784043968.336329:0:7441:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1784043968.336330:0:7441:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784043968.336331:0:7441:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1784043968.336347:0:7441:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:0.0:1784043968.337525:0:6527:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000585760e8/0x89871fc3aba17b4f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x89871fc3aba17b48 expref: 14 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784043968.337549:0:6527:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000585760e8/0x89871fc3aba17b4f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x89871fc3aba17b48 expref: 14 pid: 6505 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784043968.337560:0:6527:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000002b4e090e pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6527:1870705580843520:0@lo:104: 00000100:00100000:0.0:1784043968.338493:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784043968.343149:0:6527:0:(client.c:2702:ptlrpc_set_wait()) set 00000000e47c4b4f going to sleep for 11 seconds 00080000:10000000:2.0:1784043968.343728:0:7441:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00080000:10000000:2.0:1784043968.343906:0:7441:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:2.0:1784043968.344213:0:7441:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:2.0:1784043968.344430:0:7441:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:2.0:1784043968.344703:0:7441:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:2.0:1784043968.344871:0:7441:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00000100:00100000:3.0:1784043968.345317:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580843392 00000100:00100000:3.0:1784043968.345335:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580843392 00000100:00100000:1.0:1784043968.345751:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580843520 00000100:00100000:1.0:1784043968.345757:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580843520 00000100:00100000:1.0:1784043968.345784:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1784043968.345792:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001ff4add4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+4:6527:x1870705580843392:12345-0@lo:104: 00010000:00010000:1.0:1784043968.345808:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.140@tcp lock: 000000003673cdfe/0x89871fc3aba17be9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x89871fc3aba17bf0 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784043968.345907:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1784043968.345912:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001ff4add4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+4:6527:x1870705580843392:12345-0@lo:104: Request processed in 121us (9983us total) trans 0 rc 0/0 00000100:00100000:1.0:1784043968.345918:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1784043968.345936:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1784043968.345941:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000034288381 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+3:6527:x1870705580843520:12345-0@lo:104: 00010000:00010000:1.0:1784043968.345948:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.140@tcp lock: 00000000223ad1ac/0x89871fc3aba17b48 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x89871fc3aba17b4f expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784043968.345985:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1784043968.346004:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000034288381 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+3:6527:x1870705580843520:12345-0@lo:104: Request processed in 49us (7502us total) trans 0 rc 0/0 00000100:00100000:1.0:1784043968.346012:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:2.0:1784043968.346201:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1784043968.346206:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: 000000003673cdfe/0x89871fc3aba17be9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x89871fc3aba17bf0 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784043968.346214:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000003673cdfe already unused, calling callback (00000000c6a82693) 10000000:00010000:2.0:1784043968.346217:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: 000000003673cdfe/0x89871fc3aba17be9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x89871fc3aba17bf0 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784043968.346224:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: 000000003673cdfe/0x89871fc3aba17be9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x89871fc3aba17bf0 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784043968.346231:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: 000000003673cdfe/0x89871fc3aba17be9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x89871fc3aba17bf0 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784043968.346236:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1784043968.346283:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.140@tcp lock: 000000003673cdfe/0x89871fc3aba17be9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x89871fc3aba17bf0 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784043968.346289:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784043968.346319:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: 000000003673cdfe/0x89871fc3aba17be9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x89871fc3aba17bf0 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784043968.346326:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: 000000003673cdfe/0x89871fc3aba17be9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x89871fc3aba17bf0 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784043968.346340:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784043968.346342:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: 00000000223ad1ac/0x89871fc3aba17b48 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x89871fc3aba17b4f expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784043968.346355:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000223ad1ac already unused, calling callback (00000000c6a82693) 10000000:00010000:2.0:1784043968.346357:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: 00000000223ad1ac/0x89871fc3aba17b48 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x89871fc3aba17b4f expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784043968.346363:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: 00000000223ad1ac/0x89871fc3aba17b48 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x89871fc3aba17b4f expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784043968.346369:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: 00000000223ad1ac/0x89871fc3aba17b48 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x89871fc3aba17b4f expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784043968.346374:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1784043968.346388:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.140@tcp lock: 00000000223ad1ac/0x89871fc3aba17b48 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x89871fc3aba17b4f expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784043968.346393:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784043968.346406:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: 00000000223ad1ac/0x89871fc3aba17b48 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x89871fc3aba17b4f expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784043968.346411:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: 00000000223ad1ac/0x89871fc3aba17b48 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x89871fc3aba17b4f expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784043968.346425:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784043968.346426:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784043968.346428:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784043968.346434:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784043968.346441:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784043968.346455:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000050ef7cb1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:3640:1870705580843648:0@lo:103: 00000100:00100000:2.0:1784043968.346501:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784043968.346566:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000007e7d0bbd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:3638:1870705580843776:0@lo:103: 00000100:00100000:2.0:1784043968.346876:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784043968.346913:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580843648 00000100:00100000:2.0:1784043968.346918:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580843648 00010000:00010000:2.0:1784043968.346939:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000934b724a/0x89871fc3aba17bf0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x89871fc3aba17be9 expref: 15 pid: 6505 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784043968.346961:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580843776 00000100:00100000:2.0:1784043968.346964:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580843776 00010000:00010000:2.0:1784043968.346975:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000585760e8/0x89871fc3aba17b4f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x89871fc3aba17b48 expref: 16 pid: 6505 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784043968.347066:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1784043968.347075:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f6d3719e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+16:3640:x1870705580843648:12345-0@lo:103: 00010000:00010000:2.0:1784043968.347086:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784043968.347091:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000934b724a/0x89871fc3aba17bf0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x89871fc3aba17be9 expref: 16 pid: 6505 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784043968.347101:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000934b724a/0x89871fc3aba17bf0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x89871fc3aba17be9 expref: 16 pid: 6505 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784043968.347119:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784043968.347149:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f6d3719e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+16:3640:x1870705580843648:12345-0@lo:103: Request processed in 75us (648us total) trans 0 rc 0/0 00000100:00100000:2.0:1784043968.347156:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1784043968.347171:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1784043968.347200:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000005111530 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+15:3638:x1870705580843776:12345-0@lo:103: 00010000:00010000:2.0:1784043968.347207:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784043968.347211:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000585760e8/0x89871fc3aba17b4f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x89871fc3aba17b48 expref: 15 pid: 6505 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784043968.347230:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000585760e8/0x89871fc3aba17b4f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x89871fc3aba17b48 expref: 15 pid: 6505 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784043968.347242:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000003791ae2a/0x89871fc3aba17c2f lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784043968.347249:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000003791ae2a/0x89871fc3aba17c2f lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1784043968.347264:0:6497:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.011531532s 00010000:00010000:2.0:1784043968.347268:0:6497:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000003791ae2a/0x89871fc3aba17c2f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784043968.347274:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000003791ae2a/0x89871fc3aba17c2f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784043968.347280:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000003791ae2a/0x89871fc3aba17c2f lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784043968.347285:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000003791ae2a/0x89871fc3aba17c2f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784043968.347289:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000003791ae2a already unused, calling callback (00000000622db14d) 00010000:00010000:2.0:1784043968.347292:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000003791ae2a/0x89871fc3aba17c2f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784043968.347297:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000003791ae2a/0x89871fc3aba17c2f lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784043968.347305:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000003791ae2a/0x89871fc3aba17c2f lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784043968.347323:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784043968.347350:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000005111530 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+15:3638:x1870705580843776:12345-0@lo:103: Request processed in 152us (475us total) trans 0 rc 0/0 00000100:00100000:2.0:1784043968.347356:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1784043968.347417:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000007e7d0bbd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:3638:1870705580843776:0@lo:103: 00000100:00100000:2.0:1784043968.347443:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000050ef7cb1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:3640:1870705580843648:0@lo:103: 00010000:00010000:2.0:1784043968.347466:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000934b724a/0x89871fc3aba17bf0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x89871fc3aba17be9 expref: 14 pid: 6505 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784043968.347480:0:6527:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000077f84d32 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6527:1870705580843392:0@lo:104: 00010000:00010000:2.0:1784043968.347490:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000585760e8/0x89871fc3aba17b4f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x89871fc3aba17b48 expref: 13 pid: 6505 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784043968.347499:0:6527:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000002b4e090e pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6527:1870705580843520:0@lo:104: 00010000:00010000:2.0:1784043968.347515:0:6527:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000003791ae2a/0x89871fc3aba17c2f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784043968.347523:0:6527:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000003791ae2a/0x89871fc3aba17c2f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784043968.347528:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000003791ae2a/0x89871fc3aba17c2f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784043968.347546:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000003791ae2a/0x89871fc3aba17c2f lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:2.0:1784043968.348940:0:7441:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:2.0:1784043968.349345:0:7441:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:2.0:1784043968.349571:0:7441:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00080000:10000000:2.0:1784043968.349836:0:7441:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:2.0:1784043968.350091:0:7441:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00080000:10000000:2.0:1784043968.350287:0:7441:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00000040:01000000:2.0:1784043968.351788:0:7441:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000040:01000000:2.0:1784043968.352373:0:7465:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000100:00100000:2.0:1784043968.352427:0:7465:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000050ef7cb1 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7465:1870705580843904:0@lo:700: 00000100:00100000:2.0:1784043968.352500:0:7465:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784043968.352577:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580843904 00000100:00100000:2.0:1784043968.352586:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580843904 00000100:00100000:2.0:1784043968.352651:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1784043968.352659:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007e7d0bbd pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7465:x1870705580843904:12345-0@lo:700: 00000100:00100000:2.0:1784043968.352753:0:7465:0:(client.c:2702:ptlrpc_set_wait()) set 000000005b42cfe2 going to sleep for 11 seconds 00000040:01000000:3.0:1784043968.352859:0:7441:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000100:00100000:3.0:1784043968.353336:0:7466:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000077011c81 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7466:1870705580844032:0@lo:1000: 00000100:00100000:3.0:1784043968.353376:0:7466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784043968.353401:0:7466:0:(client.c:2702:ptlrpc_set_wait()) set 00000000f0445a5d going to sleep for 11 seconds 00000100:00100000:0.0:1784043968.353452:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580844032 00000100:00100000:0.0:1784043968.353457:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580844032 00000100:00100000:0.0:1784043968.353488:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1784043968.353494:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000255a1197 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7466:x1870705580844032:12345-0@lo:1000: 00000100:00100000:0.0:1784043968.353581:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000255a1197 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7466:x1870705580844032:12345-0@lo:1000: Request processed in 87us (204us total) trans 0 rc 0/0 00000100:00100000:0.0:1784043968.353597:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1784043968.353735:0:7466:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000077011c81 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7466:1870705580844032:0@lo:1000: 00000040:01000000:3.0:1784043968.353768:0:7466:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000100:00100000:3.0:1784043968.353790:0:7466:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000077011c81 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7466:1870705580844160:0@lo:700: 00000100:00100000:3.0:1784043968.353815:0:7466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784043968.353828:0:7466:0:(client.c:2702:ptlrpc_set_wait()) set 000000007b752219 going to sleep for 11 seconds 00000100:00100000:2.0:1784043968.353886:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580844160 00000100:00100000:2.0:1784043968.353891:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580844160 00000100:00100000:2.0:1784043968.353939:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1784043968.353945:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ad163b8f pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7466:x1870705580844160:12345-0@lo:700: 00000100:00100000:2.0:1784043968.354429:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ad163b8f pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7466:x1870705580844160:12345-0@lo:700: Request processed in 483us (612us total) trans 0 rc 0/0 00000100:00100000:2.0:1784043968.354437:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000040:01000000:2.0:1784043968.355863:0:7441:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:2.0:1784043968.355990:0:7441:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1784043968.356869:0:7441:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1784043968.356880:0:7441:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000020:00080000:1.0:1784043968.357112:0:7464:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:1.0:1784043968.357125:0:7464:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:00080000:2.0:1784043968.357352:0:7441:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1784043968.357750:0:7466:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000077011c81 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7466:1870705580844160:0@lo:700: 00000100:00100000:3.0:1784043968.357830:0:7466:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000077011c81 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7466:1870705580844288:0@lo:900: 00000100:00100000:3.0:1784043968.357896:0:7466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:2.0:1784043968.358912:0:7441:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000100:00100000:3.0:1784043968.359613:0:7466:0:(client.c:2702:ptlrpc_set_wait()) set 000000007b752219 going to sleep for 11 seconds 00000040:00080000:2.0:1784043968.359833:0:7441:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1784043968.359872:0:7441:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:2.0:1784043968.360501:0:7441:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 40000000:02000000:3.0:1784043968.361966:0:6518:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt 00080000:10000000:2.0:1784043968.364529:0:7441:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000003:0xa:0x0] (8/32) registered 00000100:00100000:1.0:1784043968.365346:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580844288 00000100:00100000:1.0:1784043968.365357:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580844288 00100000:10000000:2.0:1784043968.366166:0:7441:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:2.0:1784043968.366345:0:7441:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:2.0:1784043968.366482:0:7441:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:2.0:1784043968.366646:0:7441:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:2.0:1784043968.366800:0:7441:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:2.0:1784043968.366926:0:7441:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:2.0:1784043968.367142:0:7441:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:2.0:1784043968.367324:0:7441:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:2.0:1784043968.367475:0:7441:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00000100:00100000:1.0:1784043968.369870:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1784043968.369897:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000087dc51f pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7466:x1870705580844288:12345-0@lo:900: 00000100:00100000:1.0:1784043968.370065:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000087dc51f pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7466:x1870705580844288:12345-0@lo:900: Request processed in 181us (12167us total) trans 0 rc 0/0 00000100:00100000:1.0:1784043968.370078:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00100000:10000000:2.0:1784043968.370448:0:7441:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:2.0:1784043968.371581:0:7441:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00000100:00100000:3.0:1784043968.371786:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007e7d0bbd pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7465:x1870705580843904:12345-0@lo:700: Request processed in 19124us (19284us total) trans 0 rc 0/0 00000100:00100000:3.0:1784043968.371803:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1784043968.371863:0:7466:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000077011c81 x1870705580844288/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1784043984 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784043968.371881:0:7466:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000077011c81 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7466:1870705580844288:0@lo:900: 00000100:00100000:3.0:1784043968.371984:0:7466:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000077011c81 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7466:1870705580844416:0@lo:1000: 00010000:00080000:2.0:1784043968.372095:0:7465:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000050ef7cb1 x1870705580843904/t0(0) o700->lustre-MDT0000-lwp-MDT0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1784043984 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784043968.372104:0:7465:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000050ef7cb1 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7465:1870705580843904:0@lo:700: 40000000:02000000:2.0:1784043968.372111:0:7465:0:(fid_request.c:122:seq_client_rpc()) cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] 00000100:00100000:3.0:1784043968.374306:0:7466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784043968.374351:0:7466:0:(client.c:2702:ptlrpc_set_wait()) set 000000009aa81021 going to sleep for 11 seconds 00000100:00100000:1.0:1784043968.375360:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580844416 00000100:00100000:1.0:1784043968.375372:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580844416 00000100:00100000:1.0:1784043968.375437:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1784043968.375446:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009aad85ce pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7466:x1870705580844416:12345-0@lo:1000: 00000100:00100000:1.0:1784043968.375557:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009aad85ce pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7466:x1870705580844416:12345-0@lo:1000: Request processed in 112us (1257us total) trans 0 rc 0/0 00000100:00100000:1.0:1784043968.375564:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1784043968.375752:0:7466:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000077011c81 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7466:1870705580844416:0@lo:1000: 00000004:00080000:3.0:1784043968.375844:0:7466:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 000000007b752219 with version 0 00000020:00100000:3.0:1784043968.375867:0:7466:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1784043968.375873:0:7466:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@0000000077011c81 x1870705580844672/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1784043968.375893:0:7466:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000077011c81 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7466:1870705580844672:0@lo:1000: 00000100:00100000:3.0:1784043968.375925:0:7466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784043968.375960:0:7466:0:(client.c:2702:ptlrpc_set_wait()) set 0000000066a27bfc going to sleep for 11 seconds 00000100:00100000:1.0:1784043968.376518:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580844672 00000100:00100000:1.0:1784043968.376524:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580844672 00000100:00100000:1.0:1784043968.376576:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1784043968.376583:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c5d3aaaa pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7466:x1870705580844672:12345-0@lo:1000: 00100000:10000000:0.0:1784043968.379768:0:7441:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:0.0:1784043968.379960:0:7441:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:0.0:1784043968.380472:0:7441:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:0.0:1784043968.381117:0:7441:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:0.0:1784043968.381408:0:7441:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:0.0:1784043968.384875:0:7441:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:0.0:1784043968.385257:0:7441:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:0.0:1784043968.385418:0:7441:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:0.0:1784043968.386475:0:7441:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:0.0:1784043968.386715:0:7441:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:0.0:1784043968.386859:0:7441:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:0.0:1784043968.388788:0:7441:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00000001:00080000:2.0:1784043968.389171:0:6490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967297 is committed 00100000:10000000:0.0:1784043968.389490:0:7441:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:0.0:1784043968.389649:0:7441:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:0.0:1784043968.389777:0:7441:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:0.0:1784043968.389913:0:7441:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00000100:00100000:1.0:1784043968.390136:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c5d3aaaa pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7466:x1870705580844672:12345-0@lo:1000: Request processed in 13549us (14206us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1784043968.390148:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00100000:10000000:0.0:1784043968.393140:0:7441:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00000004:00080000:2.0:1784043968.395240:0:7466:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:2.0:1784043968.395249:0:7466:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1784043968.395267:0:7466:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000077011c81 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7466:1870705580844672:0@lo:1000: 00000100:00100000:2.0:1784043968.395394:0:7466:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000050ef7cb1 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7466:1870705580844800:0@lo:1000: 00000100:00100000:2.0:1784043968.395465:0:7466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784043968.395541:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580844800 00000100:00100000:2.0:1784043968.395547:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580844800 00000100:00100000:2.0:1784043968.395616:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1784043968.395623:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000026c68162 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7466:x1870705580844800:12345-0@lo:1000: 00000100:00100000:2.0:1784043968.395692:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000026c68162 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7466:x1870705580844800:12345-0@lo:1000: Request processed in 70us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1784043968.395699:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1784043968.395748:0:7466:0:(client.c:2702:ptlrpc_set_wait()) set 00000000e687fd50 going to sleep for 11 seconds 00000100:00100000:2.0:1784043968.395764:0:7466:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000050ef7cb1 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7466:1870705580844800:0@lo:1000: 00000040:00080000:2.0:1784043968.395782:0:7466:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:2.0:1784043968.395820:0:7466:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 000000005fd96d6a with version 1 00000004:00080000:3.0:1784043968.398708:0:7456:0:(osp_trans.c:1336:osp_get_next_request()) ou 00000000dfd299e3 version 1 rpc_version 1 00000020:00100000:3.0:1784043968.398755:0:7456:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1784043968.398764:0:7456:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000e8cfe501 x1870705580845056/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1784043968.398786:0:7456:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000e8cfe501 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7456:1870705580845056:0@lo:1000: 00000100:00100000:3.0:1784043968.398848:0:7456:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784043968.398896:0:7456:0:(client.c:2702:ptlrpc_set_wait()) set 000000001f689f2a going to sleep for 11 seconds 00000040:00080000:2.0:1784043968.399986:0:7466:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1784043968.400150:0:7466:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000100:00100000:2.0:1784043968.400434:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580845056 00000100:00100000:2.0:1784043968.400443:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580845056 00000100:00100000:2.0:1784043968.400557:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1784043968.400567:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001abdd810 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7456:x1870705580845056:12345-0@lo:1000: 00100000:10000000:0.0:1784043968.406508:0:7441:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:0.0:1784043968.406709:0:7441:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:0.0:1784043968.406862:0:7441:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:0.0:1784043968.407477:0:7441:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:0.0:1784043968.408145:0:7441:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000001:00080000:1.0:1784043968.409804:0:6490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967298 is committed 00000100:00100000:2.0:1784043968.409986:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001abdd810 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7456:x1870705580845056:12345-0@lo:1000: Request processed in 9417us (11134us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1784043968.410008:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000004:00080000:0.0:1784043968.414498:0:7456:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:0.0:1784043968.414509:0:7456:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:0.0:1784043968.414546:0:7456:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000e8cfe501 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7456:1870705580845056:0@lo:1000: 00000001:00080000:0.0:1784043968.424166:0:7441:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1784043968.424398:0:7441:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffb73bc1c57988 00100000:10000000:0.0:1784043968.424408:0:7441:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000040:00080000:3.0:1784043968.428661:0:7465:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1784043968.435706:0:7465:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1784043968.435821:0:7465:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1784043968.435826:0:7465:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00000020:01000004:1.0:1784043968.439915:0:7441:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1784043968.439951:0:7441:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.140@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1784043968.439977:0:7441:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:1.0:1784043968.440140:0:7441:0:(super25.c:181:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:0.0:1784043968.441388:0:7441:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1784043968.441573:0:7441:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:0.0:1784043969.166540:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784043970.190309:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784043971.214341:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784043972.238066:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784043973.262936:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1784043973.691707:0:7711:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg240-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:3.0:1784043973.710722:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784043973.710744:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000000e85f894 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1870705580845184:0@lo:41: 00000100:00100000:3.0:1784043973.710814:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784043973.712562:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580845184 00000100:00100000:1.0:1784043973.712574:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580845184 00000100:00100000:1.0:1784043973.712631:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1784043973.712639:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007a6e663b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1870705580845184:12345-0@lo:41: 00000004:00000024:1.0:1784043973.712678:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:1.0:1784043973.712750:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007a6e663b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1870705580845184:12345-0@lo:41: Request processed in 112us (1937us total) trans 0 rc 0/0 00000100:00100000:1.0:1784043973.712758:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1784043973.712970:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000019726bed pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1870705580845568:0@lo:400: 00000100:00100000:3.0:1784043973.713008:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784043973.713060:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000000e85f894 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1870705580845184:0@lo:41: 00000100:00100000:3.0:1784043973.713093:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580845568 00000100:00100000:3.0:1784043973.713097:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580845568 00000100:00100000:3.0:1784043973.713131:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1784043973.713136:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a66635dd pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1870705580845568:12345-0@lo:400: 00000100:00100000:3.0:1784043973.713169:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a66635dd pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1870705580845568:12345-0@lo:400: Request processed in 33us (162us total) trans 0 rc 0/0 00000100:00100000:3.0:1784043973.713203:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1784043973.713244:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@0000000019726bed x1870705580845568/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784043989 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784043973.713254:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000019726bed pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1870705580845568:0@lo:400: 00000100:00100000:2.0:1784043973.713477:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000054f985b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:3640:1870705580845312:0@lo:400: 00000100:00100000:2.0:1784043973.713522:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784043973.713555:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784043973.713562:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000001127ed1d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1870705580845440:0@lo:400: 00000100:00100000:2.0:1784043973.713585:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784043973.713616:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580845440 00000100:00100000:2.0:1784043973.713619:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580845440 00000100:00100000:2.0:1784043973.713644:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1784043973.713657:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000050ef7cb1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1870705580845440:12345-0@lo:400: 00000100:00100000:2.0:1784043973.713691:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000050ef7cb1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1870705580845440:12345-0@lo:400: Request processed in 35us (105us total) trans 0 rc 0/0 00000100:00100000:2.0:1784043973.713697:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1784043973.713723:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@000000001127ed1d x1870705580845440/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784043989 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784043973.713732:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000001127ed1d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1870705580845440:0@lo:400: 00000100:00100000:3.0:1784043973.714208:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580845312 00000100:00100000:3.0:1784043973.714214:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580845312 00000100:00100000:3.0:1784043973.714257:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1784043973.714263:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008f86fd3e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+13:3640:x1870705580845312:12345-0@lo:400: 00000100:00100000:3.0:1784043973.714294:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008f86fd3e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+13:3640:x1870705580845312:12345-0@lo:400: Request processed in 32us (773us total) trans 0 rc 0/0 00000100:00100000:3.0:1784043973.714301:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1784043973.715344:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000054f985b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:3640:1870705580845312:0@lo:400: 00010000:00010000:0.0:1784043974.286471:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1784043974.733849:0:6508:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1784043974.733860:0:6508:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9b396f3cf800 from 4 10000000:01000000:1.0:1784043974.733865:0:6508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1784043974.733905:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: 0000000047aa1126/0x89871fc3aba17c36 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784043974.733916:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: 0000000047aa1126/0x89871fc3aba17c36 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784043974.733926:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: 0000000047aa1126/0x89871fc3aba17c36 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784043974.733946:0:6508:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000855fc6fc pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580845696:0@lo:101: 00000100:00100000:1.0:1784043974.734022:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784043974.734077:0:6508:0:(client.c:2702:ptlrpc_set_wait()) set 0000000008a58d1d going to sleep for 11 seconds 00000100:00100000:1.0:1784043974.736152:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580845696 00000100:00100000:1.0:1784043974.736166:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580845696 00000100:00100000:1.0:1784043974.736347:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1784043974.736358:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c538a61f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+13:6508:x1870705580845696:12345-0@lo:101: 00010000:00010000:1.0:1784043974.736376:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784043974.736395:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000009e35d841/0x89871fc3aba17c3d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x89871fc3aba17c36 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784043974.736447:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000009e35d841/0x89871fc3aba17c3d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x89871fc3aba17c36 expref: 14 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784043974.736459:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000009e35d841/0x89871fc3aba17c3d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x89871fc3aba17c36 expref: 14 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784043974.736471:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000009e35d841, rc 0) 00000100:00100000:1.0:1784043974.736680:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c538a61f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+14:6508:x1870705580845696:12345-0@lo:101: Request processed in 323us (2656us total) trans 0 rc 0/0 00000100:00100000:1.0:1784043974.736688:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1784043974.737023:0:6508:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000855fc6fc pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580845696:0@lo:101: 00010000:00010000:0.0:1784043974.737052:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: 0000000047aa1126/0x89871fc3aba17c36 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba17c3d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784043974.737062:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: 0000000047aa1126/0x89871fc3aba17c36 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x89871fc3aba17c3d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784043974.737131:0:6508:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000045492e6e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580845824:0@lo:256: 00000100:00100000:0.0:1784043974.737192:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784043974.737220:0:6508:0:(client.c:2702:ptlrpc_set_wait()) set 00000000f543cf78 going to sleep for 11 seconds 00000100:00100000:3.0:1784043974.737570:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580845824 00000100:00100000:3.0:1784043974.737576:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580845824 00000100:00100000:3.0:1784043974.737626:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1784043974.737633:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b24b0503 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+14:6508:x1870705580845824:12345-0@lo:256: 20000000:01000000:3.0:1784043974.737648:0:6506:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1784043974.737662:0:6506:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1784043974.737666:0:6506:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:3.0:1784043974.737758:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b24b0503 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+14:6508:x1870705580845824:12345-0@lo:256: Request processed in 126us (585us total) trans 0 rc 0/0 00000100:00100000:3.0:1784043974.737766:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1784043974.737804:0:6508:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000045492e6e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580845824:0@lo:256: 10000000:01000000:3.0:1784043974.737853:0:6508:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1784043974.737864:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: 0000000047aa1126/0x89871fc3aba17c36 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba17c3d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043974.737873:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: 0000000047aa1126/0x89871fc3aba17c36 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba17c3d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784043974.737883:0:6508:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1784043974.737885:0:6508:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9b397418c800 from 21 10000000:01000000:3.0:1784043974.737888:0:6508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1784043974.737911:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: 0000000017dbd489/0x89871fc3aba17c44 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043974.737918:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: 0000000017dbd489/0x89871fc3aba17c44 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043974.737925:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: 0000000017dbd489/0x89871fc3aba17c44 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784043974.737936:0:6508:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000019726bed pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580845952:0@lo:101: 00000100:00100000:3.0:1784043974.737961:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784043974.737975:0:6508:0:(client.c:2702:ptlrpc_set_wait()) set 00000000f7b50bbf going to sleep for 11 seconds 00000100:00100000:3.0:1784043974.737986:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580845952 00000100:00100000:3.0:1784043974.737989:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580845952 00000100:00100000:3.0:1784043974.738006:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1784043974.738011:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000045df040b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+14:6508:x1870705580845952:12345-0@lo:101: 00010000:00010000:3.0:1784043974.738019:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784043974.738029:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000934b724a/0x89871fc3aba17c4b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x89871fc3aba17c44 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043974.738047:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000934b724a/0x89871fc3aba17c4b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x89871fc3aba17c44 expref: 15 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043974.738064:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000934b724a/0x89871fc3aba17c4b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x89871fc3aba17c44 expref: 15 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043974.738072:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000934b724a, rc 0) 00000100:00100000:3.0:1784043974.738106:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000045df040b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+15:6508:x1870705580845952:12345-0@lo:101: Request processed in 94us (143us total) trans 0 rc 0/0 00000100:00100000:3.0:1784043974.738112:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1784043974.738142:0:6508:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000019726bed pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580845952:0@lo:101: 00010000:00010000:3.0:1784043974.738154:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: 0000000017dbd489/0x89871fc3aba17c44 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba17c4b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043974.738163:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: 0000000017dbd489/0x89871fc3aba17c44 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x89871fc3aba17c4b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784043974.738990:0:6508:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000019726bed pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580846080:0@lo:501: 00000100:00100000:3.0:1784043974.739023:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784043974.739095:0:6508:0:(client.c:2702:ptlrpc_set_wait()) set 00000000f7b50bbf going to sleep for 11 seconds 00000100:00100000:2.0:1784043974.739132:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580846080 00000100:00100000:2.0:1784043974.739138:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580846080 00000100:00100000:2.0:1784043974.739487:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1784043974.739496:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000056d34cc7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+15:6508:x1870705580846080:12345-0@lo:501: 00000100:00100000:2.0:1784043974.739626:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000056d34cc7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+15:6508:x1870705580846080:12345-0@lo:501: Request processed in 132us (603us total) trans 0 rc 0/0 00000100:00100000:2.0:1784043974.739633:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1784043974.739694:0:6508:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000019726bed pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580846080:0@lo:501: 00000100:00100000:3.0:1784043974.739727:0:6508:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000019726bed pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580846208:0@lo:503: 00000100:00100000:3.0:1784043974.739769:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784043974.739790:0:6508:0:(client.c:2702:ptlrpc_set_wait()) set 00000000f7b50bbf going to sleep for 11 seconds 00000100:00100000:3.0:1784043974.739803:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580846208 00000100:00100000:3.0:1784043974.739808:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580846208 00000100:00100000:3.0:1784043974.739833:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1784043974.739838:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002d3d447e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+15:6508:x1870705580846208:12345-0@lo:503: 00000100:00100000:3.0:1784043974.739922:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002d3d447e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+15:6508:x1870705580846208:12345-0@lo:503: Request processed in 84us (152us total) trans 0 rc 0/0 00000100:00100000:3.0:1784043974.739937:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1784043974.739979:0:6508:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000019726bed pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580846208:0@lo:503: 00000100:00100000:3.0:1784043974.740146:0:7761:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000019726bed pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:7761:1870705580846336:0@lo:502: 00000100:00100000:3.0:1784043974.740199:0:7761:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784043974.740218:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580846336 00000100:00100000:3.0:1784043974.740222:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580846336 00000100:00100000:3.0:1784043974.740242:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1784043974.740247:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ede9543a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+15:7761:x1870705580846336:12345-0@lo:502: 00000100:00100000:3.0:1784043974.740564:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ede9543a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+15:7761:x1870705580846336:12345-0@lo:502: Request processed in 316us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1784043974.740571:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1784043974.740602:0:7761:0:(client.c:2702:ptlrpc_set_wait()) set 000000005a574c58 going to sleep for 11 seconds 00000100:00100000:3.0:1784043974.740615:0:7761:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000019726bed pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:7761:1870705580846336:0@lo:502: 00000100:00100000:3.0:1784043974.740654:0:7761:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000019726bed pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:7761:1870705580846464:0@lo:502: 00000100:00100000:3.0:1784043974.740685:0:7761:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784043974.740704:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580846464 00000100:00100000:3.0:1784043974.740708:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580846464 00000100:00100000:3.0:1784043974.740729:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1784043974.740734:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000622993aa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+15:7761:x1870705580846464:12345-0@lo:502: 00000100:00100000:3.0:1784043974.740792:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000622993aa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+15:7761:x1870705580846464:12345-0@lo:502: Request processed in 58us (107us total) trans 0 rc 0/0 00000100:00100000:3.0:1784043974.740798:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1784043974.740822:0:7761:0:(client.c:2702:ptlrpc_set_wait()) set 000000005a574c58 going to sleep for 11 seconds 00000100:00100000:3.0:1784043974.740832:0:7761:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000019726bed pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:7761:1870705580846464:0@lo:502: 00000040:00080000:3.0:1784043974.740854:0:7761:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:3.0:1784043974.740912:0:6508:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:3.0:1784043974.740945:0:6508:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1784043974.740953:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: 0000000017dbd489/0x89871fc3aba17c44 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba17c4b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043974.740962:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: 0000000017dbd489/0x89871fc3aba17c44 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba17c4b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784043974.740971:0:6508:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1784043974.740974:0:6508:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9b397418c800 from 4 10000000:01000000:3.0:1784043974.740976:0:6508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1784043974.740996:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: 00000000223ad1ac/0x89871fc3aba17c52 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043974.741003:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: 00000000223ad1ac/0x89871fc3aba17c52 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043974.741011:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: 00000000223ad1ac/0x89871fc3aba17c52 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784043974.741023:0:6508:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000019726bed pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580846592:0@lo:101: 00000100:00100000:3.0:1784043974.741049:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784043974.741064:0:6508:0:(client.c:2702:ptlrpc_set_wait()) set 000000005a574c58 going to sleep for 11 seconds 00000100:00100000:3.0:1784043974.741077:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580846592 00000100:00100000:3.0:1784043974.741080:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580846592 00000100:00100000:3.0:1784043974.741101:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1784043974.741107:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000593ff23b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+15:6508:x1870705580846592:12345-0@lo:101: 00010000:00010000:3.0:1784043974.741115:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784043974.741130:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000003673cdfe/0x89871fc3aba17c59 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x89871fc3aba17c52 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043974.741148:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000003673cdfe/0x89871fc3aba17c59 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x89871fc3aba17c52 expref: 16 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043974.741157:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000003673cdfe/0x89871fc3aba17c59 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x89871fc3aba17c52 expref: 16 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043974.741164:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000003673cdfe, rc 0) 00000100:00100000:3.0:1784043974.741215:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000593ff23b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+16:6508:x1870705580846592:12345-0@lo:101: Request processed in 109us (166us total) trans 0 rc 0/0 00000100:00100000:3.0:1784043974.741221:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1784043974.741249:0:6508:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000019726bed pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580846592:0@lo:101: 00010000:00010000:3.0:1784043974.741260:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: 00000000223ad1ac/0x89871fc3aba17c52 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba17c59 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043974.741268:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: 00000000223ad1ac/0x89871fc3aba17c52 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x89871fc3aba17c59 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784043974.741307:0:6508:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000019726bed pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580846720:0@lo:256: 00000100:00100000:3.0:1784043974.741742:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784043974.741758:0:6508:0:(client.c:2702:ptlrpc_set_wait()) set 000000005a574c58 going to sleep for 11 seconds 00000100:00100000:3.0:1784043974.741771:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580846720 00000100:00100000:3.0:1784043974.741774:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580846720 00000100:00100000:3.0:1784043974.741795:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1784043974.741800:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006d9e0862 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+16:6508:x1870705580846720:12345-0@lo:256: 20000000:01000000:3.0:1784043974.741813:0:6505:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1784043974.741829:0:6505:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1784043974.741836:0:6505:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:3.0:1784043974.741908:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006d9e0862 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+16:6508:x1870705580846720:12345-0@lo:256: Request processed in 106us (164us total) trans 0 rc 0/0 00000100:00100000:3.0:1784043974.741915:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1784043974.741948:0:6508:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000019726bed pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580846720:0@lo:256: 10000000:01000000:3.0:1784043974.741989:0:6508:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1784043974.741994:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: 00000000223ad1ac/0x89871fc3aba17c52 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba17c59 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043974.742001:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: 00000000223ad1ac/0x89871fc3aba17c52 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba17c59 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784043974.742007:0:6508:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1784043974.742009:0:6508:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:3.0:1784043974.742011:0:6508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1784043974.742037:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: 00000000752054b2/0x89871fc3aba17c60 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043974.742043:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: 00000000752054b2/0x89871fc3aba17c60 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043974.742051:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: 00000000752054b2/0x89871fc3aba17c60 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784043974.742064:0:6508:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000019726bed pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580846848:0@lo:101: 00000100:00100000:3.0:1784043974.742090:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784043974.742104:0:6508:0:(client.c:2702:ptlrpc_set_wait()) set 000000005a574c58 going to sleep for 11 seconds 00000100:00100000:3.0:1784043974.742117:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580846848 00000100:00100000:3.0:1784043974.742120:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580846848 00000100:00100000:3.0:1784043974.742139:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1784043974.742150:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003e630ddc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+16:6508:x1870705580846848:12345-0@lo:101: 00010000:00010000:3.0:1784043974.742157:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784043974.742168:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000b5c45b20/0x89871fc3aba17c67 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x89871fc3aba17c60 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043974.742201:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b5c45b20/0x89871fc3aba17c67 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x89871fc3aba17c60 expref: 17 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043974.742209:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000b5c45b20/0x89871fc3aba17c67 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x89871fc3aba17c60 expref: 17 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043974.742215:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000b5c45b20, rc 0) 00000100:00100000:3.0:1784043974.742243:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003e630ddc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+17:6508:x1870705580846848:12345-0@lo:101: Request processed in 94us (153us total) trans 0 rc 0/0 00000100:00100000:3.0:1784043974.742250:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1784043974.742279:0:6508:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000019726bed pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580846848:0@lo:101: 00010000:00010000:3.0:1784043974.742288:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: 00000000752054b2/0x89871fc3aba17c60 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba17c67 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043974.742295:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: 00000000752054b2/0x89871fc3aba17c60 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x89871fc3aba17c67 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784043974.743096:0:6508:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000019726bed pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580846976:0@lo:501: 00000100:00100000:3.0:1784043974.743136:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784043974.743628:0:6508:0:(client.c:2702:ptlrpc_set_wait()) set 000000005a574c58 going to sleep for 11 seconds 00000100:00100000:2.0:1784043974.743882:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580846976 00000100:00100000:2.0:1784043974.743889:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580846976 00000100:00100000:2.0:1784043974.743940:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1784043974.743948:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000759192e4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+17:6508:x1870705580846976:12345-0@lo:501: 00000100:00100000:2.0:1784043974.744083:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000759192e4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+17:6508:x1870705580846976:12345-0@lo:501: Request processed in 137us (947us total) trans 0 rc 0/0 00000100:00100000:2.0:1784043974.744090:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1784043974.744136:0:6508:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000019726bed pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580846976:0@lo:501: 00000100:00100000:2.0:1784043974.744199:0:6508:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000009c7cab6a pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580847104:0@lo:503: 00000100:00100000:2.0:1784043974.744242:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784043974.744274:0:6508:0:(client.c:2702:ptlrpc_set_wait()) set 00000000bea2ac9e going to sleep for 11 seconds 00000100:00100000:2.0:1784043974.744284:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580847104 00000100:00100000:2.0:1784043974.744287:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580847104 00000100:00100000:2.0:1784043974.744304:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1784043974.744309:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c033a9aa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+17:6508:x1870705580847104:12345-0@lo:503: 00000100:00100000:2.0:1784043974.744580:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c033a9aa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+17:6508:x1870705580847104:12345-0@lo:503: Request processed in 271us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1784043974.744587:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1784043974.744622:0:6508:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000009c7cab6a pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580847104:0@lo:503: 00000100:00100000:2.0:1784043974.744786:0:7764:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000009c7cab6a pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:7764:1870705580847232:0@lo:502: 00000100:00100000:2.0:1784043974.744819:0:7764:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784043974.744837:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580847232 00000100:00100000:2.0:1784043974.744841:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580847232 00000100:00100000:2.0:1784043974.744858:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1784043974.744862:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c1a71e72 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+17:7764:x1870705580847232:12345-0@lo:502: 00000100:00100000:2.0:1784043974.744933:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c1a71e72 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+17:7764:x1870705580847232:12345-0@lo:502: Request processed in 70us (114us total) trans 0 rc 0/0 00000100:00100000:2.0:1784043974.744940:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1784043974.744966:0:7764:0:(client.c:2702:ptlrpc_set_wait()) set 00000000020d8d38 going to sleep for 11 seconds 00000100:00100000:2.0:1784043974.744978:0:7764:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000009c7cab6a pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:7764:1870705580847232:0@lo:502: 00000020:01000000:2.0:1784043974.744997:0:7764:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784043974.745008:0:7764:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784043974.745010:0:7764:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:2.0:1784043974.745015:0:7764:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1784043974.745018:0:7764:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.202.140@tcp to nid 0x20000c0a8ca8c (192.168.202.140@tcp) 00000020:00000080:2.0:1784043974.745041:0:7764:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1784043974.745054:0:7764:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (00000000686acb83) 00000020:00000080:2.0:1784043974.745073:0:7764:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osp with refcount 2 00000020:00000080:2.0:1784043974.745083:0:7764:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1784043974.745160:0:7764:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:2.0:1784043974.745166:0:7764:0:(osd_handler.c:8929:osd_obd_connect()) connect #5 00000020:00000080:2.0:1784043974.745198:0:7764:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x89871fc3aba17c75 00010000:00080000:2.0:1784043974.745232:0:7764:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000dedd873c@lustre-MDT0001-osp-MDT0000: add connection 192.168.202.140@tcp at head 00010000:00010000:2.0:1784043974.748726:0:7764:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-4 is initialized 00000020:00000080:3.0:1784043974.749761:0:7764:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1784043974.749773:0:7764:0:(obd_config.c:1470:class_process_config()) processing cmd: cf014 00000004:01000000:3.0:1784043974.749804:0:7764:0:(lod_lov.c:129:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:3.0:1784043974.749826:0:7764:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x89871fc3aba17c7c 00000100:00080000:3.0:1784043974.749841:0:7764:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1784043974.749845:0:7764:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import 00000000dedd873c using connection 192.168.202.140@tcp/0@lo 00000100:00100000:3.0:1784043974.749875:0:7764:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000019726bed x1870705580847360/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1784043974.749896:0:7764:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000040:01000000:3.0:1784043974.749929:0:7764:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00100000:2.0:1784043974.750059:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000019726bed pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1870705580847360:0@lo:38: 00000100:00100000:2.0:1784043974.750120:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784043974.750269:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580847360 00000100:00100000:3.0:1784043974.750278:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580847360 00000100:00100000:3.0:1784043974.751553:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1784043974.751566:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009c7cab6a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3637:x1870705580847360:12345-0@lo:38: 00010000:00080000:3.0:1784043974.751598:0:6517:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 167 last 0 00000020:00000080:3.0:1784043974.751638:0:6517:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x89871fc3aba17c83 00000004:00100000:3.0:1784043974.751655:0:6517:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:3.0:1784043974.751660:0:6517:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:2.0:1784043974.751933:0:7767:0:(client.c:1832:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@00000000f6d3719e x1870705580847488/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784043974.751944:0:7767:0:(client.c:2702:ptlrpc_set_wait()) set 00000000fcdc345f going to sleep for 0 seconds 00000020:01000000:3.0:1784043974.752037:0:7764:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784043974.752044:0:7764:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784043974.752045:0:7764:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:3.0:1784043974.752048:0:7764:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784043974.752051:0:7764:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784043974.752053:0:7764:0:(obd_config.c:1561:class_process_config()) marker 18 (0x1) lustre sys.timeout 00000020:00000080:3.0:1784043974.752056:0:7764:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1784043974.752057:0:7764:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1784043974.752081:0:7764:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000054f985b pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:7764:1870705580847616:0@lo:502: 00000100:00100000:3.0:1784043974.752151:0:7764:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784043974.752212:0:7764:0:(client.c:2702:ptlrpc_set_wait()) set 00000000b0334fbc going to sleep for 11 seconds 00000100:00100000:2.0:1784043974.752270:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580847616 00000100:00100000:2.0:1784043974.752277:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580847616 00000100:00100000:2.0:1784043974.752503:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1784043974.752513:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009772d483 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+17:7764:x1870705580847616:12345-0@lo:502: 00000100:00100000:2.0:1784043974.752621:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009772d483 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+17:7764:x1870705580847616:12345-0@lo:502: Request processed in 110us (470us total) trans 0 rc 0/0 00000100:00100000:2.0:1784043974.752630:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1784043974.752720:0:7764:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000054f985b pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:7764:1870705580847616:0@lo:502: 00000020:01000000:3.0:1784043974.752745:0:7764:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784043974.752750:0:7764:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784043974.752757:0:7764:0:(obd_config.c:1561:class_process_config()) marker 18 (0x2) lustre sys.timeout 00000040:00080000:3.0:1784043974.752760:0:7764:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:2.0:1784043974.752957:0:6508:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:2.0:1784043974.752981:0:6508:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1784043974.752990:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: 00000000752054b2/0x89871fc3aba17c60 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba17c67 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784043974.753002:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: 00000000752054b2/0x89871fc3aba17c60 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba17c67 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784043974.753012:0:6508:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1784043974.753014:0:6508:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff9b394402b380 from 1 10000000:01000000:2.0:1784043974.753017:0:6508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1784043974.753048:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: 00000000624b7a4c/0x89871fc3aba17c8a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784043974.753055:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: 00000000624b7a4c/0x89871fc3aba17c8a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784043974.753063:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: 00000000624b7a4c/0x89871fc3aba17c8a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784043974.753076:0:6508:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000a656cb83 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580847744:0@lo:101: 00000100:00100000:2.0:1784043974.753106:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784043974.753140:0:6508:0:(client.c:2702:ptlrpc_set_wait()) set 00000000ade3dca6 going to sleep for 11 seconds 00000100:00100000:2.0:1784043974.753725:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000001956d5ca pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3639:1870705580847872:0@lo:400: 00000100:00100000:2.0:1784043974.753760:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784043974.753791:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000da6c0e8b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1870705580848000:0@lo:400: 00000100:00100000:2.0:1784043974.753811:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784043974.753822:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784043974.753825:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000f4a73654 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1870705580848128:0@lo:400: 00000100:00100000:2.0:1784043974.753837:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784043974.753855:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580847872 00000100:00100000:2.0:1784043974.753858:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580847872 00000100:00100000:2.0:1784043974.753882:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580848128 00000100:00100000:2.0:1784043974.753883:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580848128 00000100:00100000:2.0:1784043974.753891:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1784043974.753894:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000098d9a091 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1870705580847872:12345-0@lo:400: 00000100:00100000:2.0:1784043974.753924:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000098d9a091 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1870705580847872:12345-0@lo:400: Request processed in 29us (165us total) trans 0 rc 0/0 00000100:00100000:2.0:1784043974.753928:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1784043974.753936:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1784043974.753950:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000032f891aa pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1870705580848128:12345-0@lo:400: 00000100:00100000:2.0:1784043974.753981:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000032f891aa pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1870705580848128:12345-0@lo:400: Request processed in 32us (143us total) trans 0 rc 0/0 00000100:00100000:2.0:1784043974.753987:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1784043974.754016:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000f4a73654 x1870705580848128/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784043990 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784043974.754025:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000f4a73654 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1870705580848128:0@lo:400: 00010000:00080000:2.0:1784043974.754039:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@000000001956d5ca x1870705580847872/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784043990 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784043974.754045:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000001956d5ca pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3639:1870705580847872:0@lo:400: 00000100:00100000:3.0:1784043974.754567:0:6516:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:3.0:1784043974.754577:0:6516:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:3.0:1784043974.754598:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580847744 00000100:00100000:3.0:1784043974.754603:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580847744 00000100:00100000:3.0:1784043974.754633:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1784043974.754639:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bc4c5213 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+17:6508:x1870705580847744:12345-0@lo:101: 00010000:00010000:3.0:1784043974.754649:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784043974.754662:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000348717a7/0x89871fc3aba17c91 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x89871fc3aba17c8a expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043974.754684:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000348717a7/0x89871fc3aba17c91 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x89871fc3aba17c8a expref: 18 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043974.754693:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000348717a7/0x89871fc3aba17c91 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x89871fc3aba17c8a expref: 18 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043974.754700:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000348717a7, rc 0) 00000100:00100000:3.0:1784043974.754728:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bc4c5213 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+18:6508:x1870705580847744:12345-0@lo:101: Request processed in 90us (1623us total) trans 0 rc 0/0 00000100:00100000:3.0:1784043974.754732:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1784043974.754754:0:6508:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000a656cb83 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580847744:0@lo:101: 00010000:00010000:3.0:1784043974.754765:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: 00000000624b7a4c/0x89871fc3aba17c8a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba17c91 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043974.754771:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: 00000000624b7a4c/0x89871fc3aba17c8a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x89871fc3aba17c91 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784043974.754817:0:6508:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000054f985b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580848256:0@lo:501: 00000100:00100000:3.0:1784043974.754855:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784043974.754877:0:6508:0:(client.c:2702:ptlrpc_set_wait()) set 00000000f7b50bbf going to sleep for 11 seconds 00000100:00100000:3.0:1784043974.754901:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580848256 00000100:00100000:3.0:1784043974.754905:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580848256 00000100:00100000:3.0:1784043974.754927:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1784043974.754934:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000edd60308 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+18:6508:x1870705580848256:12345-0@lo:501: 00000100:00100000:3.0:1784043974.755005:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000edd60308 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+18:6508:x1870705580848256:12345-0@lo:501: Request processed in 73us (150us total) trans 0 rc -2/-2 00000100:00100000:3.0:1784043974.755012:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1784043974.755042:0:6508:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000054f985b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580848256:0@lo:501: 10000000:01000000:3.0:1784043974.755064:0:6508:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1784043974.755070:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: 00000000624b7a4c/0x89871fc3aba17c8a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba17c91 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043974.755077:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: 00000000624b7a4c/0x89871fc3aba17c8a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba17c91 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784043974.755679:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580848000 00000100:00100000:2.0:1784043974.755685:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580848000 00000100:00100000:3.0:1784043974.755823:0:7768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1784043974.755830:0:7768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000003cdb5dd pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1870705580848000:12345-0@lo:400: 00000100:00100000:3.0:1784043974.755938:0:7768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000003cdb5dd pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1870705580848000:12345-0@lo:400: Request processed in 109us (2125us total) trans 0 rc 0/0 00000100:00100000:3.0:1784043974.755946:0:7768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1784043974.756002:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000da6c0e8b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1870705580848000:0@lo:400: 00000100:00080000:3.0:1784043974.759993:0:6517:0:(import.c:65:import_set_state_nolock()) 000000000fceaa87 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1784043974.760084:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009c7cab6a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3637:x1870705580847360:12345-0@lo:38: Request processed in 8517us (9961us total) trans 0 rc 0/0 00000100:00100000:3.0:1784043974.760094:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1784043974.760230:0:3637:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1784043974.760240:0:3637:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1784043974.760249:0:3637:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:2.0:1784043974.760254:0:3637:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1784043974.760256:0:3637:0:(import.c:65:import_set_state_nolock()) 00000000dedd873c lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:2.0:1784043974.760275:0:3637:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000fcdc345f): req@00000000f6d3719e x1870705580847488/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784043974.760292:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000019726bed pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1870705580847360:0@lo:38: 00000100:00100000:2.0:1784043974.760367:0:7767:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784043974.760400:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580847488 00000100:00100000:2.0:1784043974.760405:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580847488 00000100:00100000:2.0:1784043974.760440:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1784043974.760454:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000da6c0e8b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7767:x1870705580847488:12345-0@lo:1000: 00000100:00100000:2.0:1784043974.760545:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000da6c0e8b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7767:x1870705580847488:12345-0@lo:1000: Request processed in 92us (178us total) trans 0 rc 0/0 00000100:00100000:2.0:1784043974.760553:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1784043974.760585:0:7767:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000f6d3719e pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7767:1870705580847488:0@lo:1000: 00000040:01000000:2.0:1784043974.760617:0:7767:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:2.0:1784043974.760655:0:7767:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000f6d3719e pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7767:1870705580848384:0@lo:1000: 00000100:00100000:2.0:1784043974.760689:0:7767:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784043974.760704:0:7767:0:(client.c:2702:ptlrpc_set_wait()) set 00000000fcdc345f going to sleep for 11 seconds 00000100:00100000:3.0:1784043974.761541:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580848384 00000100:00100000:3.0:1784043974.761557:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580848384 00000100:00100000:3.0:1784043974.761608:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1784043974.761618:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001956d5ca pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7767:x1870705580848384:12345-0@lo:1000: 00000100:00100000:3.0:1784043974.761753:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001956d5ca pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7767:x1870705580848384:12345-0@lo:1000: Request processed in 138us (1064us total) trans 0 rc 0/0 00000100:00100000:3.0:1784043974.761761:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1784043974.761854:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000054f985b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1870705580848512:0@lo:41: 00000100:00100000:0.0:1784043974.761894:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784043974.761975:0:7767:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000f6d3719e pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7767:1870705580848384:0@lo:1000: 00000100:00100000:2.0:1784043974.762023:0:7767:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000f6d3719e pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7767:1870705580848640:0@lo:700: 00000100:00100000:2.0:1784043974.762049:0:7767:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784043974.762068:0:7767:0:(client.c:2702:ptlrpc_set_wait()) set 00000000f0399a93 going to sleep for 11 seconds 00000100:00100000:3.0:1784043974.763605:0:7768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580848512 00000100:00100000:3.0:1784043974.763617:0:7768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580848512 00000100:00100000:3.0:1784043974.763663:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1784043974.763672:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000087ddf1ef pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3638:x1870705580848512:12345-0@lo:41: 00000004:00000024:3.0:1784043974.763708:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:1.0:1784043974.764458:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580848640 00000100:00100000:1.0:1784043974.764468:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580848640 00000100:00100000:1.0:1784043974.764520:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1784043974.764527:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f4a73654 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:lustre-MDT0000-mdtlov_UUID+7:7767:x1870705580848640:12345-0@lo:700: 00000100:00100000:1.0:1784043974.764619:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f4a73654 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:lustre-MDT0000-mdtlov_UUID+7:7767:x1870705580848640:12345-0@lo:700: Request processed in 93us (2569us total) trans 0 rc 0/0 00000100:00100000:1.0:1784043974.764627:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1784043974.764654:0:7767:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000f6d3719e pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7767:1870705580848640:0@lo:700: 00000100:00100000:2.0:1784043974.764793:0:7767:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000f6d3719e pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7767:1870705580848768:0@lo:1000: 00000100:00100000:2.0:1784043974.764829:0:7767:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784043974.764856:0:7767:0:(client.c:2702:ptlrpc_set_wait()) set 00000000631b5b14 going to sleep for 11 seconds 00000100:00100000:1.0:1784043974.764875:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580848768 00000100:00100000:1.0:1784043974.764880:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580848768 00000100:00100000:1.0:1784043974.764903:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1784043974.764912:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a656cb83 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:7767:x1870705580848768:12345-0@lo:1000: 00000100:00100000:1.0:1784043974.765107:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a656cb83 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:7767:x1870705580848768:12345-0@lo:1000: Request processed in 197us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1784043974.765114:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1784043974.765120:0:7767:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000f6d3719e pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7767:1870705580848768:0@lo:1000: 00000004:00080000:2.0:1784043974.765165:0:7767:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth 00000000f0399a93 with version 0 00000020:00100000:2.0:1784043974.765205:0:7767:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1784043974.765531:0:7767:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000f6d3719e x1870705580849024/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1784043974.765550:0:7767:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000f6d3719e pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7767:1870705580849024:0@lo:1000: 00000100:00100000:2.0:1784043974.765579:0:7767:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784043974.765613:0:7767:0:(client.c:2702:ptlrpc_set_wait()) set 000000008161f278 going to sleep for 11 seconds 00000100:00100000:1.0:1784043974.765883:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580849024 00000100:00100000:1.0:1784043974.765889:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580849024 00000100:00100000:1.0:1784043974.765914:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1784043974.765929:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000010506563 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:7767:x1870705580849024:12345-0@lo:1000: 00000100:00100000:3.0:1784043974.766566:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000087ddf1ef pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:3638:x1870705580848512:12345-0@lo:41: Request processed in 2893us (4669us total) trans 0 rc 0/0 00000100:00100000:3.0:1784043974.766576:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1784043974.771572:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000054f985b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1870705580848512:0@lo:41: 00000020:00000004:2.0:1784043974.775980:0:7769:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1784043974.776276:0:7769:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000001:00080000:3.0:1784043974.778470:0:7443:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967297 is committed 00000001:00100000:3.0:1784043974.778495:0:7443:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1784043974.778674:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000010506563 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7767:x1870705580849024:12345-0@lo:1000: Request processed in 12743us (13090us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1784043974.778688:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000004:00080000:3.0:1784043974.779676:0:7767:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:3.0:1784043974.779684:0:7767:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1784043974.779763:0:7767:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000f6d3719e pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7767:1870705580849024:0@lo:1000: 00000100:00100000:3.0:1784043974.779867:0:7767:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000001127ed1d pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7767:1870705580849152:0@lo:1000: 00000100:00100000:3.0:1784043974.779921:0:7767:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784043974.779958:0:7767:0:(client.c:2702:ptlrpc_set_wait()) set 000000006f95e767 going to sleep for 11 seconds 00000100:00100000:2.0:1784043974.780278:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580849152 00000100:00100000:2.0:1784043974.780285:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580849152 00000100:00100000:2.0:1784043974.782634:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1784043974.782653:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e8cfe501 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7767:x1870705580849152:12345-0@lo:1000: 00000100:00100000:2.0:1784043974.782807:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e8cfe501 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7767:x1870705580849152:12345-0@lo:1000: Request processed in 161us (2885us total) trans 0 rc 0/0 00000100:00100000:2.0:1784043974.782815:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1784043974.782873:0:7767:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000001127ed1d pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7767:1870705580849152:0@lo:1000: 00000040:00080000:2.0:1784043974.782905:0:7767:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:2.0:1784043974.782948:0:7767:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth 00000000b0d95434 with version 1 00000004:00080000:3.0:1784043974.784810:0:7765:0:(osp_trans.c:1336:osp_get_next_request()) ou 000000009743b615 version 1 rpc_version 1 00000020:00100000:3.0:1784043974.784851:0:7765:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1784043974.784860:0:7765:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@0000000077011c81 x1870705580849408/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1784043974.784883:0:7765:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000077011c81 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7765:1870705580849408:0@lo:1000: 00000100:00100000:3.0:1784043974.784954:0:7765:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784043974.785010:0:7765:0:(client.c:2702:ptlrpc_set_wait()) set 000000009ae7de10 going to sleep for 11 seconds 00000100:00100000:3.0:1784043974.785033:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580849408 00000100:00100000:3.0:1784043974.785039:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580849408 00000100:00100000:3.0:1784043974.785082:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1784043974.785090:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001127ed1d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7765:x1870705580849408:12345-0@lo:1000: 00000040:00080000:2.0:1784043974.789573:0:7767:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1784043974.789669:0:7767:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1784043974.789674:0:7767:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000001:00080000:3.0:1784043974.790619:0:7443:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967298 is committed 00000100:00100000:0.0:1784043974.790893:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001127ed1d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7765:x1870705580849408:12345-0@lo:1000: Request processed in 5800us (5935us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1784043974.790908:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000004:00080000:3.0:1784043974.791080:0:7765:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:3.0:1784043974.791086:0:7765:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1784043974.791103:0:7765:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000077011c81 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7765:1870705580849408:0@lo:1000: 00010000:00010000:1.0:1784043975.309511:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784043976.333807:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784043977.364262:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1784043977.963870:0:7871:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1784043977.964003:0:7871:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1784043978.381392:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784043978.829501:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000f6d3719e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1870705580849536:0@lo:41: 00000100:00100000:3.0:1784043978.829592:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784043978.829803:0:7768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580849536 00000100:00100000:0.0:1784043978.829812:0:7768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580849536 00000100:00100000:0.0:1784043978.829863:0:7768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1784043978.829871:0:7768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000077011c81 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1870705580849536:12345-0@lo:41: 00000004:00000024:0.0:1784043978.829906:0:7768:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:0.0:1784043978.830061:0:7768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000077011c81 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1870705580849536:12345-0@lo:41: Request processed in 190us (470us total) trans 0 rc 0/0 00000100:00100000:0.0:1784043978.830069:0:7768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1784043978.830152:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000f6d3719e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1870705580849536:0@lo:41: 00000020:00000080:1.0:1784043979.186800:0:7919:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffcaf6491a0 20000000:00000080:1.0:1784043979.186817:0:7919:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9b396f26b400 uarg=0000000000000000 20000000:01000000:1.0:1784043979.186853:0:7919:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1784043979.186859:0:7919:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1784043979.186864:0:7919:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:1.0:1784043979.186936:0:7919:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:1.0:1784043979.186947:0:7919:0:(mgs_llog.c:4116:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:1.0:1784043979.189496:0:7919:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1784043979.189753:0:7919:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1784043979.189787:0:7919:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:1.0:1784043979.189801:0:7919:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:1.0:1784043979.189818:0:7919:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1784043979.189835:0:7919:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000b56328ad/0x89871fc3aba17c98 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784043979.189854:0:7919:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000325f393c/0x89871fc3aba17b17 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x89871fc3aba17b10 expref: 17 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784043979.189861:0:7919:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000050e869a7/0x89871fc3aba17c05 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x89871fc3aba17bfe expref: 17 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784043979.189868:0:7919:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000b56328ad/0x89871fc3aba17c98 lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 7919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784043979.189906:0:7919:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000050e869a7/0x89871fc3aba17c05 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x89871fc3aba17bfe expref: 17 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784043979.189926:0:7919:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000050e869a7/0x89871fc3aba17c05 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x89871fc3aba17bfe expref: 17 pid: 6506 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784043979.189939:0:7919:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000006b863310 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7919:1870705580849664:0@lo:104: 00000100:00100000:1.0:1784043979.190004:0:7919:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1784043979.190111:0:7919:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000325f393c/0x89871fc3aba17b17 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x89871fc3aba17b10 expref: 17 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784043979.190119:0:7919:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000325f393c/0x89871fc3aba17b17 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x89871fc3aba17b10 expref: 17 pid: 6505 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784043979.190127:0:7919:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000009aa6163a pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7919:1870705580849792:0@lo:104: 00000100:00100000:1.0:1784043979.190146:0:7919:0:(client.c:2702:ptlrpc_set_wait()) set 000000007081a58c going to sleep for 11 seconds 00000100:00100000:3.0:1784043979.194592:0:6494:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1784043979.194642:0:6494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784043979.194710:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580849664 00000100:00100000:3.0:1784043979.194718:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580849664 00000100:00100000:2.0:1784043979.194777:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580849792 00000100:00100000:2.0:1784043979.194781:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580849792 00000100:00100000:2.0:1784043979.194806:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1784043979.194813:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f50b73b7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+4:7919:x1870705580849664:12345-0@lo:104: 00010000:00010000:2.0:1784043979.194831:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.140@tcp lock: 00000000f89289b8/0x89871fc3aba17bfe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x89871fc3aba17c05 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784043979.194914:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1784043979.194920:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f50b73b7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+4:7919:x1870705580849664:12345-0@lo:104: Request processed in 108us (4916us total) trans 0 rc 0/0 00000100:00100000:2.0:1784043979.194926:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1784043979.194968:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1784043979.194974:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000054f985b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+3:7919:x1870705580849792:12345-0@lo:104: 00010000:00010000:2.0:1784043979.194994:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.140@tcp lock: 000000003d9de477/0x89871fc3aba17b10 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x89871fc3aba17b17 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784043979.195028:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1784043979.195032:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000054f985b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+3:7919:x1870705580849792:12345-0@lo:104: Request processed in 60us (393us total) trans 0 rc 0/0 00000100:00100000:2.0:1784043979.195039:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:2.0:1784043979.195056:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1784043979.195061:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: 00000000f89289b8/0x89871fc3aba17bfe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x89871fc3aba17c05 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784043979.195068:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000f89289b8 already unused, calling callback (00000000c6a82693) 10000000:00010000:2.0:1784043979.195071:0:6499:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: 00000000f89289b8/0x89871fc3aba17bfe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x89871fc3aba17c05 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784043979.195080:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: 00000000f89289b8/0x89871fc3aba17bfe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x89871fc3aba17c05 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784043979.195087:0:6499:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: 00000000f89289b8/0x89871fc3aba17bfe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x89871fc3aba17c05 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784043979.195092:0:6499:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1784043979.195125:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.140@tcp lock: 00000000f89289b8/0x89871fc3aba17bfe lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x89871fc3aba17c05 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784043979.195131:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784043979.195147:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: 00000000f89289b8/0x89871fc3aba17bfe lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x89871fc3aba17c05 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784043979.195153:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: 00000000f89289b8/0x89871fc3aba17bfe lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x89871fc3aba17c05 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784043979.195202:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784043979.195205:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: 000000003d9de477/0x89871fc3aba17b10 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x89871fc3aba17b17 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784043979.195210:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000003d9de477 already unused, calling callback (00000000c6a82693) 10000000:00010000:2.0:1784043979.195212:0:6499:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: 000000003d9de477/0x89871fc3aba17b10 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x89871fc3aba17b17 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784043979.195218:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: 000000003d9de477/0x89871fc3aba17b10 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x89871fc3aba17b17 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784043979.195224:0:6499:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: 000000003d9de477/0x89871fc3aba17b10 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x89871fc3aba17b17 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784043979.195228:0:6499:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1784043979.195257:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.140@tcp lock: 000000003d9de477/0x89871fc3aba17b10 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x89871fc3aba17b17 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784043979.195264:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784043979.195269:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: 000000003d9de477/0x89871fc3aba17b10 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x89871fc3aba17b17 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784043979.195274:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: 000000003d9de477/0x89871fc3aba17b10 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x89871fc3aba17b17 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784043979.195290:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784043979.195291:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784043979.195293:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784043979.195313:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000f6d3719e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:3640:1870705580849920:0@lo:103: 00000100:00100000:2.0:1784043979.195352:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784043979.195387:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784043979.195392:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000d43a34d4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:3640:1870705580850048:0@lo:103: 00000100:00100000:2.0:1784043979.195413:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784043979.195452:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580849920 00000100:00100000:2.0:1784043979.195457:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580849920 00010000:00010000:2.0:1784043979.195475:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000050e869a7/0x89871fc3aba17c05 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x89871fc3aba17bfe expref: 18 pid: 6506 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784043979.195495:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580850048 00000100:00100000:2.0:1784043979.195497:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580850048 00010000:00010000:2.0:1784043979.195507:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000325f393c/0x89871fc3aba17b17 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x89871fc3aba17b10 expref: 19 pid: 6505 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784043979.195519:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1784043979.195524:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000dc77644f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+19:3640:x1870705580849920:12345-0@lo:103: 00010000:00010000:2.0:1784043979.195535:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784043979.195538:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000050e869a7/0x89871fc3aba17c05 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x89871fc3aba17bfe expref: 19 pid: 6506 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784043979.195547:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000050e869a7/0x89871fc3aba17c05 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x89871fc3aba17bfe expref: 19 pid: 6506 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784043979.195563:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784043979.195587:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000dc77644f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+19:3640:x1870705580849920:12345-0@lo:103: Request processed in 63us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1784043979.195593:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1784043979.195606:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1784043979.195611:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002672f1f8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+18:3640:x1870705580850048:12345-0@lo:103: 00010000:00010000:2.0:1784043979.195626:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784043979.195629:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000325f393c/0x89871fc3aba17b17 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x89871fc3aba17b10 expref: 18 pid: 6505 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784043979.195637:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000325f393c/0x89871fc3aba17b17 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x89871fc3aba17b10 expref: 18 pid: 6505 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784043979.195648:0:6496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000b56328ad/0x89871fc3aba17c98 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 7919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784043979.195654:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b56328ad/0x89871fc3aba17c98 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 7919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784043979.195665:0:6496:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000b56328ad/0x89871fc3aba17c98 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 7919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784043979.195672:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000b56328ad/0x89871fc3aba17c98 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784043979.195677:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000b56328ad/0x89871fc3aba17c98 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784043979.195683:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000b56328ad/0x89871fc3aba17c98 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784043979.195688:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000b56328ad already unused, calling callback (00000000622db14d) 00010000:00010000:2.0:1784043979.195691:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000b56328ad/0x89871fc3aba17c98 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784043979.195698:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000b56328ad/0x89871fc3aba17c98 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 7919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784043979.195712:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000b56328ad/0x89871fc3aba17c98 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784043979.195722:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784043979.195742:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002672f1f8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+18:3640:x1870705580850048:12345-0@lo:103: Request processed in 132us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1784043979.195747:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1784043979.195780:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000d43a34d4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:3640:1870705580850048:0@lo:103: 00000100:00100000:2.0:1784043979.195787:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000f6d3719e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:3640:1870705580849920:0@lo:103: 00010000:00010000:1.0:1784043979.195883:0:7919:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000050e869a7/0x89871fc3aba17c05 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x89871fc3aba17bfe expref: 17 pid: 6506 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784043979.195893:0:7919:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000006b863310 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7919:1870705580849664:0@lo:104: 00010000:00010000:1.0:1784043979.195901:0:7919:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000325f393c/0x89871fc3aba17b17 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x89871fc3aba17b10 expref: 16 pid: 6505 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784043979.195908:0:7919:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000009aa6163a pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7919:1870705580849792:0@lo:104: 00010000:00010000:1.0:1784043979.195923:0:7919:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000b56328ad/0x89871fc3aba17c98 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784043979.195931:0:7919:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000b56328ad/0x89871fc3aba17c98 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784043979.195937:0:7919:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000b56328ad/0x89871fc3aba17c98 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784043979.195948:0:7919:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000b56328ad/0x89871fc3aba17c98 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784043979.196869:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784043979.405399:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784043979.853542:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000090e6db70 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1870705580850432:0@lo:400: 00000100:00100000:0.0:1784043979.853619:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784043979.853695:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784043979.853701:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000001ff4add4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1870705580850560:0@lo:400: 00000100:00100000:0.0:1784043979.853728:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784043979.853768:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580850560 00000100:00100000:0.0:1784043979.853776:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580850560 00000100:00100000:0.0:1784043979.853827:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1784043979.853836:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002b4e090e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1870705580850560:12345-0@lo:400: 00000100:00100000:0.0:1784043979.853886:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002b4e090e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1870705580850560:12345-0@lo:400: Request processed in 52us (158us total) trans 0 rc 0/0 00000100:00100000:0.0:1784043979.853894:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:0.0:1784043979.853945:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@000000001ff4add4 x1870705580850560/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784043995 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784043979.853959:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000001ff4add4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1870705580850560:0@lo:400: 00000100:00100000:1.0:1784043979.854157:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000005e1f5826 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:3638:1870705580850176:0@lo:400: 00000100:00100000:1.0:1784043979.854226:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784043979.854250:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000034288381 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1870705580850688:0@lo:400: 00000100:00100000:1.0:1784043979.854277:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784043979.854294:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784043979.854299:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000789f3829 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1870705580850304:0@lo:400: 00000100:00100000:1.0:1784043979.854319:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784043979.855217:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580850432 00000100:00100000:3.0:1784043979.855226:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580850432 00000100:00100000:3.0:1784043979.855266:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580850688 00000100:00100000:3.0:1784043979.855269:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580850688 00000100:00100000:3.0:1784043979.855285:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1784043979.855291:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000045492e6e pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1870705580850432:12345-0@lo:400: 00000100:00100000:3.0:1784043979.855351:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000045492e6e pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1870705580850432:12345-0@lo:400: Request processed in 60us (1732us total) trans 0 rc 0/0 00000100:00100000:3.0:1784043979.855358:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1784043979.855372:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1784043979.855392:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009aa6163a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1870705580850688:12345-0@lo:400: 00000100:00100000:3.0:1784043979.855425:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009aa6163a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1870705580850688:12345-0@lo:400: Request processed in 35us (1148us total) trans 0 rc 0/0 00000100:00100000:3.0:1784043979.855443:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1784043979.855462:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580850304 00000100:00100000:3.0:1784043979.855465:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580850304 00000100:00100000:3.0:1784043979.855488:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1784043979.855493:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006b863310 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1870705580850304:12345-0@lo:400: 00000100:00100000:3.0:1784043979.855519:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006b863310 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1870705580850304:12345-0@lo:400: Request processed in 27us (1200us total) trans 0 rc 0/0 00000100:00100000:3.0:1784043979.855525:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1784043979.855563:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000090e6db70 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1870705580850432:0@lo:400: 00010000:00080000:1.0:1784043979.855664:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000789f3829 x1870705580850304/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784043995 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784043979.855685:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000789f3829 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1870705580850304:0@lo:400: 00000100:00100000:1.0:1784043979.855696:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000034288381 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1870705580850688:0@lo:400: 00000100:00100000:1.0:1784043979.855710:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784043979.855719:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000019726bed pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1870705580850816:0@lo:41: 00000100:00100000:1.0:1784043979.855748:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784043979.856234:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580850816 00000100:00100000:3.0:1784043979.856239:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580850816 00000100:00100000:3.0:1784043979.856271:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1784043979.856276:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003f6a3d8d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1870705580850816:12345-0@lo:41: 00000004:00000024:3.0:1784043979.856344:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:3.0:1784043979.856419:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003f6a3d8d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1870705580850816:12345-0@lo:41: Request processed in 142us (670us total) trans 0 rc 0/0 00000100:00100000:3.0:1784043979.856424:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1784043979.856788:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580850176 00000100:00100000:0.0:1784043979.856793:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580850176 00000100:00100000:0.0:1784043979.856834:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1784043979.856840:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000058ffcfb2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+16:3638:x1870705580850176:12345-0@lo:400: 00000100:00100000:0.0:1784043979.856873:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000058ffcfb2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+16:3638:x1870705580850176:12345-0@lo:400: Request processed in 34us (2647us total) trans 0 rc 0/0 00000100:00100000:0.0:1784043979.856878:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1784043979.858781:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000019726bed pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1870705580850816:0@lo:41: 00000100:00100000:1.0:1784043979.858800:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000005e1f5826 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:3638:1870705580850176:0@lo:400: 00010000:00010000:0.0:1784043980.431403:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784043981.455325:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784043982.478639:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784043983.501485:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1784043983.949276:0:6508:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1784043983.949285:0:6508:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9b396f3cf800 from 1 10000000:01000000:2.0:1784043983.949290:0:6508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1784043983.949333:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: 00000000010b95f1/0x89871fc3aba17c9f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784043983.949346:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: 00000000010b95f1/0x89871fc3aba17c9f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784043983.949357:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: 00000000010b95f1/0x89871fc3aba17c9f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784043983.949381:0:6508:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000d43a34d4 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580850944:0@lo:101: 00000100:00100000:2.0:1784043983.949464:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784043983.949578:0:6508:0:(client.c:2702:ptlrpc_set_wait()) set 000000000b850ece going to sleep for 11 seconds 00000100:00100000:3.0:1784043983.950780:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580850944 00000100:00100000:3.0:1784043983.950792:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580850944 00000100:00100000:3.0:1784043983.950854:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1784043983.950862:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000021c79fa8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+16:6508:x1870705580850944:12345-0@lo:101: 00010000:00010000:3.0:1784043983.950879:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784043983.950900:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000daadf120/0x89871fc3aba17ca6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x89871fc3aba17c9f expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043983.950938:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000daadf120/0x89871fc3aba17ca6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x89871fc3aba17c9f expref: 17 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043983.950949:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000daadf120/0x89871fc3aba17ca6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x89871fc3aba17c9f expref: 17 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043983.950971:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000daadf120, rc 0) 00000100:00100000:3.0:1784043983.951038:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000021c79fa8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+17:6508:x1870705580850944:12345-0@lo:101: Request processed in 176us (1574us total) trans 0 rc 0/0 00000100:00100000:3.0:1784043983.951045:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1784043983.951098:0:6508:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000d43a34d4 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580850944:0@lo:101: 00010000:00010000:3.0:1784043983.951115:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: 00000000010b95f1/0x89871fc3aba17c9f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba17ca6 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043983.951123:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: 00000000010b95f1/0x89871fc3aba17c9f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x89871fc3aba17ca6 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784043983.951233:0:6508:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000019726bed pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580851072:0@lo:501: 00000100:00100000:3.0:1784043983.951268:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784043983.951594:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784043983.951608:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000006996e2e1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1870705580851200:0@lo:41: 00000100:00100000:0.0:1784043983.951651:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784043983.951790:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580851200 00000100:00100000:2.0:1784043983.951795:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580851200 00000100:00100000:2.0:1784043983.951841:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1784043983.951847:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001ff4add4 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1870705580851200:12345-0@lo:41: 00000004:00000024:2.0:1784043983.951878:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:2.0:1784043983.951917:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001ff4add4 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1870705580851200:12345-0@lo:41: Request processed in 70us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1784043983.951924:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1784043983.953878:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580851072 00000100:00100000:1.0:1784043983.953893:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580851072 00000100:00100000:1.0:1784043983.954028:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1784043983.954037:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b54794f7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+17:6508:x1870705580851072:12345-0@lo:501: 00000100:00100000:1.0:1784043983.954312:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b54794f7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+17:6508:x1870705580851072:12345-0@lo:501: Request processed in 276us (3043us total) trans 0 rc 0/0 00000100:00100000:1.0:1784043983.954320:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1784043983.957103:0:6508:0:(client.c:2702:ptlrpc_set_wait()) set 00000000424e6cbd going to sleep for 11 seconds 00000100:00100000:3.0:1784043983.957166:0:6508:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000019726bed pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580851072:0@lo:501: 00000100:00100000:3.0:1784043983.957258:0:6508:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000019726bed pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580851328:0@lo:503: 00000100:00100000:3.0:1784043983.957344:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784043983.957379:0:6508:0:(client.c:2702:ptlrpc_set_wait()) set 00000000424e6cbd going to sleep for 11 seconds 00000100:00100000:3.0:1784043983.957436:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580851328 00000100:00100000:3.0:1784043983.957442:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580851328 00000100:00100000:3.0:1784043983.957507:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1784043983.957515:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000eb45ac72 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+17:6508:x1870705580851328:12345-0@lo:503: 00000100:00100000:3.0:1784043983.958095:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000eb45ac72 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+17:6508:x1870705580851328:12345-0@lo:503: Request processed in 579us (749us total) trans 0 rc 0/0 00000100:00100000:3.0:1784043983.958104:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1784043983.958225:0:6508:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000019726bed pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580851328:0@lo:503: 00000100:00100000:2.0:1784043983.958436:0:8135:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000555112de pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:8135:1870705580851456:0@lo:502: 00000100:00100000:2.0:1784043983.958480:0:8135:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784043983.958507:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580851456 00000100:00100000:2.0:1784043983.958511:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580851456 00000100:00100000:2.0:1784043983.958537:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1784043983.958556:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005c0f0db0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+17:8135:x1870705580851456:12345-0@lo:502: 00000100:00100000:2.0:1784043983.958632:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005c0f0db0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+17:8135:x1870705580851456:12345-0@lo:502: Request processed in 89us (152us total) trans 0 rc 0/0 00000100:00100000:2.0:1784043983.958638:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1784043983.958678:0:8135:0:(client.c:2702:ptlrpc_set_wait()) set 00000000f9b3e130 going to sleep for 11 seconds 00000100:00100000:2.0:1784043983.958690:0:8135:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000555112de pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:8135:1870705580851456:0@lo:502: 00000020:01000000:2.0:1784043983.958709:0:8135:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784043983.958717:0:8135:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784043983.958720:0:8135:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1784043983.958727:0:8135:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9b396f3cf800 00000020:00000080:2.0:1784043983.958729:0:8135:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1784043983.958814:0:8135:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3975b52680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:8135:1870705580851584:0@lo:502: 00000100:00100000:2.0:1784043983.958845:0:8135:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784043983.958862:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580851584 00000100:00100000:2.0:1784043983.958865:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580851584 00000100:00100000:2.0:1784043983.958889:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1784043983.958894:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3965ef8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+17:8135:x1870705580851584:12345-0@lo:502: 00000100:00100000:2.0:1784043983.958947:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3965ef8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+17:8135:x1870705580851584:12345-0@lo:502: Request processed in 51us (101us total) trans 0 rc 0/0 00000100:00100000:2.0:1784043983.958954:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1784043983.959121:0:8135:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b396f22a180 going to sleep for 11 seconds 00000100:00100000:2.0:1784043983.959229:0:8135:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3975b52680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:8135:1870705580851584:0@lo:502: 00000020:01000000:2.0:1784043983.959247:0:8135:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784043983.959252:0:8135:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784043983.959254:0:8135:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1784043983.959257:0:8135:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:2.0:1784043983.959312:0:6508:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1784043983.959346:0:6508:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1784043983.959355:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b3965d1ca00/0x89871fc3aba17c9f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba17ca6 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784043983.959365:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9b3965d1ca00/0x89871fc3aba17c9f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba17ca6 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784043983.959375:0:6508:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1784043983.959377:0:6508:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9b397418c800 from 1 10000000:01000000:2.0:1784043983.959380:0:6508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1784043983.959441:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b3965d1d400/0x89871fc3aba17cad lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784043983.959450:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9b3965d1d400/0x89871fc3aba17cad lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784043983.959460:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9b3965d1d400/0x89871fc3aba17cad lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784043983.959483:0:6508:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3975b52680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580851712:0@lo:101: 00000100:00100000:2.0:1784043983.959510:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784043983.959523:0:6508:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b396f22a180 going to sleep for 11 seconds 00000100:00100000:2.0:1784043983.959536:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580851712 00000100:00100000:2.0:1784043983.960401:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580851712 00000100:00100000:2.0:1784043983.960452:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1784043983.960460:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3965ef9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+17:6508:x1870705580851712:12345-0@lo:101: 00010000:00010000:2.0:1784043983.960472:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784043983.960487:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b3965d1c400/0x89871fc3aba17cb4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x89871fc3aba17cad expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784043983.960513:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b3965d1c400/0x89871fc3aba17cb4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x89871fc3aba17cad expref: 18 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784043983.960523:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b3965d1c400/0x89871fc3aba17cb4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x89871fc3aba17cad expref: 18 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784043983.960532:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3965d1c400, rc 0) 00000100:00100000:2.0:1784043983.962111:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3965ef9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+18:6508:x1870705580851712:12345-0@lo:101: Request processed in 1645us (2594us total) trans 0 rc 0/0 00000100:00100000:2.0:1784043983.962123:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1784043983.962265:0:6508:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3975b52680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580851712:0@lo:101: 00010000:00010000:2.0:1784043983.962286:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9b3965d1d400/0x89871fc3aba17cad lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba17cb4 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784043983.962298:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9b3965d1d400/0x89871fc3aba17cad lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x89871fc3aba17cb4 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784043983.962381:0:6508:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3975b52680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580851840:0@lo:501: 00000100:00100000:2.0:1784043983.962427:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784043983.962447:0:6508:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b396f22a180 going to sleep for 11 seconds 00000100:00100000:3.0:1784043983.963538:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580851840 00000100:00100000:3.0:1784043983.963557:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580851840 00000100:00100000:3.0:1784043983.963613:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1784043983.963623:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3965ef8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+18:6508:x1870705580851840:12345-0@lo:501: 00000100:00100000:3.0:1784043983.963777:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3965ef8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+18:6508:x1870705580851840:12345-0@lo:501: Request processed in 155us (1349us total) trans 0 rc 0/0 00000100:00100000:3.0:1784043983.963786:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1784043983.963844:0:6508:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3975b52680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580851840:0@lo:501: 00000100:00100000:3.0:1784043983.963892:0:6508:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39459b4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580851968:0@lo:503: 00000100:00100000:3.0:1784043983.963940:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784043983.964658:0:6508:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3947487d80 going to sleep for 11 seconds 00000100:00100000:3.0:1784043983.964688:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580851968 00000100:00100000:3.0:1784043983.964694:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580851968 00000100:00100000:3.0:1784043983.964736:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1784043983.964743:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3965efa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+18:6508:x1870705580851968:12345-0@lo:503: 00000100:00100000:3.0:1784043983.964848:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3965efa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+18:6508:x1870705580851968:12345-0@lo:503: Request processed in 105us (907us total) trans 0 rc 0/0 00000100:00100000:3.0:1784043983.964855:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1784043983.964904:0:6508:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39459b4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580851968:0@lo:503: 00000100:00100000:0.0:1784043983.968067:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3975b50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1870705580851200:0@lo:41: 00000100:00100000:2.0:1784043983.969168:0:8136:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3975b51c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:8136:1870705580852096:0@lo:502: 00000100:00100000:2.0:1784043983.969279:0:8136:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784043983.969321:0:8136:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b396f22a0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784043983.969423:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580852096 00000100:00100000:3.0:1784043983.969430:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580852096 00000100:00100000:3.0:1784043983.969496:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1784043983.969506:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3965ef8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+18:8136:x1870705580852096:12345-0@lo:502: 00000100:00100000:3.0:1784043983.970658:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3965ef8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+18:8136:x1870705580852096:12345-0@lo:502: Request processed in 1149us (1374us total) trans 0 rc 0/0 00000100:00100000:3.0:1784043983.970669:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1784043983.980525:0:8136:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3975b51c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:8136:1870705580852096:0@lo:502: 00000020:01000000:1.0:1784043983.980632:0:8136:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1784043983.980648:0:8136:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784043983.980725:0:8136:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1784043983.980734:0:8136:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9b397418c800 00000020:00000080:1.0:1784043983.980738:0:8136:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1784043983.980785:0:8136:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397a8a7100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:8136:1870705580852224:0@lo:502: 00000100:00100000:1.0:1784043983.980875:0:8136:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784043983.980988:0:8136:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3942ab0e40 going to sleep for 11 seconds 00000100:00100000:2.0:1784043983.981912:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580852224 00000100:00100000:2.0:1784043983.981921:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580852224 00000100:00100000:2.0:1784043983.981991:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1784043983.982001:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3965efb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+18:8136:x1870705580852224:12345-0@lo:502: 00000100:00100000:2.0:1784043983.982150:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3965efb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+18:8136:x1870705580852224:12345-0@lo:502: Request processed in 150us (1275us total) trans 0 rc 0/0 00000100:00100000:2.0:1784043983.982158:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1784043983.982411:0:8136:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397a8a7100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:8136:1870705580852224:0@lo:502: 00000020:01000000:1.0:1784043983.982442:0:8136:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784043983.982448:0:8136:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784043983.982450:0:8136:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1784043983.982454:0:8136:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:0.0:1784043983.982640:0:6508:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1784043983.982661:0:6508:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1784043983.982671:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b3965d1d400/0x89871fc3aba17cad lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba17cb4 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784043983.982684:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9b3965d1d400/0x89871fc3aba17cad lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba17cb4 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784043984.526382:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784043984.981629:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3975b50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1870705580852480:0@lo:400: 00000100:00100000:2.0:1784043984.981705:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784043984.981769:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784043984.981776:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3975b53480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1870705580852608:0@lo:400: 00000100:00100000:2.0:1784043984.981802:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784043984.981929:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3975b52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:3641:1870705580852352:0@lo:400: 00000100:00100000:0.0:1784043984.981963:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784043984.981988:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3975b53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1870705580852864:0@lo:400: 00000100:00100000:0.0:1784043984.982010:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784043984.982031:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784043984.982036:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3975b52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3641:1870705580852736:0@lo:400: 00000100:00100000:0.0:1784043984.982060:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784043984.982117:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580852480 00000100:00100000:2.0:1784043984.982125:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580852480 00000100:00100000:2.0:1784043984.982199:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580852736 00000100:00100000:2.0:1784043984.982203:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580852736 00000100:00100000:2.0:1784043984.982221:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1784043984.982229:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3975b51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1870705580852480:12345-0@lo:400: 00000100:00100000:2.0:1784043984.982284:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3975b51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1870705580852480:12345-0@lo:400: Request processed in 55us (579us total) trans 0 rc 0/0 00000100:00100000:2.0:1784043984.982303:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1784043984.982320:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1784043984.982327:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39503bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1870705580852736:12345-0@lo:400: 00000100:00100000:2.0:1784043984.982361:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39503bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1870705580852736:12345-0@lo:400: Request processed in 34us (300us total) trans 0 rc 0/0 00000100:00100000:2.0:1784043984.982367:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1784043984.982398:0:7768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580852608 00000100:00100000:2.0:1784043984.982402:0:7768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580852608 00000100:00100000:2.0:1784043984.982426:0:7768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580852864 00000100:00100000:2.0:1784043984.982429:0:7768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580852864 00000100:00100000:2.0:1784043984.982442:0:7768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1784043984.982448:0:7768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3975b50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1870705580852608:12345-0@lo:400: 00000100:00100000:2.0:1784043984.982480:0:7768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3975b50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1870705580852608:12345-0@lo:400: Request processed in 32us (677us total) trans 0 rc 0/0 00000100:00100000:2.0:1784043984.982487:0:7768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1784043984.982499:0:7768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1784043984.982506:0:7768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39503bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1870705580852864:12345-0@lo:400: 00000100:00100000:2.0:1784043984.982532:0:7768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39503bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1870705580852864:12345-0@lo:400: Request processed in 27us (521us total) trans 0 rc 0/0 00000100:00100000:2.0:1784043984.982538:0:7768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:2.0:1784043984.982575:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b3975b52300 x1870705580852736/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044000 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784043984.982588:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3975b52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3641:1870705580852736:0@lo:400: 00000100:00100000:2.0:1784043984.982599:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3975b53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1870705580852864:0@lo:400: 00000100:00100000:2.0:1784043984.982630:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3975b53480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1870705580852608:0@lo:400: 00010000:00080000:2.0:1784043984.982651:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b3975b50e00 x1870705580852480/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044000 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784043984.982660:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3975b50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1870705580852480:0@lo:400: 00000100:00100000:3.0:1784043984.982888:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580852352 00000100:00100000:3.0:1784043984.982894:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580852352 00000100:00100000:3.0:1784043984.982924:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1784043984.982931:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3965ef9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+18:3641:x1870705580852352:12345-0@lo:400: 00000100:00100000:3.0:1784043984.982969:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3965ef9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+18:3641:x1870705580852352:12345-0@lo:400: Request processed in 38us (1004us total) trans 0 rc 0/0 00000100:00100000:3.0:1784043984.982976:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1784043984.983122:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3975b52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:3641:1870705580852352:0@lo:400: 00000100:00100000:0.0:1784043984.984276:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39459b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1870705580852992:0@lo:41: 00000100:00100000:0.0:1784043984.984321:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784043984.985073:0:7768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580852992 00000100:00100000:2.0:1784043984.985080:0:7768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580852992 00000100:00100000:2.0:1784043984.985137:0:7768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1784043984.985146:0:7768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39503bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1870705580852992:12345-0@lo:41: 00000004:00000024:2.0:1784043984.985199:0:7768:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:2.0:1784043984.988612:0:7768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39503bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1870705580852992:12345-0@lo:41: Request processed in 3455us (4279us total) trans 0 rc 0/0 00000100:00100000:2.0:1784043984.988627:0:7768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1784043984.989994:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39459b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1870705580852992:0@lo:41: 00010000:00010000:2.0:1784043985.551538:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784043986.573516:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784043987.597333:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784043988.621310:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784043989.079214:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3975b50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1870705580853120:0@lo:41: 00000100:00100000:2.0:1784043989.079288:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784043989.079371:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580853120 00000100:00100000:2.0:1784043989.079433:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580853120 00000100:00100000:2.0:1784043989.079484:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1784043989.079493:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3975b53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1870705580853120:12345-0@lo:41: 00000004:00000024:2.0:1784043989.079526:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:2.0:1784043989.079570:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3975b53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1870705580853120:12345-0@lo:41: Request processed in 78us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1784043989.079577:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1784043989.079622:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3975b50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1870705580853120:0@lo:41: 00010000:00010000:1.0:1784043989.645366:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1784043989.654867:0:8419:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1784043989.654871:0:8419:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:2.0:1784043989.654872:0:8419:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:2.0:1784043989.655047:0:8419:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9b3975aa3000 00000020:01000004:2.0:1784043989.655063:0:8419:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1784043989.655075:0:8419:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1784043989.655089:0:8419:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9b3944028000) 00000020:00000080:2.0:1784043989.655108:0:8419:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1784043989.693057:0:8419:0:(scrub.c:229:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:3.0:1784043989.693121:0:8419:0:(scrub.c:229:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00080000:01000000:3.0:1784043989.734212:0:8419:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1784043989.734480:0:8419:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1784043989.734491:0:8419:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:3.0:1784043989.734503:0:8419:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x89871fc3aba17cc2 00000020:01000004:3.0:1784043989.734510:0:8419:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:3.0:1784043989.734929:0:8419:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.140@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1784043989.734934:0:8419:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.140@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1784043989.734941:0:8419:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1784043989.734947:0:8419:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1784043989.734959:0:8419:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9b3974250000) 00000020:00000080:3.0:1784043989.734971:0:8419:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type ost with refcount 2 00000100:00100000:3.0:1784043989.736969:0:8419:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1784043989.737205:0:8419:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1784043989.737224:0:8419:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:0.0:1784043989.739231:0:8419:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:0.0:1784043989.739241:0:8419:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:1.0:1784043989.741219:0:8419:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:1.0:1784043989.741230:0:8419:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:1.0:1784043989.744817:0:8419:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1784043989.744983:0:8419:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:1.0:1784043989.744989:0:8419:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:0.0:1784043989.749453:0:8419:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:0.0:1784043989.749465:0:8419:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:1.0:1784043989.774056:0:8419:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1784043989.774624:0:8419:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1784043989.774633:0:8419:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:1.0:1784043989.775653:0:8419:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1784043989.775663:0:8419:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:1.0:1784043989.777053:0:8419:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1784043989.777064:0:8419:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:1.0:1784043989.779783:0:8419:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1784043989.779911:0:8419:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:1.0:1784043989.779915:0:8419:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:1.0:1784043989.781801:0:8419:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:1.0:1784043989.781813:0:8419:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:0.0:1784043989.849525:0:8419:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1784043989.849730:0:8419:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:0.0:1784043989.849738:0:8419:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:0.0:1784043989.851465:0:8419:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:0.0:1784043989.851476:0:8419:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:1.0:1784043989.852140:0:8419:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:1.0:1784043989.852170:0:8419:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:1.0:1784043989.852208:0:8419:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.140@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1784043989.900624:0:8419:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.140@tcp ctxt 0 is initialized 00000020:01000004:2.0:1784043989.900655:0:8419:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.202.140@tcp, index=0000, flags=0x20062 00000020:01000004:2.0:1784043989.900658:0:8419:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1784043989.900660:0:8419:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1784043989.900661:0:8419:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784043989.900661:0:8419:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784043989.900662:0:8419:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784043989.900663:0:8419:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784043989.900664:0:8419:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1784043989.900665:0:8419:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1784043989.900666:0:8419:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1784043989.900667:0:8419:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784043989.900668:0:8419:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1784043989.900671:0:8419:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:2.0:1784043989.900673:0:8419:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1784043989.900674:0:8419:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1784043989.900674:0:8419:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784043989.900675:0:8419:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784043989.900675:0:8419:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784043989.900676:0:8419:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784043989.900677:0:8419:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1784043989.900677:0:8419:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1784043989.900678:0:8419:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1784043989.900679:0:8419:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784043989.900679:0:8419:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1784043989.900701:0:8419:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1784043989.900719:0:8419:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3975b50e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:8419:1870705580853248:0@lo:253: 00000100:00100000:2.0:1784043989.900808:0:8419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784043989.900866:0:8419:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3975915000 going to sleep for 11 seconds 00000100:00100000:3.0:1784043989.902389:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580853248 00000100:00100000:3.0:1784043989.902399:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580853248 00000100:00100000:3.0:1784043989.902463:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1784043989.902473:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3965efb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+18:8419:x1870705580853248:12345-0@lo:253: 20000000:01000000:3.0:1784043989.902507:0:6505:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1784043989.902511:0:6505:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:3.0:1784043989.902516:0:6505:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:3.0:1784043989.902519:0:6505:0:(mgs_llog.c:3858:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:3.0:1784043989.902744:0:6505:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1784043989.902874:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:3.0:1784043989.902886:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:3.0:1784043989.902901:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:3.0:1784043989.902906:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:3.0:1784043989.902917:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:3.0:1784043989.902928:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:3.0:1784043989.903005:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:2.0:1784043989.904101:0:6505:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.202.140@tcp 20000000:01000000:2.0:1784043989.904105:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.140@tcp (null) (null) (null) 00000040:00080000:2.0:1784043989.904155:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:2.0:1784043989.904198:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1784043989.904216:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:2.0:1784043989.904222:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.202.140@tcp (null) (null) 00000040:00080000:2.0:1784043989.904244:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:2.0:1784043989.904251:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:2.0:1784043989.904262:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:2.0:1784043989.904276:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:2.0:1784043989.904383:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].25, 224 off12680 20000000:01000000:2.0:1784043989.904396:0:6505:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.202.140@tcp 20000000:01000000:2.0:1784043989.904397:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.140@tcp (null) (null) (null) 00000040:00080000:2.0:1784043989.904412:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].26, 88 off12768 20000000:01000000:2.0:1784043989.904417:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1784043989.904429:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].27, 144 off12912 20000000:01000000:2.0:1784043989.904433:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf003 lustre-OST0000_UUID 192.168.202.140@tcp (null) (null) 00000040:00080000:2.0:1784043989.904445:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].28, 152 off13064 20000000:01000000:2.0:1784043989.904451:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:2.0:1784043989.904463:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].29, 136 off13200 00000040:00080000:2.0:1784043989.904478:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].30, 224 off13424 00000040:00080000:2.0:1784043989.904839:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13448 20000000:01000000:2.0:1784043989.904851:0:6505:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.202.140@tcp 20000000:01000000:2.0:1784043989.904852:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.140@tcp (null) (null) (null) 00000040:00080000:2.0:1784043989.904864:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13536 20000000:01000000:2.0:1784043989.904869:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1784043989.904900:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13664 20000000:01000000:2.0:1784043989.904907:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.202.140@tcp (null) (null) 00000040:00080000:2.0:1784043989.904919:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13808 20000000:01000000:2.0:1784043989.904924:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:2.0:1784043989.904936:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13936 00000040:00080000:2.0:1784043989.904950:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14160 20000000:01000000:2.0:1784043989.904962:0:6505:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:2.0:1784043989.904970:0:6505:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1784043989.904973:0:6505:0:(mgs_llog.c:4177:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1784043989.905025:0:6505:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1784043989.905028:0:6505:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1784043989.906924:0:8438:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 18 1->4: lustre sys.timeout 20000000:01000000:3.0:1784043989.906985:0:8438:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 18 2->4: lustre sys.timeout 00000040:00080000:3.0:1784043989.907003:0:8438:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:2.0:1784043989.907476:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:2.0:1784043989.907499:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:2.0:1784043989.907515:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:2.0:1784043989.907525:0:6505:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1784043989.907528:0:6505:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:1.0:1784043989.917620:0:8439:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:2.0:1784043989.918129:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:2.0:1784043989.918289:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:2.0:1784043989.918309:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:2.0:1784043989.918323:0:6505:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:2.0:1784043989.918326:0:6505:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:1.0:1784043989.925368:0:8440:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 19 1->4: lustre sys.timeout 20000000:01000000:1.0:1784043989.925431:0:8440:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 19 2->4: lustre sys.timeout 00000040:00080000:1.0:1784043989.925631:0:8440:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 31 count 31 00000040:00080000:2.0:1784043989.931120:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].31, 224 off13648 00000040:00080000:2.0:1784043989.931168:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].32, 80 off13728 00000040:00080000:2.0:1784043989.931211:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].33, 224 off13952 20000000:01000000:2.0:1784043989.931221:0:6505:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1784043989.931224:0:6505:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:2.0:1784043989.931809:0:8441:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 20 1->4: lustre sys.timeout 20000000:01000000:2.0:1784043989.931832:0:8441:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 20 2->4: lustre sys.timeout 00000040:00080000:2.0:1784043989.931847:0:8441:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:1.0:1784043989.932099:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14384 00000040:00080000:1.0:1784043989.932122:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14464 00000040:00080000:1.0:1784043989.932137:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14688 10000000:01000000:1.0:1784043989.932152:0:6505:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1784043989.932198:0:6505:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b394166aa00/0x89871fc3aba17cd0 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784043989.932218:0:6505:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b394166b600/0x89871fc3aba17b9c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x89871fc3aba17b95 expref: 18 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784043989.932226:0:6505:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b39586ef800/0x89871fc3aba17c13 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x89871fc3aba17c0c expref: 18 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784043989.932233:0:6505:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b39586eea00/0x89871fc3aba17c4b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x89871fc3aba17c44 expref: 18 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784043989.932239:0:6505:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b39759f8800/0x89871fc3aba17c67 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x89871fc3aba17c60 expref: 18 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784043989.932258:0:6505:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b39759f8000/0x89871fc3aba17c91 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x89871fc3aba17c8a expref: 18 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784043989.932266:0:6505:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b394166aa00/0x89871fc3aba17cd0 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784043989.932308:0:6505:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b39759f8000/0x89871fc3aba17c91 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x89871fc3aba17c8a expref: 18 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784043989.932321:0:6505:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b39759f8000/0x89871fc3aba17c91 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x89871fc3aba17c8a expref: 18 pid: 6505 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784043989.932346:0:6505:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397a8a7100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6505:1870705580853376:0@lo:104: 00000100:00100000:1.0:1784043989.932422:0:6505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1784043989.932487:0:6505:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b39759f8800/0x89871fc3aba17c67 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x89871fc3aba17c60 expref: 18 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784043989.932496:0:6505:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b39759f8800/0x89871fc3aba17c67 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x89871fc3aba17c60 expref: 18 pid: 6505 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784043989.932505:0:6505:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397a8a6680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6505:1870705580853504:0@lo:104: 00000100:00100000:1.0:1784043989.932540:0:6505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1784043989.932566:0:6505:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b39586eea00/0x89871fc3aba17c4b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x89871fc3aba17c44 expref: 18 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784043989.932574:0:6505:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b39586eea00/0x89871fc3aba17c4b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x89871fc3aba17c44 expref: 18 pid: 6506 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784043989.932582:0:6505:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397a8a6a00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6505:1870705580853632:0@lo:104: 00000100:00100000:3.0:1784043989.932590:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580853376 00000100:00100000:3.0:1784043989.932596:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580853376 00000100:00100000:1.0:1784043989.932610:0:6505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784043989.932632:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580853504 00000100:00100000:3.0:1784043989.932634:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580853504 00010000:00010000:1.0:1784043989.932636:0:6505:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b39586ef800/0x89871fc3aba17c13 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x89871fc3aba17c0c expref: 18 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784043989.932644:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580853632 00000100:00100000:3.0:1784043989.932645:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580853632 00010000:00010000:1.0:1784043989.932645:0:6505:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b39586ef800/0x89871fc3aba17c13 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x89871fc3aba17c0c expref: 18 pid: 6506 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784043989.932653:0:6505:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397a8a4000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6505:1870705580853760:0@lo:104: 00000100:00100000:3.0:1784043989.932657:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1784043989.932664:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397a8a4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+5:6505:x1870705580853376:12345-0@lo:104: 00000100:00100000:1.0:1784043989.932673:0:6505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1784043989.932675:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.140@tcp lock: ffff9b3965d1dc00/0x89871fc3aba17c8a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x89871fc3aba17c91 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784043989.932687:0:6505:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b394166b600/0x89871fc3aba17b9c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x89871fc3aba17b95 expref: 18 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784043989.932693:0:6505:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b394166b600/0x89871fc3aba17b9c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x89871fc3aba17b95 expref: 18 pid: 6506 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043989.932720:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1784043989.932726:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397a8a4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+5:6505:x1870705580853376:12345-0@lo:104: Request processed in 62us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1784043989.932741:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1784043989.932755:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580853760 00000100:00100000:3.0:1784043989.932758:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580853760 00000100:00100000:3.0:1784043989.932771:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1784043989.932775:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397a8a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+5:6505:x1870705580853504:12345-0@lo:104: 00010000:00010000:3.0:1784043989.932782:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.140@tcp lock: ffff9b39759f9200/0x89871fc3aba17c60 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x89871fc3aba17c67 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043989.932813:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1784043989.932818:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397a8a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+5:6505:x1870705580853504:12345-0@lo:104: Request processed in 43us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1784043989.932825:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1784043989.932838:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1784043989.932843:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397a8a7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+4:6505:x1870705580853632:12345-0@lo:104: 00010000:00010000:3.0:1784043989.932850:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.140@tcp lock: ffff9b39586ee000/0x89871fc3aba17c44 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x89871fc3aba17c4b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043989.932873:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1784043989.932878:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397a8a7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+4:6505:x1870705580853632:12345-0@lo:104: Request processed in 35us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1784043989.932882:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1784043989.932894:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1784043989.932899:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397a8a6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+3:6505:x1870705580853760:12345-0@lo:104: 00010000:00010000:3.0:1784043989.932905:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.140@tcp lock: ffff9b394166b800/0x89871fc3aba17c0c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x89871fc3aba17c13 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043989.932927:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:3.0:1784043989.932937:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397a8a6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+3:6505:x1870705580853760:12345-0@lo:104: Request processed in 38us (262us total) trans 0 rc 0/0 00000100:00100000:3.0:1784043989.932943:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:3.0:1784043989.932961:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1784043989.932966:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: ffff9b3965d1dc00/0x89871fc3aba17c8a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x89871fc3aba17c91 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043989.932973:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3965d1dc00 already unused, calling callback (ffffffffc113cc20) 10000000:00010000:3.0:1784043989.932976:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: ffff9b3965d1dc00/0x89871fc3aba17c8a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x89871fc3aba17c91 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043989.932983:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9b3965d1dc00/0x89871fc3aba17c8a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x89871fc3aba17c91 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784043989.932990:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9b3965d1dc00/0x89871fc3aba17c8a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x89871fc3aba17c91 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784043989.932995:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1784043989.933021:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.140@tcp lock: ffff9b3965d1dc00/0x89871fc3aba17c8a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x89871fc3aba17c91 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784043989.933021:0:6505:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397a8a4a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6505:1870705580853888:0@lo:104: 00010000:00010000:3.0:1784043989.933027:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1784043989.933043:0:6505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1784043989.933045:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: ffff9b3965d1dc00/0x89871fc3aba17c8a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x89871fc3aba17c91 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043989.933052:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9b3965d1dc00/0x89871fc3aba17c8a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x89871fc3aba17c91 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784043989.933057:0:6505:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3950d62840 going to sleep for 11 seconds 00010000:00010000:3.0:1784043989.933064:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1784043989.933066:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: ffff9b39759f9200/0x89871fc3aba17c60 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x89871fc3aba17c67 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784043989.933074:0:6505:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397a8a7100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6505:1870705580853376:0@lo:104: 00000100:00100000:1.0:1784043989.933081:0:6505:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397a8a6680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6505:1870705580853504:0@lo:104: 00010000:00010000:3.0:1784043989.933082:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b39759f9200 already unused, calling callback (ffffffffc113cc20) 10000000:00010000:3.0:1784043989.933085:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: ffff9b39759f9200/0x89871fc3aba17c60 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x89871fc3aba17c67 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784043989.933087:0:6505:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397a8a6a00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6505:1870705580853632:0@lo:104: 00010000:00010000:3.0:1784043989.933092:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9b39759f9200/0x89871fc3aba17c60 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x89871fc3aba17c67 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784043989.933093:0:6505:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397a8a4000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6505:1870705580853760:0@lo:104: 10000000:00010000:3.0:1784043989.933099:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9b39759f9200/0x89871fc3aba17c60 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x89871fc3aba17c67 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784043989.933104:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1784043989.933130:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.140@tcp lock: ffff9b39759f9200/0x89871fc3aba17c60 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x89871fc3aba17c67 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043989.933136:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784043989.933141:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: ffff9b39759f9200/0x89871fc3aba17c60 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x89871fc3aba17c67 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043989.933147:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9b39759f9200/0x89871fc3aba17c60 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x89871fc3aba17c67 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043989.933157:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1784043989.933159:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: ffff9b39586ee000/0x89871fc3aba17c44 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x89871fc3aba17c4b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043989.933164:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b39586ee000 already unused, calling callback (ffffffffc113cc20) 10000000:00010000:3.0:1784043989.933167:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: ffff9b39586ee000/0x89871fc3aba17c44 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x89871fc3aba17c4b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043989.933221:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9b39586ee000/0x89871fc3aba17c44 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x89871fc3aba17c4b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784043989.933413:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9b39586ee000/0x89871fc3aba17c44 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x89871fc3aba17c4b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784043989.933419:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1784043989.933434:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.140@tcp lock: ffff9b39586ee000/0x89871fc3aba17c44 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x89871fc3aba17c4b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043989.933440:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784043989.933457:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: ffff9b39586ee000/0x89871fc3aba17c44 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x89871fc3aba17c4b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043989.933464:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9b39586ee000/0x89871fc3aba17c44 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x89871fc3aba17c4b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043989.933475:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784043989.933478:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: ffff9b394166b800/0x89871fc3aba17c0c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x89871fc3aba17c13 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043989.933484:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b394166b800 already unused, calling callback (ffffffffc113cc20) 10000000:00010000:3.0:1784043989.933486:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: ffff9b394166b800/0x89871fc3aba17c0c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x89871fc3aba17c13 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043989.933505:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9b394166b800/0x89871fc3aba17c0c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x89871fc3aba17c13 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784043989.933511:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9b394166b800/0x89871fc3aba17c0c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x89871fc3aba17c13 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784043989.933522:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1784043989.933536:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.140@tcp lock: ffff9b394166b800/0x89871fc3aba17c0c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x89871fc3aba17c13 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043989.933542:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784043989.933548:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: ffff9b394166b800/0x89871fc3aba17c0c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x89871fc3aba17c13 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043989.933554:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9b394166b800/0x89871fc3aba17c0c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x89871fc3aba17c13 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043989.933621:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784043989.933623:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784043989.933625:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784043989.933632:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784043989.933643:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39459b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:3640:1870705580854016:0@lo:103: 00000100:00100000:3.0:1784043989.933672:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784043989.933702:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784043989.933709:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39459b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:3640:1870705580854144:0@lo:103: 00000100:00100000:3.0:1784043989.933741:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784043989.933771:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39459b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:3638:1870705580854272:0@lo:103: 00000100:00100000:3.0:1784043989.933793:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784043989.933810:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784043989.933815:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39459b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:3638:1870705580854400:0@lo:103: 00000100:00100000:3.0:1784043989.933834:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784043989.933862:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580854016 00000100:00100000:3.0:1784043989.933866:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580854016 00010000:00010000:3.0:1784043989.933890:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b39759f8000/0x89871fc3aba17c91 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x89871fc3aba17c8a expref: 19 pid: 6505 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784043989.933905:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580854144 00000100:00100000:3.0:1784043989.933908:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580854144 00010000:00010000:3.0:1784043989.933917:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b39759f8800/0x89871fc3aba17c67 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x89871fc3aba17c60 expref: 20 pid: 6505 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784043989.933925:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580854272 00000100:00100000:3.0:1784043989.933927:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580854272 00010000:00010000:3.0:1784043989.933935:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b39586eea00/0x89871fc3aba17c4b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x89871fc3aba17c44 expref: 21 pid: 6506 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784043989.933943:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580854400 00000100:00100000:3.0:1784043989.933946:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580854400 00010000:00010000:3.0:1784043989.933954:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b39586ef800/0x89871fc3aba17c13 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x89871fc3aba17c0c expref: 22 pid: 6506 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784043989.933965:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1784043989.933971:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39459b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+22:3640:x1870705580854016:12345-0@lo:103: 00010000:00010000:3.0:1784043989.933980:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784043989.933985:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b39759f8000/0x89871fc3aba17c91 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x89871fc3aba17c8a expref: 22 pid: 6505 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043989.933994:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b39759f8000/0x89871fc3aba17c91 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x89871fc3aba17c8a expref: 22 pid: 6505 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043989.934007:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b39759f8000/0x89871fc3aba17c91 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x89871fc3aba17c8a expref: 22 pid: 6505 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043989.934019:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 10000000:01000000:0.0:1784043989.934202:0:6508:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1784043989.934206:0:6508:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9b396f3cf800 from 30 10000000:01000000:0.0:1784043989.934209:0:6508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1784043989.934232:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b3982055000/0x89871fc3aba17cd7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784043989.934241:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9b3982055000/0x89871fc3aba17cd7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784043989.934249:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9b3982055000/0x89871fc3aba17cd7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784043989.934262:0:6508:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39503bc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580854528:0@lo:101: 00000100:00100000:0.0:1784043989.934292:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784043989.934312:0:6508:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3970fc3d80 going to sleep for 11 seconds 00000100:00100000:0.0:1784043989.934326:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580854528 00000100:00100000:0.0:1784043989.934330:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580854528 00000100:00100000:2.0:1784043989.934630:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580853888 00000100:00100000:2.0:1784043989.934635:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580853888 00000100:00100000:2.0:1784043989.934659:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1784043989.934665:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397a8a5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+3:6505:x1870705580853888:12345-0@lo:104: 00010000:00010000:2.0:1784043989.934674:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.140@tcp lock: ffff9b39586efe00/0x89871fc3aba17b95 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x89871fc3aba17b9c expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784043989.934730:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1784043989.934736:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397a8a5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+3:6505:x1870705580853888:12345-0@lo:104: Request processed in 71us (1691us total) trans 0 rc 0/0 00000100:00100000:2.0:1784043989.934752:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1784043989.934925:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1784043989.934933:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3965efa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+22:6508:x1870705580854528:12345-0@lo:101: 00010000:00010000:0.0:1784043989.934945:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784043989.934955:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b3982054800/0x89871fc3aba17cde lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x89871fc3aba17cd7 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784043989.934972:0:6506:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b394166aa00/0x89871fc3aba17cd0 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784043989.935000:0:6506:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b3982054800/0x89871fc3aba17cde lrc: 4/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x89871fc3aba17cd7 expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784043989.935015:0:6506:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: MGS lock: ffff9b394166aa00/0x89871fc3aba17cd0 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40210400000020 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784043989.935028:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b3982054800/0x89871fc3aba17cde lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x89871fc3aba17cd7 expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784043989.935036:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3982054800, rc 0) 00000100:00100000:0.0:1784043989.935068:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3965efa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+23:6508:x1870705580854528:12345-0@lo:101: Request processed in 137us (775us total) trans 0 rc 0/0 00000100:00100000:0.0:1784043989.935075:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1784043989.935114:0:6508:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39503bc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580854528:0@lo:101: 00010000:00010000:0.0:1784043989.935128:0:6508:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGC192.168.202.140@tcp lock: ffff9b3982055000/0x89871fc3aba17cd7 lrc: 4/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba17cde expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784043989.935136:0:6508:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGC192.168.202.140@tcp lock: ffff9b3982055000/0x89871fc3aba17cd7 lrc: 4/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x89871fc3aba17cde expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784043989.935304:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39459b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+22:3640:x1870705580854016:12345-0@lo:103: Request processed in 1332us (1630us total) trans 0 rc 0/0 00000100:00100000:3.0:1784043989.935318:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1784043989.935345:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1784043989.935354:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38420aa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+21:3640:x1870705580854144:12345-0@lo:103: 00010000:00010000:3.0:1784043989.935363:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784043989.935368:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b39759f8800/0x89871fc3aba17c67 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x89871fc3aba17c60 expref: 21 pid: 6505 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043989.935378:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b39759f8800/0x89871fc3aba17c67 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x89871fc3aba17c60 expref: 21 pid: 6505 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043989.935390:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b39759f8800/0x89871fc3aba17c67 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x89871fc3aba17c60 expref: 21 pid: 6505 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043989.935400:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784043989.935425:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38420aa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+20:3640:x1870705580854144:12345-0@lo:103: Request processed in 73us (1684us total) trans 0 rc 0/0 00000100:00100000:3.0:1784043989.935431:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1784043989.935444:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1784043989.935450:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38420abb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+19:3638:x1870705580854272:12345-0@lo:103: 00010000:00010000:3.0:1784043989.935457:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784043989.935462:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b39586eea00/0x89871fc3aba17c4b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x89871fc3aba17c44 expref: 19 pid: 6506 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043989.935469:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b39586eea00/0x89871fc3aba17c4b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x89871fc3aba17c44 expref: 19 pid: 6506 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043989.935478:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b39586eea00/0x89871fc3aba17c4b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x89871fc3aba17c44 expref: 19 pid: 6506 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043989.935768:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784043989.935809:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38420abb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+18:3638:x1870705580854272:12345-0@lo:103: Request processed in 359us (2014us total) trans 0 rc 0/0 00000100:00100000:3.0:1784043989.935816:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1784043989.935831:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1784043989.935837:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38420a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+17:3638:x1870705580854400:12345-0@lo:103: 00010000:00010000:3.0:1784043989.935844:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784043989.935848:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b39586ef800/0x89871fc3aba17c13 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x89871fc3aba17c0c expref: 17 pid: 6506 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043989.935857:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b39586ef800/0x89871fc3aba17c13 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x89871fc3aba17c0c expref: 17 pid: 6506 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043989.935867:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b39586ef800/0x89871fc3aba17c13 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x89871fc3aba17c0c expref: 17 pid: 6506 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043989.935875:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784043989.935895:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38420a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+16:3638:x1870705580854400:12345-0@lo:103: Request processed in 59us (2061us total) trans 0 rc 0/0 00000100:00100000:3.0:1784043989.935902:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:3.0:1784043989.935930:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784043989.935936:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: ffff9b39586efe00/0x89871fc3aba17b95 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x89871fc3aba17b9c expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043989.935943:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b39586efe00 already unused, calling callback (ffffffffc113cc20) 10000000:00010000:3.0:1784043989.935947:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: ffff9b39586efe00/0x89871fc3aba17b95 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x89871fc3aba17b9c expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043989.935965:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9b39586efe00/0x89871fc3aba17b95 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x89871fc3aba17b9c expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784043989.935972:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9b39586efe00/0x89871fc3aba17b95 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x89871fc3aba17b9c expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784043989.935977:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1784043989.935997:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.140@tcp lock: ffff9b39586efe00/0x89871fc3aba17b95 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x89871fc3aba17b9c expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043989.936003:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784043989.936015:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: ffff9b39586efe00/0x89871fc3aba17b95 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x89871fc3aba17b9c expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043989.936022:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9b39586efe00/0x89871fc3aba17b95 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x89871fc3aba17b9c expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043989.936032:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784043989.936034:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784043989.936035:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784043989.936093:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784043989.936106:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b38420a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:3641:1870705580854656:0@lo:103: 00000100:00100000:0.0:1784043989.936150:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784043989.936224:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39459b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:3638:1870705580854400:0@lo:103: 00000100:00100000:2.0:1784043989.936234:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39459b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:3638:1870705580854272:0@lo:103: 00000100:00100000:2.0:1784043989.937318:0:6505:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397a8a4a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6505:1870705580853888:0@lo:104: 00010000:00010000:2.0:1784043989.937366:0:6505:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b394166aa00/0x89871fc3aba17cd0 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000020 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784043989.937423:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580854656 00000100:00100000:3.0:1784043989.937430:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580854656 00010000:00010000:3.0:1784043989.937462:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b394166b600/0x89871fc3aba17b9c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x89871fc3aba17b95 expref: 16 pid: 6506 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784043989.937496:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1784043989.937504:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3944090850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+16:3641:x1870705580854656:12345-0@lo:103: 00010000:00010000:3.0:1784043989.937514:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784043989.937518:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b394166b600/0x89871fc3aba17b9c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x89871fc3aba17b95 expref: 16 pid: 6506 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043989.937539:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b394166b600/0x89871fc3aba17b9c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x89871fc3aba17b95 expref: 16 pid: 6506 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043989.937552:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b394166b600/0x89871fc3aba17b9c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x89871fc3aba17b95 expref: 16 pid: 6506 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043989.937567:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b394166aa00/0x89871fc3aba17cd0 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40290400000020 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043989.937575:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b394166aa00/0x89871fc3aba17cd0 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40290400000020 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043989.937590:0:6498:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b394166aa00/0x89871fc3aba17cd0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000020 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043989.937597:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b394166aa00/0x89871fc3aba17cd0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000020 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043989.937603:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b394166aa00/0x89871fc3aba17cd0 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000020 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043989.937610:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b394166aa00/0x89871fc3aba17cd0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000020 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043989.937615:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b394166aa00 already unused, calling callback (ffffffffc0b56230) 00010000:00010000:3.0:1784043989.937619:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b394166aa00/0x89871fc3aba17cd0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000020 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043989.937627:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b394166aa00/0x89871fc3aba17cd0 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000020 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043989.937653:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b3982054800/0x89871fc3aba17cde lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40080000000000 nid: 0@lo remote: 0x89871fc3aba17cd7 expref: 15 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043989.937660:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b3982054800/0x89871fc3aba17cde lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40080000000000 nid: 0@lo remote: 0x89871fc3aba17cd7 expref: 15 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043989.937682:0:6498:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: MGS lock: ffff9b3982054800/0x89871fc3aba17cde lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x89871fc3aba17cd7 expref: 15 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784043989.937692:0:6498:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b38420a9180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:MGS:6498:1870705580854784:0@lo:105: 00000100:00100000:3.0:1784043989.937741:0:6498:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784043989.937778:0:6498:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3947f6e0c0 going to sleep for 11 seconds 00010000:00010000:3.0:1784043989.937791:0:6505:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b394166aa00/0x89871fc3aba17cd0 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000020 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784043989.937792:0:6495:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00010000:00010000:3.0:1784043989.937798:0:6505:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b394166aa00/0x89871fc3aba17cd0 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000020 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784043989.937802:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580854784 20000000:01000000:3.0:1784043989.937805:0:6505:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1784043989.937805:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580854784 00000100:00100000:2.0:1784043989.937835:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1784043989.937841:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3975613450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+3:6498:x1870705580854784:12345-0@lo:105: 00010000:00010000:2.0:1784043989.937851:0:6495:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: MGC192.168.202.140@tcp lock: ffff9b3982055000/0x89871fc3aba17cd7 lrc: 5/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x89871fc3aba17cde expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784043989.937858:0:6495:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: MGC192.168.202.140@tcp lock: ffff9b3982055000/0x89871fc3aba17cd7 lrc: 5/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x89871fc3aba17cde expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784043989.937866:0:6495:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGC192.168.202.140@tcp lock: ffff9b3982055000/0x89871fc3aba17cd7 lrc: 5/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11080000000000 nid: local remote: 0x89871fc3aba17cde expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784043989.937871:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9b3982055000/0x89871fc3aba17cd7 lrc: 6/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11080000000000 nid: local remote: 0x89871fc3aba17cde expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784043989.937878:0:6495:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: MGC192.168.202.140@tcp lock: ffff9b3982055000/0x89871fc3aba17cd7 lrc: 6/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1080000000000 nid: local remote: 0x89871fc3aba17cde expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784043989.937901:0:6495:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff9b3982055000) 00000100:00100000:2.0:1784043989.937935:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3975613450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+3:6498:x1870705580854784:12345-0@lo:105: Request processed in 94us (193us total) trans 0 rc 0/0 00000100:00100000:2.0:1784043989.937942:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1784043989.938143:0:6498:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b38420a9180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:MGS:6498:1870705580854784:0@lo:105: 00010000:00010000:3.0:1784043989.938156:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b394166aa00/0x89871fc3aba17cd0 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000020 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043989.938164:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b394166aa00/0x89871fc3aba17cd0 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000020 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043989.938194:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784043989.938229:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3944090850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+15:3641:x1870705580854656:12345-0@lo:103: Request processed in 726us (2079us total) trans 0 rc 0/0 00000100:00100000:3.0:1784043989.938243:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1784043989.938485:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b38420a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:3641:1870705580854656:0@lo:103: 00010000:00010000:0.0:1784043989.938705:0:6508:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: MGC192.168.202.140@tcp lock: ffff9b3982055000/0x89871fc3aba17cd7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x89871fc3aba17cde expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784043989.938715:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9b3982055000/0x89871fc3aba17cd7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x89871fc3aba17cde expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784043989.938783:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39459b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:3640:1870705580854016:0@lo:103: 00000100:00100000:1.0:1784043989.938799:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39459b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:3640:1870705580854144:0@lo:103: 00000100:00100000:0.0:1784043989.938808:0:6508:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39503bc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580854912:0@lo:501: 00000100:00100000:0.0:1784043989.938837:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784043989.938870:0:6508:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b396f256840 going to sleep for 11 seconds 00000100:00100000:2.0:1784043989.938878:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580854912 00000100:00100000:2.0:1784043989.938882:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580854912 00000100:00100000:2.0:1784043989.938960:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1784043989.938968:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3965efb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+15:6508:x1870705580854912:12345-0@lo:501: 00000100:00100000:2.0:1784043989.939094:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3965efb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+15:6508:x1870705580854912:12345-0@lo:501: Request processed in 127us (255us total) trans 0 rc 0/0 00000100:00100000:2.0:1784043989.939101:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1784043989.939166:0:6508:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39503bc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580854912:0@lo:501: 00000100:00100000:1.0:1784043989.939238:0:6508:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397a8a4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580855040:0@lo:503: 00000100:00100000:1.0:1784043989.939280:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784043989.942317:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3965efb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+14:8419:x1870705580853248:12345-0@lo:253: Request processed in 39837us (41499us total) trans 0 rc 0/0 00000100:00100000:3.0:1784043989.942329:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1784043989.942551:0:6508:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3950d62300 going to sleep for 11 seconds 00000100:00100000:0.0:1784043989.942801:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580855040 00000100:00100000:0.0:1784043989.942809:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580855040 00000100:00100000:0.0:1784043989.942862:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1784043989.942871:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3965ef9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+14:6508:x1870705580855040:12345-0@lo:503: 00000100:00100000:0.0:1784043989.942998:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3965ef9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+14:6508:x1870705580855040:12345-0@lo:503: Request processed in 127us (3716us total) trans 0 rc 0/0 00000100:00100000:0.0:1784043989.943005:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1784043989.943061:0:6508:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397a8a4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580855040:0@lo:503: 00000100:00100000:0.0:1784043989.943357:0:8442:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39503bdf80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:8442:1870705580855168:0@lo:502: 00000100:00100000:0.0:1784043989.943402:0:8442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784043989.943425:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580855168 00000100:00100000:0.0:1784043989.943429:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580855168 00000100:00100000:0.0:1784043989.943653:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1784043989.943662:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3965ef8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+14:8442:x1870705580855168:12345-0@lo:502: 00000100:00100000:0.0:1784043989.943815:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3965ef8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+14:8442:x1870705580855168:12345-0@lo:502: Request processed in 154us (412us total) trans 0 rc 0/0 00000100:00100000:0.0:1784043989.943822:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1784043989.943854:0:8442:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b397a881a80 going to sleep for 11 seconds 00000100:00100000:0.0:1784043989.943867:0:8442:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39503bdf80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:8442:1870705580855168:0@lo:502: 00000100:00100000:0.0:1784043989.943905:0:8442:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39503bdf80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:8442:1870705580855296:0@lo:502: 00000100:00100000:0.0:1784043989.943934:0:8442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784043989.944007:0:8442:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3970fc39c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784043989.946585:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580855296 00000100:00100000:2.0:1784043989.946600:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580855296 00000100:00100000:3.0:1784043989.946706:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1784043989.946718:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3965efa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+14:8442:x1870705580855296:12345-0@lo:502: 00000100:00100000:0.0:1784043989.946766:0:8419:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3975b50e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:8419:1870705580853248:0@lo:253: 10000000:01000000:0.0:1784043989.946782:0:8419:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1784043989.946784:0:8419:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1784043989.946786:0:8419:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1784043989.946787:0:8419:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784043989.946788:0:8419:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:0.0:1784043989.946790:0:8419:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784043989.946791:0:8419:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784043989.946792:0:8419:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1784043989.946794:0:8419:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1784043989.946795:0:8419:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784043989.946796:0:8419:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1784043989.946820:0:8419:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9b3975aa3000 from lustre-OST0000 10000000:01000000:0.0:1784043989.946852:0:8419:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:0.0:1784043989.946855:0:8419:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1784043989.946862:0:8419:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9b394402b380 local copy 10000000:01000000:0.0:1784043989.946866:0:8419:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00000100:00100000:3.0:1784043989.946885:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3965efa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+14:8442:x1870705580855296:12345-0@lo:502: Request processed in 169us (2949us total) trans 0 rc 0/0 00000100:00100000:3.0:1784043989.946891:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00010000:00010000:0.0:1784043989.946896:0:8419:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b3982055600/0x89871fc3aba17ce5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784043989.946906:0:8419:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.202.140@tcp lock: ffff9b3982055600/0x89871fc3aba17ce5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784043989.946915:0:8419:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9b3982055600/0x89871fc3aba17ce5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784043989.946939:0:8419:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39503bfb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:8419:1870705580855424:0@lo:101: 00000100:00100000:0.0:1784043989.946972:0:8419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784043989.957881:0:8419:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b397a8819c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784043989.957947:0:8442:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39503bdf80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:8442:1870705580855296:0@lo:502: 00000040:00080000:0.0:1784043989.958001:0:8442:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:0.0:1784043989.958102:0:6508:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:0.0:1784043989.958139:0:6508:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1784043989.958152:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b3982055000/0x89871fc3aba17cd7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba17cde expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784043989.958162:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9b3982055000/0x89871fc3aba17cd7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba17cde expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784043989.958188:0:6508:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:0.0:1784043989.958191:0:6508:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 25 10000000:01000000:0.0:1784043989.958194:0:6508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:0.0:1784043989.958235:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b3982054e00/0x89871fc3aba17cec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784043989.958242:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9b3982054e00/0x89871fc3aba17cec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784043989.958253:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9b3982054e00/0x89871fc3aba17cec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784043989.958272:0:6508:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39503bdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580855552:0@lo:101: 00000100:00100000:0.0:1784043989.958353:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784043989.960313:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580855424 00000100:00100000:1.0:1784043989.960327:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580855424 00000100:00100000:1.0:1784043989.960810:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1784043989.960825:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3950377450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+14:8419:x1870705580855424:12345-0@lo:101: 00010000:00010000:1.0:1784043989.960859:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784043989.960881:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b394166be00/0x89871fc3aba17cf3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x89871fc3aba17ce5 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784043989.960923:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b394166be00/0x89871fc3aba17cf3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x89871fc3aba17ce5 expref: 15 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784043989.960935:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b394166be00/0x89871fc3aba17cf3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x89871fc3aba17ce5 expref: 15 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784043989.960944:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b394166be00, rc 0) 00000100:00100000:1.0:1784043989.961030:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3950377450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+15:8419:x1870705580855424:12345-0@lo:101: Request processed in 209us (14056us total) trans 0 rc 0/0 00000100:00100000:1.0:1784043989.961036:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1784043989.970590:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580855552 00000100:00100000:3.0:1784043989.970606:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580855552 00000100:00100000:0.0:1784043989.970649:0:6508:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b397a881a80 going to sleep for 11 seconds 00000100:00100000:0.0:1784043989.970693:0:8419:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39503bfb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:8419:1870705580855424:0@lo:101: 00010000:00010000:0.0:1784043989.970715:0:8419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9b3982055600/0x89871fc3aba17ce5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x89871fc3aba17cf3 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784043989.970728:0:8419:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9b3982055600/0x89871fc3aba17ce5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x89871fc3aba17cf3 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784043989.970866:0:8419:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39503bfb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:8419:1870705580855680:0@lo:501: 00000100:00100000:0.0:1784043989.970921:0:8419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784043989.970998:0:8419:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b397a8819c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784043989.971219:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580855680 00000100:00100000:1.0:1784043989.971225:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580855680 00000100:00100000:1.0:1784043989.971408:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1784043989.971420:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3950375450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+16:6508:x1870705580855552:12345-0@lo:101: 00010000:00010000:1.0:1784043989.971435:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784043989.971453:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b394166bc00/0x89871fc3aba17cfa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x89871fc3aba17cec expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784043989.971476:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b394166bc00/0x89871fc3aba17cfa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x89871fc3aba17cec expref: 17 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784043989.971494:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b394166bc00/0x89871fc3aba17cfa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x89871fc3aba17cec expref: 17 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784043989.971502:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b394166bc00, rc 0) 00000100:00100000:3.0:1784043989.971789:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1784043989.971800:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3950374050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+17:8419:x1870705580855680:12345-0@lo:501: 00000100:00100000:3.0:1784043989.971880:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3950374050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+17:8419:x1870705580855680:12345-0@lo:501: Request processed in 83us (958us total) trans 0 rc -2/-2 00000100:00100000:3.0:1784043989.971889:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1784043989.973280:0:8419:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39503bfb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:8419:1870705580855680:0@lo:501: 10000000:01000000:0.0:1784043989.973311:0:8419:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.140@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1784043989.973358:0:8419:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.140@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1784043989.973367:0:8419:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b3982055600/0x89871fc3aba17ce5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x89871fc3aba17cf3 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784043989.973379:0:8419:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b3982055600/0x89871fc3aba17ce5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000400000000 nid: local remote: 0x89871fc3aba17cf3 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784043989.973387:0:8419:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.140@tcp lock: ffff9b3982055600/0x89871fc3aba17ce5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000400000000 nid: local remote: 0x89871fc3aba17cf3 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784043989.973411:0:8419:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784043989.973429:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784043989.973438:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: ffff9b3982055600/0x89871fc3aba17ce5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x400000000 nid: local remote: 0x89871fc3aba17cf3 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043989.973448:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3982055600 already unused, calling callback (ffffffffc113cc20) 10000000:00010000:3.0:1784043989.973453:0:6499:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: ffff9b3982055600/0x89871fc3aba17ce5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x400000000 nid: local remote: 0x89871fc3aba17cf3 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784043989.973454:0:8419:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9b3975aa3000 10000000:01000000:0.0:1784043989.973462:0:8419:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1784043989.973464:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9b3982055600/0x89871fc3aba17ce5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x8400000000 nid: local remote: 0x89871fc3aba17cf3 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784043989.973469:0:8419:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1784043989.973473:0:8419:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1784043989.973477:0:8419:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:0.0:1784043989.973480:0:8419:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 10000000:00010000:3.0:1784043989.973489:0:6499:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9b3982055600/0x89871fc3aba17ce5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x9400000000 nid: local remote: 0x89871fc3aba17cf3 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784043989.973496:0:6499:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1784043989.973510:0:8419:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b3982055200/0x89871fc3aba17d01 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784043989.973520:0:8419:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9b3982055200/0x89871fc3aba17d01 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043989.973522:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.140@tcp lock: ffff9b3982055600/0x89871fc3aba17ce5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x4809400000020 nid: local remote: 0x89871fc3aba17cf3 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043989.973537:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784043989.973551:0:8419:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9b3982055200/0x89871fc3aba17d01 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043989.973558:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: ffff9b3982055600/0x89871fc3aba17ce5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x4809400000020 nid: local remote: 0x89871fc3aba17cf3 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043989.973564:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9b3982055600/0x89871fc3aba17ce5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x4809400000020 nid: local remote: 0x89871fc3aba17cf3 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043989.973573:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784043989.973575:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784043989.973577:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784043989.973581:0:8419:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39503bfb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:8419:1870705580855808:0@lo:101: 00000100:00100000:3.0:1784043989.973583:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784043989.973595:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b38420aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:3640:1870705580855936:0@lo:103: 00000100:00100000:3.0:1784043989.973702:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784043989.973745:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580855936 00000100:00100000:3.0:1784043989.973750:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580855936 00000100:00100000:3.0:1784043989.973784:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1784043989.973791:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38420abb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+17:3640:x1870705580855936:12345-0@lo:103: 00010000:00010000:3.0:1784043989.973801:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784043989.973812:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b394166be00/0x89871fc3aba17cf3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x89871fc3aba17ce5 expref: 17 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043989.973822:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784043989.973827:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3950375450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+16:6508:x1870705580855552:12345-0@lo:101: Request processed in 2408us (15472us total) trans 0 rc 0/0 00000100:00100000:1.0:1784043989.973836:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1784043989.973855:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38420abb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+15:3640:x1870705580855936:12345-0@lo:103: Request processed in 64us (153us total) trans 0 rc 0/0 00000100:00100000:3.0:1784043989.973861:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1784043989.973883:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b38420aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:3640:1870705580855936:0@lo:103: 00000100:00100000:0.0:1784043989.974128:0:8419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784043989.974148:0:8419:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b397a881600 going to sleep for 11 seconds 00000100:00100000:3.0:1784043989.974170:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580855808 00000100:00100000:3.0:1784043989.974295:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580855808 00000100:00100000:2.0:1784043989.974418:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1784043989.974427:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3950376450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+15:8419:x1870705580855808:12345-0@lo:101: 00010000:00010000:2.0:1784043989.974438:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784043989.974449:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b3965d1c800/0x89871fc3aba17d08 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x89871fc3aba17d01 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784043989.974468:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b3965d1c800/0x89871fc3aba17d08 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x89871fc3aba17d01 expref: 16 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784043989.974480:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b3965d1c800/0x89871fc3aba17d08 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x89871fc3aba17d01 expref: 16 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784043989.974499:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3965d1c800, rc 0) 00000100:00100000:2.0:1784043989.974544:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3950376450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+16:8419:x1870705580855808:12345-0@lo:101: Request processed in 118us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1784043989.974550:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1784043989.974710:0:8419:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39503bfb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:8419:1870705580855808:0@lo:101: 00010000:00010000:3.0:1784043989.974723:0:8419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9b3982055200/0x89871fc3aba17d01 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba17d08 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043989.974732:0:8419:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9b3982055200/0x89871fc3aba17d01 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x89871fc3aba17d08 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784043989.974813:0:8419:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b38420aa300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:8419:1870705580856064:0@lo:501: 00000100:00100000:3.0:1784043989.974839:0:8419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784043989.974867:0:8419:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3947f6e180 going to sleep for 11 seconds 00000100:00100000:1.0:1784043989.974907:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580856064 00000100:00100000:1.0:1784043989.974912:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580856064 00000100:00100000:1.0:1784043989.974942:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1784043989.974950:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3950377c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+16:8419:x1870705580856064:12345-0@lo:501: 00000100:00100000:1.0:1784043989.975093:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3950377c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+16:8419:x1870705580856064:12345-0@lo:501: Request processed in 144us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1784043989.975100:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1784043989.975298:0:8419:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b38420aa300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:8419:1870705580856064:0@lo:501: 00000100:00100000:3.0:1784043989.975327:0:8419:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b38420aa300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:8419:1870705580856192:0@lo:503: 00000100:00100000:3.0:1784043989.975377:0:8419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784043989.975397:0:8419:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3947f6e180 going to sleep for 11 seconds 00000100:00100000:1.0:1784043989.975458:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580856192 00000100:00100000:1.0:1784043989.975462:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580856192 00000100:00100000:1.0:1784043989.975530:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1784043989.975537:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3950375c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+16:8419:x1870705580856192:12345-0@lo:503: 00000100:00100000:1.0:1784043989.975628:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3950375c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+16:8419:x1870705580856192:12345-0@lo:503: Request processed in 91us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1784043989.975634:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1784043989.975697:0:8419:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b38420aa300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:8419:1870705580856192:0@lo:503: 00000040:00080000:3.0:1784043989.975926:0:8419:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1784043989.975995:0:8419:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b38420aa300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:8419:1870705580856320:0@lo:502: 00000100:00100000:3.0:1784043989.976025:0:8419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784043989.976142:0:6508:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39503bdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580855552:0@lo:101: 00010000:00010000:0.0:1784043989.976158:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9b3982054e00/0x89871fc3aba17cec lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba17cfa expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784043989.976169:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9b3982054e00/0x89871fc3aba17cec lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x89871fc3aba17cfa expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784043989.976230:0:6508:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39503bdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580856448:0@lo:501: 00000100:00100000:0.0:1784043989.976268:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784043989.976499:0:8419:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3947f6e180 going to sleep for 11 seconds 00000100:00100000:0.0:1784043989.976574:0:6508:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b397a881a80 going to sleep for 11 seconds 00000100:00100000:2.0:1784043989.976835:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580856320 00000100:00100000:2.0:1784043989.976841:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580856320 00000100:00100000:2.0:1784043989.976867:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580856448 00000100:00100000:2.0:1784043989.976870:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580856448 00000100:00100000:2.0:1784043989.976885:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1784043989.976891:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3950376c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+17:8419:x1870705580856320:12345-0@lo:502: 00000100:00100000:1.0:1784043989.977047:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1784043989.977055:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3950374c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+17:6508:x1870705580856448:12345-0@lo:501: 00000100:00100000:1.0:1784043989.977145:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3950374c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+17:6508:x1870705580856448:12345-0@lo:501: Request processed in 91us (876us total) trans 0 rc 0/0 00000100:00100000:1.0:1784043989.977152:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1784043989.977260:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3950376c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+16:8419:x1870705580856320:12345-0@lo:502: Request processed in 368us (1234us total) trans 0 rc 0/0 00000100:00100000:2.0:1784043989.977267:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1784043989.977446:0:6508:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39503bdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580856448:0@lo:501: 00000100:00100000:0.0:1784043989.977480:0:6508:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39503bdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580856576:0@lo:503: 00000100:00100000:0.0:1784043989.977516:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784043989.977540:0:6508:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b397a881a80 going to sleep for 11 seconds 00000100:00100000:2.0:1784043989.977686:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580856576 00000100:00100000:2.0:1784043989.977690:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580856576 00000100:00100000:2.0:1784043989.977725:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1784043989.977732:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3950375850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+16:6508:x1870705580856576:12345-0@lo:503: 00000100:00100000:2.0:1784043989.977815:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3950375850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+16:6508:x1870705580856576:12345-0@lo:503: Request processed in 84us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1784043989.977821:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1784043989.978033:0:6508:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39503bdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580856576:0@lo:503: 00000100:00100000:0.0:1784043989.978502:0:8443:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39503bdf80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:8443:1870705580856704:0@lo:502: 00000100:00100000:0.0:1784043989.978540:0:8443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784043989.978697:0:8443:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b397a881600 going to sleep for 11 seconds 00000100:00100000:2.0:1784043989.978752:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580856704 00000100:00100000:2.0:1784043989.978756:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580856704 00000100:00100000:2.0:1784043989.978791:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1784043989.978799:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3950374450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+16:8443:x1870705580856704:12345-0@lo:502: 00000100:00100000:2.0:1784043989.978874:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3950374450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+16:8443:x1870705580856704:12345-0@lo:502: Request processed in 76us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1784043989.978887:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1784043989.978968:0:8443:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39503bdf80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:8443:1870705580856704:0@lo:502: 00000020:01000000:0.0:1784043989.978992:0:8443:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1784043989.978997:0:8443:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:0.0:1784043989.979002:0:8443:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784043989.979005:0:8443:0:(obd_config.c:1561:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1784043989.979008:0:8443:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1784043989.979011:0:8443:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.202.140@tcp to nid 0x20000c0a8ca8c (192.168.202.140@tcp) 00000020:01000000:0.0:1784043989.979028:0:8443:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:0.0:1784043989.979030:0:8443:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1784043989.979048:0:8443:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff9b3842113380) 00000020:00000080:0.0:1784043989.979066:0:8443:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type osp with refcount 2 00000020:00000080:0.0:1784043989.979071:0:8443:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1784043989.979592:0:8443:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:1.0:1784043989.979599:0:8443:0:(osd_handler.c:8929:osd_obd_connect()) connect #4 00000020:00000080:1.0:1784043989.979607:0:8443:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x89871fc3aba17d16 00010000:00080000:1.0:1784043989.979636:0:8443:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9b3842126000@lustre-OST0000-osc-MDT0001: add connection 192.168.202.140@tcp at head 00010000:00010000:1.0:1784043989.979876:0:8443:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-5 is initialized 00000100:00100000:3.0:1784043989.987723:0:8419:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b38420aa300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:8419:1870705580856320:0@lo:502: 00000040:00080000:2.0:1784043989.988010:0:8419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1784043989.988037:0:8419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:2.0:1784043989.988050:0:8419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:2.0:1784043989.988062:0:8419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:2.0:1784043989.988074:0:8419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:2.0:1784043989.988087:0:8419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:2.0:1784043989.988125:0:8419:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3975b53b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:8419:1870705580856832:0@lo:502: 00000100:00100000:2.0:1784043989.988236:0:8419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784043989.988281:0:8419:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b395205acc0 going to sleep for 11 seconds 00000100:00100000:1.0:1784043989.988423:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580856832 00000100:00100000:1.0:1784043989.988430:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580856832 00000100:00100000:1.0:1784043989.988485:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1784043989.988495:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3950376850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+16:8419:x1870705580856832:12345-0@lo:502: 00000100:00100000:1.0:1784043989.988701:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3950376850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+16:8419:x1870705580856832:12345-0@lo:502: Request processed in 206us (466us total) trans 0 rc 0/0 00000100:00100000:1.0:1784043989.988710:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1784043989.988733:0:8419:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3975b53b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:8419:1870705580856832:0@lo:502: 00000040:00080000:0.0:1784043989.988791:0:8419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:0.0:1784043989.988801:0:8419:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000040:01000000:3.0:1784043989.989368:0:8443:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:3.0:1784043989.989385:0:8443:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:3.0:1784043989.989555:0:8443:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1784043989.989845:0:8443:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1784043989.989929:0:8443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:3.0:1784043989.990013:0:8443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:1.0:1784043989.991155:0:8445:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1784043989.991160:0:8445:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1784043989.991928:0:8443:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1784043989.991939:0:8443:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1784043989.991970:0:8443:0:(lod_lov.c:129:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1784043989.991988:0:8443:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x89871fc3aba17d1d 00000100:00080000:3.0:1784043989.991997:0:8443:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1784043989.992001:0:8443:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9b3842126000 using connection 192.168.202.140@tcp/0@lo 00000100:00100000:3.0:1784043989.992031:0:8443:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b38420aa300 x1870705580856960/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1784043989.992051:0:8443:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:2.0:1784043989.992088:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b38420aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1870705580856960:0@lo:8: 00000020:01000000:3.0:1784043989.992136:0:8443:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784043989.992142:0:8443:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784043989.992144:0:8443:0:(obd_config.c:1561:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1784043989.992147:0:8443:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784043989.992152:0:8443:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784043989.992154:0:8443:0:(obd_config.c:1561:class_process_config()) marker 27 (0x1) lustre sys.timeout 00000020:00000080:3.0:1784043989.992159:0:8443:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000100:00100000:2.0:1784043989.992159:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:3.0:1784043989.992163:0:8443:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1784043989.993352:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39503bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1870705580857472:0@lo:400: 00000100:00100000:0.0:1784043989.993389:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784043989.993410:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784043989.993414:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39503bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3641:1870705580857344:0@lo:400: 00000100:00100000:0.0:1784043989.993480:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784043989.993507:0:7768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580857472 00000100:00100000:0.0:1784043989.993512:0:7768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580857472 00000100:00100000:0.0:1784043989.993545:0:7768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1784043989.993550:0:7768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39503bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1870705580857472:12345-0@lo:400: 00000100:00100000:0.0:1784043989.993589:0:7768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39503bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1870705580857472:12345-0@lo:400: Request processed in 38us (199us total) trans 0 rc 0/0 00000100:00100000:0.0:1784043989.993593:0:7768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1784043989.993608:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580857344 00000100:00100000:0.0:1784043989.993610:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580857344 00000100:00100000:0.0:1784043989.993643:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1784043989.993649:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39503bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1870705580857344:12345-0@lo:400: 00000100:00100000:0.0:1784043989.993679:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39503bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1870705580857344:12345-0@lo:400: Request processed in 31us (199us total) trans 0 rc 0/0 00000100:00100000:0.0:1784043989.993683:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:0.0:1784043989.993713:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b39503bfb80 x1870705580857344/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044005 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784043989.993723:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39503bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3641:1870705580857344:0@lo:400: 00000100:00100000:0.0:1784043989.993729:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39503bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1870705580857472:0@lo:400: 00000100:00100000:2.0:1784043989.994592:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39503bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1870705580857088:0@lo:400: 00000100:00100000:2.0:1784043989.994635:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784043989.994663:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784043989.994683:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39503be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1870705580857216:0@lo:400: 00000100:00100000:2.0:1784043989.994720:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784043989.994765:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580857088 00000100:00100000:2.0:1784043989.994771:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580857088 00000100:00100000:2.0:1784043989.994816:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1784043989.994826:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3975b51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1870705580857088:12345-0@lo:400: 00000100:00100000:2.0:1784043989.994876:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3975b51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1870705580857088:12345-0@lo:400: Request processed in 52us (239us total) trans 0 rc 0/0 00000100:00100000:2.0:1784043989.994885:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1784043989.994914:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580857216 00000100:00100000:2.0:1784043989.994917:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580857216 00000100:00100000:2.0:1784043989.994951:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1784043989.994972:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3975b50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1870705580857216:12345-0@lo:400: 00000100:00100000:2.0:1784043989.995013:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3975b50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1870705580857216:12345-0@lo:400: Request processed in 44us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1784043989.995022:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1784043989.995060:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39503be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1870705580857216:0@lo:400: 00010000:00080000:2.0:1784043989.995077:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b39503bdf80 x1870705580857088/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044005 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784043989.995087:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39503bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1870705580857088:0@lo:400: 00000100:00100000:3.0:1784043989.995218:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580856960 00000100:00100000:3.0:1784043989.995224:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580856960 00000100:00100000:3.0:1784043989.995330:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1784043989.995343:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3975b52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3637:x1870705580856960:12345-0@lo:8: 00010000:00020000:3.0:1784043989.995366:0:8426:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1784043989.995478:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3975b52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3637:x1870705580856960:12345-0@lo:8: Request processed in 142us (3320us total) trans 0 rc -19/-19 00000100:00080000:0.0:1784043989.995525:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9b3842126000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1784043989.995531:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1784043989.995535:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b38420aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1870705580856960:0@lo:8: 00000100:00100000:3.0:1784043989.995563:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000020:01000000:3.0:1784043989.995727:0:8444:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1784043989.995735:0:8444:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:3.0:1784043989.995742:0:8444:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784043989.995744:0:8444:0:(obd_config.c:1561:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1784043989.995750:0:8444:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1784043989.995765:0:8444:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9b3974253380) 00000020:00000080:3.0:1784043989.995783:0:8444:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type obdfilter with refcount 2 00000020:00000080:3.0:1784043989.995789:0:8444:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1784043989.995883:0:8444:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9b3975aa3000 from lustre-OST0000, refs=2 00080000:01000000:3.0:1784043989.995892:0:8444:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:3.0:1784043989.995899:0:8444:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x89871fc3aba17d2b 00000100:00100000:2.0:1784043989.996094:0:8443:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b38420a9f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:8443:1870705580857600:0@lo:502: 00000100:00100000:2.0:1784043989.996142:0:8443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784043989.996198:0:8443:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b395205a240 going to sleep for 11 seconds 00000100:00100000:1.0:1784043989.996721:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580857600 00000100:00100000:1.0:1784043989.996728:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580857600 00000100:00100000:1.0:1784043989.996775:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1784043989.996784:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3950374850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+16:8443:x1870705580857600:12345-0@lo:502: 00000100:00100000:1.0:1784043989.996906:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3950374850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+16:8443:x1870705580857600:12345-0@lo:502: Request processed in 124us (764us total) trans 0 rc 0/0 00000100:00100000:1.0:1784043989.996914:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1784043989.997046:0:8443:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b38420a9f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:8443:1870705580857600:0@lo:502: 00000020:01000000:0.0:1784043989.997072:0:8443:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784043989.997077:0:8443:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784043989.997079:0:8443:0:(obd_config.c:1561:class_process_config()) marker 27 (0x2) lustre sys.timeout 00000040:00080000:0.0:1784043989.997083:0:8443:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 34 count 34 00000020:01000000:1.0:1784043989.997331:0:6508:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 25-33 (rc=0) 10000000:01000000:1.0:1784043989.997373:0:6508:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:1.0:1784043989.997383:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b3982054e00/0x89871fc3aba17cec lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba17cfa expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784043989.997393:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9b3982054e00/0x89871fc3aba17cec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba17cfa expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784043989.997415:0:6508:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1784043989.997418:0:6508:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9b397418c800 from 30 10000000:01000000:1.0:1784043989.997421:0:6508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1784043989.997446:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b394166ac00/0x89871fc3aba17d32 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784043989.997454:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9b394166ac00/0x89871fc3aba17d32 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784043989.997463:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9b394166ac00/0x89871fc3aba17d32 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784043989.997477:0:6508:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397a8a7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580857728:0@lo:101: 00000100:00100000:1.0:1784043989.997508:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784043989.997541:0:6508:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b39452e9900 going to sleep for 11 seconds 00000100:00100000:0.0:1784043989.997591:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580857728 00000100:00100000:0.0:1784043989.997596:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580857728 00000100:00100000:0.0:1784043989.997629:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1784043989.997636:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3950377850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+16:6508:x1870705580857728:12345-0@lo:101: 00010000:00010000:0.0:1784043989.997645:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784043989.997658:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b3982054600/0x89871fc3aba17d39 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x89871fc3aba17d32 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784043989.997678:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b3982054600/0x89871fc3aba17d39 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x89871fc3aba17d32 expref: 17 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784043989.997695:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b3982054600/0x89871fc3aba17d39 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x89871fc3aba17d32 expref: 17 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784043989.997704:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3982054600, rc 0) 00000100:00100000:0.0:1784043989.997737:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3950377850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+17:6508:x1870705580857728:12345-0@lo:101: Request processed in 101us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1784043989.997744:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1784043989.997775:0:6508:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397a8a7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580857728:0@lo:101: 00010000:00010000:0.0:1784043989.997787:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9b394166ac00/0x89871fc3aba17d32 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba17d39 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784043989.997796:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9b394166ac00/0x89871fc3aba17d32 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x89871fc3aba17d39 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784043989.997843:0:6508:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39503bc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580857856:0@lo:501: 00000100:00100000:0.0:1784043989.997869:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784043989.997883:0:6508:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b394ae80f00 going to sleep for 11 seconds 00000100:00100000:0.0:1784043989.997897:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580857856 00000100:00100000:0.0:1784043989.997900:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580857856 00000100:00100000:0.0:1784043989.997934:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1784043989.997940:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3950375050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+17:6508:x1870705580857856:12345-0@lo:501: 00000100:00100000:0.0:1784043989.998038:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3950375050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+17:6508:x1870705580857856:12345-0@lo:501: Request processed in 98us (167us total) trans 0 rc 0/0 00000100:00100000:0.0:1784043989.998044:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1784043989.998075:0:6508:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39503bc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580857856:0@lo:501: 00000100:00100000:0.0:1784043989.998100:0:6508:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39503bc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580857984:0@lo:503: 00000100:00100000:0.0:1784043989.998140:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784043989.998153:0:6508:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b394ae80f00 going to sleep for 11 seconds 00000100:00100000:0.0:1784043989.998164:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580857984 00000100:00100000:0.0:1784043989.998167:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580857984 00000100:00100000:0.0:1784043989.998226:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1784043989.998233:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3950377050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+17:6508:x1870705580857984:12345-0@lo:503: 00000100:00100000:0.0:1784043989.999758:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3950377050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+17:6508:x1870705580857984:12345-0@lo:503: Request processed in 1517us (1609us total) trans 0 rc 0/0 00000100:00100000:0.0:1784043989.999772:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1784043990.000042:0:6508:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39503bc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580857984:0@lo:503: 00000100:00100000:2.0:1784043990.001077:0:8447:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3975b50000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:8447:1870705580858112:0@lo:502: 00000100:00100000:2.0:1784043990.001140:0:8447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784043990.002050:0:8447:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b395205a540 going to sleep for 11 seconds 00000100:00100000:1.0:1784043990.002503:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580858112 00000100:00100000:1.0:1784043990.002513:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580858112 00000100:00100000:0.0:1784043990.002740:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1784043990.002751:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3950376050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+17:8447:x1870705580858112:12345-0@lo:502: 00000100:00100000:0.0:1784043990.003004:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3950376050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+17:8447:x1870705580858112:12345-0@lo:502: Request processed in 254us (1863us total) trans 0 rc 0/0 00000100:00100000:0.0:1784043990.003013:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1784043990.004588:0:8447:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3975b50000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:8447:1870705580858112:0@lo:502: 00000100:00100000:2.0:1784043990.004669:0:8447:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3975b50000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:8447:1870705580858240:0@lo:502: 00000100:00100000:2.0:1784043990.004734:0:8447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784043990.004781:0:8447:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b395205a540 going to sleep for 11 seconds 00000100:00100000:1.0:1784043990.004916:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580858240 00000100:00100000:1.0:1784043990.004922:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580858240 00000100:00100000:1.0:1784043990.004974:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1784043990.004983:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3950370c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+17:8447:x1870705580858240:12345-0@lo:502: 00000100:00100000:1.0:1784043990.005101:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3950370c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+17:8447:x1870705580858240:12345-0@lo:502: Request processed in 119us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1784043990.005109:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1784043990.005405:0:8447:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3975b50000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:8447:1870705580858240:0@lo:502: 00000040:00080000:2.0:1784043990.005427:0:8447:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00010000:00010000:3.0:1784043990.006003:0:8444:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000020:01000000:1.0:1784043990.006204:0:6508:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:1.0:1784043990.006232:0:6508:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1784043990.006248:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b394166ac00/0x89871fc3aba17d32 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba17d39 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784043990.006259:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9b394166ac00/0x89871fc3aba17d32 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba17d39 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784043990.006269:0:6508:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1784043990.006271:0:6508:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:1.0:1784043990.006275:0:6508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1784043990.006312:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b394166be00/0x89871fc3aba17d40 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784043990.006321:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9b394166be00/0x89871fc3aba17d40 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784043990.006331:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9b394166be00/0x89871fc3aba17d40 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784043990.006362:0:6508:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397a8a5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580858368:0@lo:101: 00000100:00100000:1.0:1784043990.006405:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784043990.006440:0:6508:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b39452e9e40 going to sleep for 11 seconds 00000100:00100000:0.0:1784043990.006537:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580858368 00000100:00100000:0.0:1784043990.006543:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580858368 00000100:00100000:0.0:1784043990.006592:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1784043990.006605:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3950371850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+17:6508:x1870705580858368:12345-0@lo:101: 00010000:00010000:0.0:1784043990.006617:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784043990.006629:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b3982055c00/0x89871fc3aba17d47 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x89871fc3aba17d40 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784043990.006648:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b3982055c00/0x89871fc3aba17d47 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x89871fc3aba17d40 expref: 18 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784043990.006660:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b3982055c00/0x89871fc3aba17d47 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x89871fc3aba17d40 expref: 18 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784043990.006679:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3982055c00, rc 0) 00000100:00100000:0.0:1784043990.006725:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3950371850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+18:6508:x1870705580858368:12345-0@lo:101: Request processed in 125us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1784043990.006730:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1784043990.006922:0:6508:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397a8a5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580858368:0@lo:101: 00010000:00010000:2.0:1784043990.006937:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9b394166be00/0x89871fc3aba17d40 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba17d47 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784043990.006956:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9b394166be00/0x89871fc3aba17d40 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x89871fc3aba17d47 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784043990.007010:0:6508:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3975b50000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580858496:0@lo:501: 00000100:00100000:2.0:1784043990.007039:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784043990.007063:0:6508:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b395205a540 going to sleep for 11 seconds 00000100:00100000:1.0:1784043990.007113:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580858496 00000100:00100000:1.0:1784043990.007118:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580858496 00000100:00100000:1.0:1784043990.007149:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1784043990.007155:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3950370450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+18:6508:x1870705580858496:12345-0@lo:501: 00000100:00100000:1.0:1784043990.007297:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3950370450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+18:6508:x1870705580858496:12345-0@lo:501: Request processed in 141us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1784043990.007305:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1784043990.007602:0:6508:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3975b50000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580858496:0@lo:501: 00000100:00100000:2.0:1784043990.007630:0:6508:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3975b50000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580858624:0@lo:503: 00000100:00100000:2.0:1784043990.007668:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784043990.007691:0:6508:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b395205a540 going to sleep for 11 seconds 00000100:00100000:1.0:1784043990.007785:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580858624 00000100:00100000:1.0:1784043990.007790:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580858624 00000100:00100000:1.0:1784043990.007829:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1784043990.007835:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3950372850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+18:6508:x1870705580858624:12345-0@lo:503: 00000100:00100000:1.0:1784043990.007927:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3950372850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+18:6508:x1870705580858624:12345-0@lo:503: Request processed in 92us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1784043990.007934:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1784043990.008012:0:6508:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3975b50000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580858624:0@lo:503: 00000100:00100000:0.0:1784043990.008420:0:8448:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39503bfb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:8448:1870705580858752:0@lo:502: 00000100:00100000:0.0:1784043990.008460:0:8448:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784043990.008494:0:8448:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3965ee1a80 going to sleep for 11 seconds 00000100:00100000:1.0:1784043990.008548:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580858752 00000100:00100000:1.0:1784043990.008552:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580858752 00000100:00100000:1.0:1784043990.008596:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1784043990.008604:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3950370850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+18:8448:x1870705580858752:12345-0@lo:502: 00000100:00100000:1.0:1784043990.008678:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3950370850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+18:8448:x1870705580858752:12345-0@lo:502: Request processed in 75us (217us total) trans 0 rc 0/0 00000100:00100000:1.0:1784043990.008686:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1784043990.008815:0:8448:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39503bfb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:8448:1870705580858752:0@lo:502: 00000020:01000000:0.0:1784043990.008839:0:8448:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1784043990.008847:0:8448:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:0.0:1784043990.008853:0:8448:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784043990.008855:0:8448:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1784043990.008859:0:8448:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1784043990.008863:0:8448:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.202.140@tcp to nid 0x20000c0a8ca8c (192.168.202.140@tcp) 00000020:01000000:0.0:1784043990.008885:0:8448:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1784043990.008888:0:8448:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1784043990.008902:0:8448:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9b38421119c0) 00000020:00000080:0.0:1784043990.008924:0:8448:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type osp with refcount 2 00000020:00000080:0.0:1784043990.008930:0:8448:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1784043990.009120:0:8448:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:0.0:1784043990.009127:0:8448:0:(osd_handler.c:8929:osd_obd_connect()) connect #6 00000020:00000080:0.0:1784043990.009134:0:8448:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x89871fc3aba17d55 00010000:00080000:0.0:1784043990.009160:0:8448:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9b38423b1000@lustre-OST0000-osc-MDT0000: add connection 192.168.202.140@tcp at head 00010000:00010000:0.0:1784043990.009441:0:8448:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-6 is initialized 00000001:02000400:3.0:1784043990.009882:0:8444:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:3.0:1784043990.012215:0:8444:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:3.0:1784043990.012729:0:8444:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:0.0:1784043990.021208:0:8444:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:0.0:1784043990.021443:0:8444:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00000040:01000000:1.0:1784043990.025002:0:8448:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:1.0:1784043990.025033:0:8448:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1784043990.025548:0:8448:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1784043990.025846:0:8448:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1784043990.026780:0:8448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:1.0:1784043990.026887:0:8448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:3.0:1784043990.029110:0:8449:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1784043990.029119:0:8449:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1784043990.029758:0:8448:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1784043990.029770:0:8448:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1784043990.029805:0:8448:0:(lod_lov.c:129:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1784043990.029828:0:8448:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x89871fc3aba17d5c 00000100:00080000:2.0:1784043990.029840:0:8448:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1784043990.029845:0:8448:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9b38423b1000 using connection 192.168.202.140@tcp/0@lo 00000100:00100000:2.0:1784043990.029880:0:8448:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b3975b53800 x1870705580858880/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1784043990.029908:0:8448:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1784043990.029973:0:8448:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784043990.029977:0:8448:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784043990.029979:0:8448:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1784043990.029982:0:8448:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784043990.029986:0:8448:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784043990.029988:0:8448:0:(obd_config.c:1561:class_process_config()) marker 25 (0x1) lustre sys.timeout 00000020:00000080:2.0:1784043990.029991:0:8448:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1784043990.029999:0:8448:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1784043990.030029:0:8448:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3975b51880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:8448:1870705580859008:0@lo:502: 00000100:00100000:2.0:1784043990.030170:0:8448:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784043990.030240:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580859008 00000100:00100000:2.0:1784043990.030246:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580859008 00000100:00100000:2.0:1784043990.030296:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1784043990.030305:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3950373850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+18:8448:x1870705580859008:12345-0@lo:502: 00000100:00100000:2.0:1784043990.030433:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3950373850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+18:8448:x1870705580859008:12345-0@lo:502: Request processed in 128us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1784043990.030441:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1784043990.030494:0:8448:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b395205a540 going to sleep for 11 seconds 00000100:00100000:2.0:1784043990.030516:0:8448:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3975b51880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:8448:1870705580859008:0@lo:502: 00000020:01000000:2.0:1784043990.030540:0:8448:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784043990.030544:0:8448:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784043990.030546:0:8448:0:(obd_config.c:1561:class_process_config()) marker 25 (0x2) lustre sys.timeout 00000040:00080000:2.0:1784043990.030549:0:8448:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:2.0:1784043990.030601:0:6508:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:2.0:1784043990.030621:0:6508:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1784043990.030631:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b394166be00/0x89871fc3aba17d40 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba17d47 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784043990.030641:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9b394166be00/0x89871fc3aba17d40 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba17d47 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784043990.030650:0:6508:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1784043990.030652:0:6508:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff9b394402b380 from 1 10000000:01000000:2.0:1784043990.030655:0:6508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1784043990.030679:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b3965d1c000/0x89871fc3aba17d63 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784043990.030695:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9b3965d1c000/0x89871fc3aba17d63 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784043990.030704:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9b3965d1c000/0x89871fc3aba17d63 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784043990.030717:0:6508:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3975b51880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580859136:0@lo:101: 00000100:00100000:2.0:1784043990.030743:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784043990.030758:0:6508:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b395205a540 going to sleep for 11 seconds 00000100:00100000:2.0:1784043990.030773:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580859136 00000100:00100000:2.0:1784043990.030777:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580859136 00000100:00100000:2.0:1784043990.030802:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1784043990.030808:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3950371050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+18:6508:x1870705580859136:12345-0@lo:101: 00010000:00010000:2.0:1784043990.030817:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784043990.030830:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b3965d1d800/0x89871fc3aba17d6a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x89871fc3aba17d63 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784043990.030851:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b3965d1d800/0x89871fc3aba17d6a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x89871fc3aba17d63 expref: 19 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784043990.030861:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b3965d1d800/0x89871fc3aba17d6a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x89871fc3aba17d63 expref: 19 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784043990.030870:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3965d1d800, rc 0) 00000100:00100000:2.0:1784043990.030897:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3950371050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+19:6508:x1870705580859136:12345-0@lo:101: Request processed in 89us (153us total) trans 0 rc 0/0 00000100:00100000:2.0:1784043990.030904:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1784043990.030935:0:6508:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3975b51880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580859136:0@lo:101: 00010000:00010000:2.0:1784043990.030953:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9b3965d1c000/0x89871fc3aba17d63 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba17d6a expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784043990.030963:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9b3965d1c000/0x89871fc3aba17d63 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x89871fc3aba17d6a expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784043990.031005:0:6508:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3975b51880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580859264:0@lo:501: 00000100:00100000:2.0:1784043990.031030:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784043990.031043:0:6508:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b395205a540 going to sleep for 11 seconds 00000100:00100000:2.0:1784043990.031054:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580859264 00000100:00100000:2.0:1784043990.031057:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580859264 00000100:00100000:2.0:1784043990.031094:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1784043990.031100:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3950373050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+19:6508:x1870705580859264:12345-0@lo:501: 00000100:00100000:2.0:1784043990.031163:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3950373050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+19:6508:x1870705580859264:12345-0@lo:501: Request processed in 63us (132us total) trans 0 rc -2/-2 00000100:00100000:2.0:1784043990.031170:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1784043990.031221:0:6508:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3975b51880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580859264:0@lo:501: 10000000:01000000:2.0:1784043990.031240:0:6508:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1784043990.031245:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b3965d1c000/0x89871fc3aba17d63 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba17d6a expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784043990.031252:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9b3965d1c000/0x89871fc3aba17d63 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba17d6a expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784043990.031424:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3975b53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1870705580858880:0@lo:8: 00000100:00100000:1.0:1784043990.031464:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784043990.032030:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580858880 00000100:00100000:0.0:1784043990.032036:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580858880 00000100:00100000:0.0:1784043990.032066:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1784043990.032133:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397a8a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3637:x1870705580858880:12345-0@lo:8: 00010000:02000000:0.0:1784043990.032156:0:8428:0:(ldlm_lib.c:1205:target_handle_connect()) lustre-OST0000: Not available for connect from 0@lo (not set up) 00080000:10000000:2.0:1784043990.037018:0:8444:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0000: index object [0x200000003:0x2:0x0] (8/32) registered 00000100:00100000:0.0:1784043990.038429:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397a8a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3637:x1870705580858880:12345-0@lo:8: Request processed in 6350us (6958us total) trans 0 rc -19/-19 00000100:00100000:0.0:1784043990.038441:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:0.0:1784043990.038526:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9b38423b1000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1784043990.038531:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1784043990.038535:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3975b53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1870705580858880:0@lo:8: 00000020:00000080:0.0:1784043990.039864:0:8444:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1784043990.039875:0:8444:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784043990.039882:0:8444:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784043990.039884:0:8444:0:(obd_config.c:1561:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1784043990.039887:0:8444:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784043990.039891:0:8444:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784043990.039892:0:8444:0:(obd_config.c:1561:class_process_config()) marker 26 (0x1) lustre sys.timeout 00000020:00000080:0.0:1784043990.039895:0:8444:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1784043990.039896:0:8444:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1784043990.039925:0:8444:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784043990.039928:0:8444:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784043990.039930:0:8444:0:(obd_config.c:1561:class_process_config()) marker 26 (0x2) lustre sys.timeout 00000040:00080000:0.0:1784043990.039933:0:8444:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:1.0:1784043990.040098:0:8419:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:1.0:1784043990.040126:0:8419:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1784043990.040148:0:8419:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b3982055200/0x89871fc3aba17d01 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba17d08 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784043990.040161:0:8419:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9b3982055200/0x89871fc3aba17d01 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba17d08 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784043990.040170:0:8419:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9b3975aa3000 from 1 10000000:01000000:1.0:1784043990.040209:0:8419:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1784043990.040259:0:8419:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b394166aa00/0x89871fc3aba17d71 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784043990.040268:0:8419:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9b394166aa00/0x89871fc3aba17d71 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784043990.040278:0:8419:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9b394166aa00/0x89871fc3aba17d71 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784043990.040302:0:8419:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397a8a4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:8419:1870705580859392:0@lo:101: 00000100:00100000:1.0:1784043990.040379:0:8419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784043990.040653:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580859392 00000100:00100000:3.0:1784043990.040662:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580859392 00000100:00100000:1.0:1784043990.040678:0:8419:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b394ae80f00 going to sleep for 11 seconds 00000100:00100000:3.0:1784043990.040713:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1784043990.040722:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3950372050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+19:8419:x1870705580859392:12345-0@lo:101: 00010000:00010000:3.0:1784043990.040733:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784043990.040755:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b39759f8800/0x89871fc3aba17d78 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x89871fc3aba17d71 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043990.040778:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b39759f8800/0x89871fc3aba17d78 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x89871fc3aba17d71 expref: 20 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043990.040789:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b39759f8800/0x89871fc3aba17d78 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x89871fc3aba17d71 expref: 20 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043990.040802:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b39759f8800, rc 0) 00000100:00100000:3.0:1784043990.040839:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3950372050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+20:8419:x1870705580859392:12345-0@lo:101: Request processed in 119us (461us total) trans 0 rc 0/0 00000100:00100000:3.0:1784043990.040844:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1784043990.040963:0:8419:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397a8a4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:8419:1870705580859392:0@lo:101: 00010000:00010000:1.0:1784043990.040978:0:8419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9b394166aa00/0x89871fc3aba17d71 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba17d78 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784043990.040987:0:8419:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9b394166aa00/0x89871fc3aba17d71 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x89871fc3aba17d78 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784043990.041084:0:8419:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397a8a4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:8419:1870705580859520:0@lo:501: 00000100:00100000:1.0:1784043990.041110:0:8419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784043990.041132:0:8419:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b394ae80f00 going to sleep for 11 seconds 00000100:00100000:0.0:1784043990.041269:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580859520 00000100:00100000:0.0:1784043990.041274:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580859520 00000100:00100000:0.0:1784043990.041306:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1784043990.041313:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3950373450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+20:8419:x1870705580859520:12345-0@lo:501: 00000100:00100000:0.0:1784043990.041593:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3950373450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+20:8419:x1870705580859520:12345-0@lo:501: Request processed in 280us (481us total) trans 0 rc 0/0 00000100:00100000:0.0:1784043990.041607:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1784043990.041677:0:8419:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397a8a4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:8419:1870705580859520:0@lo:501: 00000100:00100000:1.0:1784043990.041700:0:8419:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397a8a4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:8419:1870705580859648:0@lo:503: 00000100:00100000:1.0:1784043990.041737:0:8419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784043990.041767:0:8419:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b394ae80f00 going to sleep for 11 seconds 00000100:00100000:3.0:1784043990.041824:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580859648 00000100:00100000:3.0:1784043990.041829:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580859648 00000100:00100000:3.0:1784043990.041887:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1784043990.041895:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3950371450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+20:8419:x1870705580859648:12345-0@lo:503: 00000100:00100000:3.0:1784043990.041981:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3950371450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+20:8419:x1870705580859648:12345-0@lo:503: Request processed in 87us (244us total) trans 0 rc 0/0 00000100:00100000:3.0:1784043990.041988:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1784043990.042057:0:8419:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397a8a4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:8419:1870705580859648:0@lo:503: 00000040:00080000:1.0:1784043990.042322:0:8419:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1784043990.042423:0:8419:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397a8a4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:8419:1870705580859776:0@lo:502: 00000100:00100000:1.0:1784043990.042457:0:8419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784043990.045450:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580859776 00000100:00100000:0.0:1784043990.045466:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580859776 00000100:00100000:0.0:1784043990.045529:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1784043990.045540:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3950370050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+20:8419:x1870705580859776:12345-0@lo:502: 00000100:00100000:1.0:1784043990.045546:0:8419:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3950d63b40 going to sleep for 11 seconds 00000100:00100000:0.0:1784043990.045795:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3950370050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+20:8419:x1870705580859776:12345-0@lo:502: Request processed in 257us (3336us total) trans 0 rc 0/0 00000100:00100000:0.0:1784043990.045803:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1784043990.045843:0:8419:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397a8a4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:8419:1870705580859776:0@lo:502: 00000040:00080000:1.0:1784043990.046157:0:8419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:1.0:1784043990.046231:0:8419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:1.0:1784043990.046267:0:8419:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397a8a4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:8419:1870705580859904:0@lo:502: 00000100:00100000:1.0:1784043990.046309:0:8419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784043990.046329:0:8419:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3950d63b40 going to sleep for 11 seconds 00000100:00100000:3.0:1784043990.046473:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580859904 00000100:00100000:3.0:1784043990.046477:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580859904 00000100:00100000:3.0:1784043990.046512:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1784043990.046520:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3950372450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+20:8419:x1870705580859904:12345-0@lo:502: 00000100:00100000:3.0:1784043990.046596:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3950372450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+20:8419:x1870705580859904:12345-0@lo:502: Request processed in 77us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1784043990.046603:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1784043990.046691:0:8419:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397a8a4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:8419:1870705580859904:0@lo:502: 00000040:00080000:1.0:1784043990.046731:0:8419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:1.0:1784043990.046739:0:8419:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:2.0:1784043990.048511:0:8454:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784043990.048522:0:8454:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784043990.048529:0:8454:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1784043990.048536:0:8454:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9b3975aa3000 00000020:00000080:2.0:1784043990.048539:0:8454:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1784043990.048554:0:8454:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784043990.048557:0:8454:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784043990.048558:0:8454:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1784043990.048561:0:8454:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:1.0:1784043990.048709:0:8419:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1784043990.048737:0:8419:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1784043990.048803:0:8419:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b394166aa00/0x89871fc3aba17d71 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba17d78 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784043990.048814:0:8419:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9b394166aa00/0x89871fc3aba17d71 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba17d78 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784043990.048861:0:8419:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1784043990.048864:0:8419:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9b3975aa3000 10000000:01000000:1.0:1784043990.048867:0:8419:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9b3975aa3000 10000000:01000000:1.0:1784043990.048871:0:8419:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1784043990.048876:0:8419:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9b3975aa3000 from 1 10000000:01000000:1.0:1784043990.048878:0:8419:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1784043990.048911:0:8419:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b394166b600/0x89871fc3aba17d7f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784043990.048924:0:8419:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9b394166b600/0x89871fc3aba17d7f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784043990.048934:0:8419:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9b394166b600/0x89871fc3aba17d7f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784043990.048954:0:8419:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397a8a4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:8419:1870705580860032:0@lo:101: 00000100:00100000:1.0:1784043990.049009:0:8419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784043990.049060:0:8419:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3950d63240 going to sleep for 11 seconds 00000100:00100000:2.0:1784043990.049215:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580860032 00000100:00100000:2.0:1784043990.049221:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580860032 00000100:00100000:2.0:1784043990.049253:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1784043990.049261:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3950373c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+20:8419:x1870705580860032:12345-0@lo:101: 00010000:00010000:2.0:1784043990.049273:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784043990.049287:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b3965d1d600/0x89871fc3aba17d86 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x89871fc3aba17d7f expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784043990.049308:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b3965d1d600/0x89871fc3aba17d86 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x89871fc3aba17d7f expref: 21 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784043990.049319:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b3965d1d600/0x89871fc3aba17d86 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x89871fc3aba17d7f expref: 21 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784043990.049328:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3965d1d600, rc 0) 00000100:00100000:2.0:1784043990.049375:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3950373c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+21:8419:x1870705580860032:12345-0@lo:101: Request processed in 115us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1784043990.049381:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1784043990.049531:0:8419:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397a8a4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:8419:1870705580860032:0@lo:101: 00010000:00010000:1.0:1784043990.049545:0:8419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9b394166b600/0x89871fc3aba17d7f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba17d86 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784043990.049554:0:8419:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9b394166b600/0x89871fc3aba17d7f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x89871fc3aba17d86 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784043990.049629:0:8419:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397a8a4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:8419:1870705580860160:0@lo:501: 00000100:00100000:1.0:1784043990.049653:0:8419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784043990.049680:0:8419:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3950d63240 going to sleep for 11 seconds 00000100:00100000:2.0:1784043990.049731:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580860160 00000100:00100000:2.0:1784043990.049735:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580860160 00000100:00100000:2.0:1784043990.049758:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1784043990.049764:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3950371c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+21:8419:x1870705580860160:12345-0@lo:501: 00000100:00100000:2.0:1784043990.049848:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3950371c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+21:8419:x1870705580860160:12345-0@lo:501: Request processed in 84us (194us total) trans 0 rc 0/0 00000100:00100000:2.0:1784043990.049862:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1784043990.049926:0:8419:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397a8a4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:8419:1870705580860160:0@lo:501: 00000100:00100000:1.0:1784043990.049950:0:8419:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397a8a4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:8419:1870705580860288:0@lo:503: 00000100:00100000:1.0:1784043990.049984:0:8419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784043990.049996:0:8419:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3950d63240 going to sleep for 11 seconds 00000100:00100000:1.0:1784043990.050008:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580860288 00000100:00100000:1.0:1784043990.050012:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580860288 00000100:00100000:1.0:1784043990.050045:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1784043990.050058:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3950372c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+21:8419:x1870705580860288:12345-0@lo:503: 00000100:00100000:1.0:1784043990.050139:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3950372c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+21:8419:x1870705580860288:12345-0@lo:503: Request processed in 81us (154us total) trans 0 rc 0/0 00000100:00100000:1.0:1784043990.050145:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1784043990.050210:0:8419:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397a8a4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:8419:1870705580860288:0@lo:503: 00000040:00080000:1.0:1784043990.050536:0:8419:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1784043990.050602:0:8419:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397a8a4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:8419:1870705580860416:0@lo:502: 00000100:00100000:1.0:1784043990.050635:0:8419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784043990.050648:0:8419:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3950d63240 going to sleep for 11 seconds 00000100:00100000:2.0:1784043990.050725:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580860416 00000100:00100000:2.0:1784043990.050729:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580860416 00000100:00100000:2.0:1784043990.050762:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1784043990.050768:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3970ede850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+21:8419:x1870705580860416:12345-0@lo:502: 00000100:00100000:2.0:1784043990.050840:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3970ede850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+21:8419:x1870705580860416:12345-0@lo:502: Request processed in 71us (203us total) trans 0 rc 0/0 00000100:00100000:2.0:1784043990.050846:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1784043990.050935:0:8419:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397a8a4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:8419:1870705580860416:0@lo:502: 00000040:00080000:1.0:1784043990.051196:0:8419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:1.0:1784043990.051225:0:8419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:1.0:1784043990.051239:0:8419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:1.0:1784043990.051254:0:8419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:1.0:1784043990.051268:0:8419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:1.0:1784043990.051295:0:8419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:1.0:1784043990.051311:0:8419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:1.0:1784043990.051326:0:8419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:1.0:1784043990.051354:0:8419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:1.0:1784043990.051368:0:8419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:1.0:1784043990.051381:0:8419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:1.0:1784043990.051516:0:8419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:1.0:1784043990.051536:0:8419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:1.0:1784043990.051551:0:8419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:1.0:1784043990.051565:0:8419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:1.0:1784043990.051580:0:8419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:1.0:1784043990.051595:0:8419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:1.0:1784043990.051609:0:8419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:1.0:1784043990.051621:0:8419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:1.0:1784043990.051645:0:8419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:1.0:1784043990.051661:0:8419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:1.0:1784043990.051687:0:8419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:1.0:1784043990.051703:0:8419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:1.0:1784043990.051716:0:8419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:1.0:1784043990.051728:0:8419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:1.0:1784043990.051740:0:8419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:1.0:1784043990.051750:0:8419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:1.0:1784043990.051761:0:8419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:1.0:1784043990.051774:0:8419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:1.0:1784043990.051786:0:8419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:1.0:1784043990.051797:0:8419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:1.0:1784043990.051808:0:8419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:1.0:1784043990.051820:0:8419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:1.0:1784043990.051832:0:8419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:1.0:1784043990.051844:0:8419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:1.0:1784043990.051856:0:8419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:1.0:1784043990.051868:0:8419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000100:00100000:1.0:1784043990.051901:0:8419:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397a8a4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:8419:1870705580860544:0@lo:502: 00000100:00100000:1.0:1784043990.051942:0:8419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784043990.052009:0:8419:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3942ab00c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784043990.052198:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580860544 00000100:00100000:2.0:1784043990.052204:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580860544 00000100:00100000:2.0:1784043990.052284:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1784043990.052291:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3970edc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+21:8419:x1870705580860544:12345-0@lo:502: 00000100:00100000:1.0:1784043990.052497:0:8419:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397a8a4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:8419:1870705580860544:0@lo:502: 00000040:00080000:1.0:1784043990.052546:0:8419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:1.0:1784043990.052554:0:8419:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000100:00100000:2.0:1784043990.052804:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3970edc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+21:8419:x1870705580860544:12345-0@lo:502: Request processed in 102us (450us total) trans 0 rc 0/0 00000100:00100000:2.0:1784043990.052811:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000020:01000004:2.0:1784043990.053169:0:8455:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1784043990.053206:0:8455:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9b3842453380) 00000020:00000080:2.0:1784043990.053228:0:8455:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type lwp with refcount 2 00000020:01000004:2.0:1784043990.053491:0:8455:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9b3975aa3000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1784043990.053497:0:8455:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9b3975aa3000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1784043990.053499:0:8455:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9b3975aa3000 3 00010000:00080000:2.0:1784043990.053537:0:8455:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9b3974da9800@lustre-MDT0000-lwp-OST0000: add connection 192.168.202.140@tcp at head 00010000:00010000:2.0:1784043990.055044:0:8455:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-7 is initialized 00000020:00000080:2.0:1784043990.055213:0:8455:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1784043990.055243:0:8455:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1784043990.055253:0:8455:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x89871fc3aba17d94 00000100:00080000:2.0:1784043990.055261:0:8455:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1784043990.055270:0:8455:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9b3974da9800 using connection 192.168.202.140@tcp/0@lo 00000100:00100000:2.0:1784043990.055298:0:8455:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b3975b51880 x1870705580860672/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1784043990.055384:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3975b51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3637:1870705580860672:0@lo:38: 00000100:00100000:1.0:1784043990.055513:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784043990.055550:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580860672 00000100:00100000:0.0:1784043990.055557:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580860672 00000100:00080000:2.0:1784043990.055572:0:8455:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1784043990.055598:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1784043990.055605:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397a8a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3637:x1870705580860672:12345-0@lo:38: 00010000:00080000:0.0:1784043990.055626:0:6512:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 183 last 0 00000020:00000080:0.0:1784043990.055656:0:6512:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x89871fc3aba17d9b 00000004:00100000:0.0:1784043990.055670:0:6512:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1784043990.055698:0:6512:0:(import.c:65:import_set_state_nolock()) ffff9b38423b4800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1784043990.055746:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397a8a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1870705580860672:12345-0@lo:38: Request processed in 140us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1784043990.055753:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1784043990.055788:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b3975b51880 x1870705580860672/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784044000 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784043990.055799:0:3637:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1784043990.055806:0:3637:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:0.0:1784043990.055812:0:3637:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1784043990.055817:0:3637:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1784043990.055819:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9b3974da9800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1784043990.055831:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3975b51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3637:1870705580860672:0@lo:38: 00000020:01000004:1.0:1784043990.055933:0:8455:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1784043990.055946:0:8455:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff9b3970fe19c0) 00000020:00000080:1.0:1784043990.055961:0:8455:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type lwp with refcount 2 00000020:01000004:1.0:1784043990.056189:0:8455:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9b3975aa3000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1784043990.056199:0:8455:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9b3975aa3000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1784043990.056201:0:8455:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9b3975aa3000 3 00010000:00080000:1.0:1784043990.056223:0:8455:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9b384244e000@lustre-MDT0001-lwp-OST0000: add connection 192.168.202.140@tcp at head 00010000:00010000:1.0:1784043990.059071:0:8455:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-8 is initialized 00000020:00000080:1.0:1784043990.060255:0:8455:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:1.0:1784043990.060318:0:8455:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1784043990.060331:0:8455:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0x89871fc3aba17da9 00000100:00080000:1.0:1784043990.060354:0:8455:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1784043990.060360:0:8455:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff9b384244e000 using connection 192.168.202.140@tcp/0@lo 00000100:00100000:1.0:1784043990.060469:0:8455:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b397a8a5f80 x1870705580860800/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1784043990.060496:0:8455:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00100000:0.0:1784043990.060509:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397a8a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3637:1870705580860800:0@lo:38: 00000100:00100000:0.0:1784043990.060596:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784043990.060659:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580860800 00000100:00100000:0.0:1784043990.060666:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580860800 00000100:00100000:0.0:1784043990.060701:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1784043990.060709:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39503bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3637:x1870705580860800:12345-0@lo:38: 00010000:00080000:0.0:1784043990.060733:0:6513:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 183 last 0 00000020:00000080:0.0:1784043990.060764:0:6513:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0x89871fc3aba17db0 00000004:00100000:0.0:1784043990.060777:0:6513:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1784043990.060799:0:6513:0:(import.c:65:import_set_state_nolock()) ffff9b38423b2000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1784043990.060846:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39503bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1870705580860800:12345-0@lo:38: Request processed in 136us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1784043990.060853:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1784043990.060889:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b397a8a5f80 x1870705580860800/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784044000 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784043990.060899:0:3637:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1784043990.060906:0:3637:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 1 00000100:00080000:1.0:1784043990.060912:0:3637:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1784043990.060916:0:3637:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1784043990.060919:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9b384244e000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1784043990.060925:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397a8a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3637:1870705580860800:0@lo:38: 00000040:00080000:1.0:1784043990.061765:0:8455:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000020:01000000:1.0:1784043990.061804:0:8419:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:1.0:1784043990.061828:0:8419:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1784043990.061846:0:8419:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b394166b600/0x89871fc3aba17d7f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba17d86 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784043990.061855:0:8419:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9b394166b600/0x89871fc3aba17d7f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba17d86 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1784043990.061895:0:8419:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1784043990.061897:0:8419:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1784043990.061898:0:8419:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1784043990.061899:0:8419:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1784043990.061900:0:8419:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784043990.061901:0:8419:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784043990.061902:0:8419:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1784043990.061903:0:8419:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1784043990.061904:0:8419:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1784043990.061905:0:8419:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784043990.061905:0:8419:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1784043990.061908:0:8419:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:1.0:1784043990.061910:0:8419:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1784043990.061911:0:8419:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1784043990.061911:0:8419:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1784043990.061912:0:8419:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1784043990.061912:0:8419:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784043990.061913:0:8419:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784043990.061914:0:8419:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1784043990.061914:0:8419:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1784043990.061915:0:8419:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1784043990.061915:0:8419:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784043990.061916:0:8419:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1784043990.061931:0:8419:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1784043990.061942:0:8419:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397a8a5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:8419:1870705580860928:0@lo:253: 00000100:00100000:1.0:1784043990.061980:0:8419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784043990.062000:0:8419:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3950d63b40 going to sleep for 11 seconds 00000100:00100000:1.0:1784043990.062016:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580860928 00000100:00100000:1.0:1784043990.062019:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580860928 00000100:00100000:1.0:1784043990.062044:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1784043990.062050:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3970edf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+21:8419:x1870705580860928:12345-0@lo:253: 20000000:01000000:1.0:1784043990.062083:0:6506:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1784043990.062098:0:6506:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1784043990.070446:0:6506:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1784043990.070504:0:6506:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1784043990.070763:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3970edf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+21:8419:x1870705580860928:12345-0@lo:253: Request processed in 8708us (8775us total) trans 0 rc 0/0 00000100:00100000:1.0:1784043990.070775:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1784043990.070868:0:8419:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397a8a5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:8419:1870705580860928:0@lo:253: 10000000:01000000:3.0:1784043990.070883:0:8419:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1784043990.070886:0:8419:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1784043990.070888:0:8419:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1784043990.070890:0:8419:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1784043990.070891:0:8419:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1784043990.070892:0:8419:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1784043990.070894:0:8419:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1784043990.070895:0:8419:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1784043990.070904:0:8419:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1784043990.070906:0:8419:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1784043990.070908:0:8419:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1784043990.070909:0:8419:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1784043990.070926:0:8419:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:2.0:1784043990.074344:0:6527:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1784043990.074353:0:6527:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1784043990.074378:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b3965d1d000/0x89871fc3aba17db7 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784043990.074461:0:6527:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b394166a400/0x89871fc3aba17c3d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x89871fc3aba17c36 expref: 20 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784043990.074471:0:6527:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b39586ee400/0x89871fc3aba17c59 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x89871fc3aba17c52 expref: 20 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784043990.074478:0:6527:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b3965d1d000/0x89871fc3aba17db7 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784043990.074527:0:6527:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b39586ee400/0x89871fc3aba17c59 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x89871fc3aba17c52 expref: 20 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784043990.074544:0:6527:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b39586ee400/0x89871fc3aba17c59 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x89871fc3aba17c52 expref: 20 pid: 6505 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784043990.074559:0:6527:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3975b51880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6527:1870705580861056:0@lo:104: 00000100:00100000:2.0:1784043990.074621:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1784043990.074740:0:6527:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b394166a400/0x89871fc3aba17c3d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x89871fc3aba17c36 expref: 20 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784043990.074749:0:6527:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b394166a400/0x89871fc3aba17c3d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x89871fc3aba17c36 expref: 20 pid: 6505 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784043990.074771:0:6527:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3975b50000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6527:1870705580861184:0@lo:104: 00000100:00100000:2.0:1784043990.074795:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00080000:10000000:3.0:1784043990.076867:0:8419:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:3.0:1784043990.077025:0:8419:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:3.0:1784043990.077487:0:8419:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:3.0:1784043990.077666:0:8419:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:3.0:1784043990.077891:0:8419:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:3.0:1784043990.078377:0:8419:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00000100:00100000:2.0:1784043990.078730:0:6527:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3950240600 going to sleep for 11 seconds 00000001:00000004:1.0:1784043990.079672:0:8419:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:0.0:1784043990.079757:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580861056 00000100:00100000:0.0:1784043990.079766:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580861056 00000100:00100000:0.0:1784043990.079808:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580861184 00000100:00100000:0.0:1784043990.079811:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580861184 00000100:00100000:0.0:1784043990.079828:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1784043990.079838:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3975b53800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+4:6527:x1870705580861056:12345-0@lo:104: 00010000:00010000:0.0:1784043990.079855:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.140@tcp lock: ffff9b39586ef600/0x89871fc3aba17c52 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x89871fc3aba17c59 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784043990.080007:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1784043990.080014:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3975b53800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+4:6527:x1870705580861056:12345-0@lo:104: Request processed in 178us (5393us total) trans 0 rc 0/0 00000100:00100000:0.0:1784043990.080022:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1784043990.080048:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1784043990.080055:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3975b53b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+3:6527:x1870705580861184:12345-0@lo:104: 00010000:00010000:0.0:1784043990.080063:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.140@tcp lock: ffff9b394166b000/0x89871fc3aba17c36 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x89871fc3aba17c3d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784043990.080143:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784043990.080150:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: ffff9b39586ef600/0x89871fc3aba17c52 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x89871fc3aba17c59 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784043990.080158:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b39586ef600 already unused, calling callback (ffffffffc113cc20) 10000000:00010000:1.0:1784043990.080163:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: ffff9b39586ef600/0x89871fc3aba17c52 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x89871fc3aba17c59 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784043990.080190:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9b39586ef600/0x89871fc3aba17c52 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x89871fc3aba17c59 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784043990.080198:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9b39586ef600/0x89871fc3aba17c52 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x89871fc3aba17c59 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784043990.080203:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1784043990.080239:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.140@tcp lock: ffff9b39586ef600/0x89871fc3aba17c52 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x89871fc3aba17c59 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784043990.080246:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784043990.080262:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: ffff9b39586ef600/0x89871fc3aba17c52 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x89871fc3aba17c59 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784043990.080269:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9b39586ef600/0x89871fc3aba17c52 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x89871fc3aba17c59 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784043990.080281:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784043990.080289:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784043990.080291:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784043990.080314:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397a8a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:3638:1870705580861312:0@lo:103: 00000100:00100000:1.0:1784043990.080365:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784043990.080423:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580861312 00000100:00100000:1.0:1784043990.080427:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580861312 00010000:00010000:1.0:1784043990.080444:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b39586ee400/0x89871fc3aba17c59 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x89871fc3aba17c52 expref: 21 pid: 6505 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784043990.080465:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1784043990.080471:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397a8a4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+21:3638:x1870705580861312:12345-0@lo:103: 00010000:00010000:1.0:1784043990.080482:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784043990.080487:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b39586ee400/0x89871fc3aba17c59 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x89871fc3aba17c52 expref: 21 pid: 6505 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784043990.080498:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b39586ee400/0x89871fc3aba17c59 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x89871fc3aba17c52 expref: 21 pid: 6505 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784043990.080517:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784043990.080544:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397a8a4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+21:3638:x1870705580861312:12345-0@lo:103: Request processed in 73us (179us total) trans 0 rc 0/0 00000100:00100000:1.0:1784043990.080551:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1784043990.080588:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397a8a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:3638:1870705580861312:0@lo:103: 00010000:00010000:0.0:1784043990.080731:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1784043990.080737:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3975b53b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+3:6527:x1870705580861184:12345-0@lo:104: Request processed in 683us (5941us total) trans 0 rc 0/0 00000100:00100000:0.0:1784043990.080744:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00010000:1.0:1784043990.081491:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784043990.081497:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: ffff9b394166b000/0x89871fc3aba17c36 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x89871fc3aba17c3d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784043990.081506:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b394166b000 already unused, calling callback (ffffffffc113cc20) 10000000:00010000:1.0:1784043990.081509:0:6499:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: ffff9b394166b000/0x89871fc3aba17c36 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x89871fc3aba17c3d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784043990.081523:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9b394166b000/0x89871fc3aba17c36 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x89871fc3aba17c3d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784043990.081530:0:6499:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9b394166b000/0x89871fc3aba17c36 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x89871fc3aba17c3d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784043990.081536:0:6499:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1784043990.081561:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.140@tcp lock: ffff9b394166b000/0x89871fc3aba17c36 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x89871fc3aba17c3d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784043990.081567:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784043990.081580:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: ffff9b394166b000/0x89871fc3aba17c36 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x89871fc3aba17c3d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784043990.081587:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9b394166b000/0x89871fc3aba17c36 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x89871fc3aba17c3d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784043990.081603:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784043990.081604:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784043990.081606:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784043990.081618:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397a8a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:3639:1870705580861440:0@lo:103: 00000100:00100000:1.0:1784043990.081652:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784043990.081693:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580861440 00000100:00100000:1.0:1784043990.081698:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580861440 00010000:00010000:1.0:1784043990.081716:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b394166a400/0x89871fc3aba17c3d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x89871fc3aba17c36 expref: 21 pid: 6505 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784043990.081738:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1784043990.081745:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397a8a4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+21:3639:x1870705580861440:12345-0@lo:103: 00010000:00010000:1.0:1784043990.081761:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784043990.081766:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b394166a400/0x89871fc3aba17c3d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x89871fc3aba17c36 expref: 21 pid: 6505 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784043990.081777:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b394166a400/0x89871fc3aba17c3d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x89871fc3aba17c36 expref: 21 pid: 6505 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784043990.081793:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b3965d1d000/0x89871fc3aba17db7 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784043990.081802:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b3965d1d000/0x89871fc3aba17db7 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1784043990.081818:0:6497:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.011531532s 00010000:00010000:1.0:1784043990.081824:0:6497:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b3965d1d000/0x89871fc3aba17db7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784043990.081831:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b3965d1d000/0x89871fc3aba17db7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784043990.081838:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b3965d1d000/0x89871fc3aba17db7 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784043990.081845:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b3965d1d000/0x89871fc3aba17db7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784043990.081851:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3965d1d000 already unused, calling callback (ffffffffc0b56230) 00010000:00010000:1.0:1784043990.081855:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b3965d1d000/0x89871fc3aba17db7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784043990.081862:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b3965d1d000/0x89871fc3aba17db7 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784043990.081877:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b3965d1d000/0x89871fc3aba17db7 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784043990.081887:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784043990.081918:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397a8a4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+21:3639:x1870705580861440:12345-0@lo:103: Request processed in 173us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1784043990.081925:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1784043990.081960:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397a8a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:3639:1870705580861440:0@lo:103: 00010000:00010000:3.0:1784043990.083293:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b39586ee400/0x89871fc3aba17c59 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x89871fc3aba17c52 expref: 20 pid: 6505 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784043990.083311:0:6527:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3975b51880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6527:1870705580861056:0@lo:104: 00010000:00010000:3.0:1784043990.083324:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b394166a400/0x89871fc3aba17c3d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x89871fc3aba17c36 expref: 19 pid: 6505 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784043990.083333:0:6527:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3975b50000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6527:1870705580861184:0@lo:104: 00010000:00010000:3.0:1784043990.083369:0:6527:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b3965d1d000/0x89871fc3aba17db7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043990.083379:0:6527:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b3965d1d000/0x89871fc3aba17db7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043990.083385:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b3965d1d000/0x89871fc3aba17db7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043990.083536:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b3965d1d000/0x89871fc3aba17db7 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784043990.095027:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1784043990.095055:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b38420a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1870705580861568:0@lo:41: 00000100:00100000:1.0:1784043990.095144:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784043990.095271:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580861568 00000100:00100000:0.0:1784043990.095279:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580861568 00000100:00100000:0.0:1784043990.095331:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1784043990.095350:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397a8a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1870705580861568:12345-0@lo:41: 00000004:00000024:0.0:1784043990.095402:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:0.0:1784043990.095455:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397a8a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1870705580861568:12345-0@lo:41: Request processed in 106us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1784043990.095462:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1784043990.095506:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b38420a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1870705580861568:0@lo:41: 00002000:00080000:1.0:1784043990.096846:0:8419:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:1.0:1784043990.096853:0:8419:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:1.0:1784043990.096887:0:8419:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1784043990.096928:0:8419:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.140@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1784043990.096947:0:8419:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:1.0:1784043990.096964:0:8419:0:(super25.c:181:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:1.0:1784043990.099965:0:8419:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1784043990.100279:0:8419:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:1.0:1784043990.671563:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1784043991.020642:0:8511:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1784043991.020986:0:8511:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1784043991.694403:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784043992.724753:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784043993.741356:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784043994.189872:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784043994.189898:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397a8a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1870705580861696:0@lo:41: 00000100:00100000:1.0:1784043994.190098:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784043994.190170:0:7768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580861696 00000100:00100000:1.0:1784043994.190201:0:7768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580861696 00000100:00100000:1.0:1784043994.190246:0:7768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1784043994.190263:0:7768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397a8a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1870705580861696:12345-0@lo:41: 00000004:00000024:1.0:1784043994.190309:0:7768:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:1.0:1784043994.190367:0:7768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397a8a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1870705580861696:12345-0@lo:41: Request processed in 105us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1784043994.190373:0:7768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1784043994.190419:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397a8a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1870705580861696:0@lo:41: 00010000:00010000:0.0:1784043994.767330:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784043995.213300:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1784043995.213351:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3975b50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:3639:1870705580861952:0@lo:400: 00000100:00080000:2.0:1784043995.213351:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1784043995.213356:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1784043995.213359:0:8:0:(import.c:65:import_set_state_nolock()) ffff9b3842126000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784043995.213364:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 183 00000100:00080000:2.0:1784043995.213369:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1784043995.213375:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9b3842126000 using connection 192.168.202.140@tcp/0@lo 00000100:00100000:2.0:1784043995.213394:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b3975b50380 x1870705580862592/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1784043995.213407:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1784043995.213410:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1784043995.213411:0:8:0:(import.c:65:import_set_state_nolock()) ffff9b38423b1000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784043995.213414:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 183 00000100:00080000:2.0:1784043995.213416:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1784043995.213420:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9b38423b1000 using connection 192.168.202.140@tcp/0@lo 00000100:00100000:3.0:1784043995.213423:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784043995.213429:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b3975b52680 x1870705580862720/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1784043995.213459:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3975b51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1870705580862080:0@lo:400: 00000100:00100000:3.0:1784043995.213462:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b38420a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1870705580861824:0@lo:41: 00000100:00100000:3.0:1784043995.213485:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784043995.213486:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784043995.213505:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3975b52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3640:1870705580862848:0@lo:400: 00000100:00100000:3.0:1784043995.213507:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3975b51c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1870705580862464:0@lo:400: 00000100:00100000:3.0:1784043995.213525:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784043995.213536:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784043995.213541:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1784043995.213546:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3975b52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3639:1870705580862336:0@lo:400: 00000100:00100000:2.0:1784043995.213551:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1784043995.213555:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3975b53100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1870705580862208:0@lo:400: 00000100:00100000:3.0:1784043995.213563:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784043995.213571:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784043995.213586:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3975b50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1870705580862976:0@lo:400: 00000100:00100000:3.0:1784043995.213593:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580861824 00000100:00100000:3.0:1784043995.213601:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580861824 00000100:00100000:2.0:1784043995.213607:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784043995.213627:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3975b50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1870705580862592:0@lo:8: 00000100:00100000:3.0:1784043995.213635:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580862464 00000100:00100000:3.0:1784043995.213638:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580862464 00000100:00100000:3.0:1784043995.213647:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580862208 00000100:00100000:3.0:1784043995.213649:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580862208 00000100:00100000:2.0:1784043995.213649:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784043995.213664:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1784043995.213665:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3975b52680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1870705580862720:0@lo:8: 00000100:00100000:3.0:1784043995.213672:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38420a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3639:x1870705580861824:12345-0@lo:41: 00000100:00100000:2.0:1784043995.213704:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00000024:3.0:1784043995.213707:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:2.0:1784043995.213744:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580861952 00000100:00100000:3.0:1784043995.213747:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38420a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3639:x1870705580861824:12345-0@lo:41: Request processed in 76us (261us total) trans 0 rc 0/0 00000100:00100000:2.0:1784043995.213748:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580861952 00000100:00100000:3.0:1784043995.213755:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1784043995.213771:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1784043995.213776:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38420ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1870705580862464:12345-0@lo:400: 00000100:00100000:2.0:1784043995.213778:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1784043995.213782:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3970edd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+19:3639:x1870705580861952:12345-0@lo:400: 00000100:00100000:3.0:1784043995.213805:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38420ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1870705580862464:12345-0@lo:400: Request processed in 27us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1784043995.213805:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3970edd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+19:3639:x1870705580861952:12345-0@lo:400: Request processed in 21us (381us total) trans 0 rc 0/0 00000100:00100000:2.0:1784043995.213812:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1784043995.213819:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1784043995.213830:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1784043995.213835:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39459b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1870705580862208:12345-0@lo:400: 00000100:00100000:2.0:1784043995.213853:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580862080 00000100:00100000:2.0:1784043995.213856:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580862080 00000100:00100000:3.0:1784043995.213866:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39459b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1870705580862208:12345-0@lo:400: Request processed in 31us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1784043995.213872:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1784043995.213874:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580862848 00000100:00100000:2.0:1784043995.213876:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580862848 00000100:00100000:2.0:1784043995.213903:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580862336 00000100:00100000:2.0:1784043995.213905:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580862336 00000100:00100000:3.0:1784043995.213907:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3975b51c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1870705580862464:0@lo:400: 00000100:00100000:2.0:1784043995.213914:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580862976 00000100:00100000:3.0:1784043995.213916:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3975b50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:3639:1870705580861952:0@lo:400: 00000100:00100000:2.0:1784043995.213916:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580862976 00000100:00100000:3.0:1784043995.213927:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b38420a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1870705580861824:0@lo:41: 00000100:00100000:2.0:1784043995.214108:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1784043995.214114:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3975b51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1870705580862080:12345-0@lo:400: 00000100:00100000:2.0:1784043995.214143:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3975b51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1870705580862080:12345-0@lo:400: Request processed in 29us (656us total) trans 0 rc 0/0 00000100:00100000:2.0:1784043995.214154:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1784043995.214166:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1784043995.214171:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39459b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1870705580862848:12345-0@lo:400: 00000100:00100000:2.0:1784043995.214230:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39459b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1870705580862848:12345-0@lo:400: Request processed in 58us (693us total) trans 0 rc 0/0 00000100:00100000:2.0:1784043995.214235:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1784043995.214245:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1784043995.214250:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38420a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1870705580862336:12345-0@lo:400: 00000100:00100000:2.0:1784043995.214277:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38420a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1870705580862336:12345-0@lo:400: Request processed in 27us (713us total) trans 0 rc 0/0 00000100:00100000:2.0:1784043995.214282:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1784043995.214303:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1784043995.214308:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39459b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1870705580862976:12345-0@lo:400: 00000100:00100000:2.0:1784043995.214332:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39459b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1870705580862976:12345-0@lo:400: Request processed in 24us (724us total) trans 0 rc 0/0 00000100:00100000:2.0:1784043995.214337:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1784043995.214367:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580862592 00000100:00100000:2.0:1784043995.214371:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580862592 00000100:00100000:2.0:1784043995.214383:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580862720 00000100:00100000:2.0:1784043995.214386:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580862720 00000100:00100000:2.0:1784043995.214394:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1784043995.214399:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39459b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3637:x1870705580862592:12345-0@lo:8: 00010000:00080000:2.0:1784043995.214421:0:8427:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 188 last 0 00000020:00000080:2.0:1784043995.214444:0:8427:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x89871fc3aba17dbe 00002000:00100000:2.0:1784043995.214483:0:8427:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff9b3842097800 ocd_connect_flags: 0xa044401443000026 ocd_version: 21136a2 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:2.0:1784043995.214495:0:8427:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00000001:00000004:2.0:1784043995.214499:0:8427:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:2.0:1784043995.214563:0:8427:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1784043995.214732:0:8427:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:2.0:1784043995.214749:0:8427:0:(import.c:65:import_set_state_nolock()) ffff9b3842094800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784043995.215192:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39459b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3637:x1870705580862592:12345-0@lo:8: Request processed in 774us (1524us total) trans 0 rc 0/0 00010000:00080000:3.0:1784043995.215200:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b3975b50380 x1870705580862592/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1784044010 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784043995.215200:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1784043995.215210:0:3637:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00100000:2.0:1784043995.215215:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00080000:3.0:1784043995.215216:0:3637:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 1 00000100:00100000:2.0:1784043995.215219:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39459b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3637:x1870705580862720:12345-0@lo:8: 00000100:00080000:3.0:1784043995.215223:0:3637:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1784043995.215228:0:3637:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1784043995.215230:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9b3842126000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00010000:00080000:2.0:1784043995.215234:0:8427:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 188 last 0 00000004:00080000:3.0:1784043995.215244:0:3637:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1784043995.215249:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3975b50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1870705580862592:0@lo:8: 00000020:00000080:2.0:1784043995.215249:0:8427:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x89871fc3aba17dc5 00002000:00100000:2.0:1784043995.215256:0:8427:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9b3842093800 ocd_connect_flags: 0xa044401443000026 ocd_version: 21136a2 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1784043995.215259:0:8427:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:2.0:1784043995.215261:0:8427:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1784043995.215300:0:8427:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1784043995.215313:0:8427:0:(import.c:65:import_set_state_nolock()) ffff9b3842091800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784043995.215349:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39459b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3637:x1870705580862720:12345-0@lo:8: Request processed in 128us (1644us total) trans 0 rc 0/0 00000100:00100000:2.0:1784043995.215356:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1784043995.215452:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3975b53100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1870705580862208:0@lo:400: 00010000:00080000:2.0:1784043995.215466:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b3975b50000 x1870705580862976/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044011 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784043995.215476:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3975b50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1870705580862976:0@lo:400: 00010000:00080000:2.0:1784043995.215485:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b3975b51500 x1870705580862080/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044011 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784043995.215501:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3975b51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1870705580862080:0@lo:400: 00010000:00080000:2.0:1784043995.215511:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b3975b52d80 x1870705580862848/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044011 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784043995.215520:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3975b52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3640:1870705580862848:0@lo:400: 00010000:00080000:2.0:1784043995.215548:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b3975b52a00 x1870705580862336/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044011 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784043995.215556:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3975b52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3639:1870705580862336:0@lo:400: 00010000:00080000:2.0:1784043995.215572:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b3975b52680 x1870705580862720/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1784044010 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784043995.215579:0:3637:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1784043995.215583:0:3637:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1784043995.215587:0:3637:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1784043995.215590:0:3637:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1784043995.215592:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9b38423b1000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1784043995.215884:0:3637:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1784043995.215889:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3975b52680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1870705580862720:0@lo:8: 00000004:00080000:0.0:1784043995.216012:0:8449:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1784043995.216067:0:8449:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 188386891869ns, next at 0ns, rc = 0 00080000:00080000:0.0:1784043995.216073:0:8449:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:0.0:1784043995.216265:0:8446:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39503bce00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8446:1870705580863104:0@lo:700: 00000100:00100000:0.0:1784043995.216308:0:8446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1784043995.216366:0:8445:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:0.0:1784043995.216370:0:8446:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b394941bb40 going to sleep for 11 seconds 00000100:00080000:0.0:1784043995.216384:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1784043995.216387:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:1.0:1784043995.216406:0:8445:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 188387231394ns, next at 0ns, rc = 0 00080000:00080000:1.0:1784043995.216418:0:8445:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:2.0:1784043995.218381:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580863104 00000100:00100000:2.0:1784043995.218394:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580863104 00000100:00100000:2.0:1784043995.218471:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1784043995.218482:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39503bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:8446:x1870705580863104:12345-0@lo:700: 00000100:00100000:2.0:1784043995.218535:0:8434:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39459b4000 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8434:1870705580863232:0@lo:700: 00000100:00100000:2.0:1784043995.218588:0:8434:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784043995.218613:0:8434:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3975ba9540 going to sleep for 11 seconds 00000100:00080000:0.0:1784043995.218672:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:3.0:1784043995.218758:0:7443:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00000100:00100000:3.0:1784043995.218898:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580863232 00000100:00100000:3.0:1784043995.218902:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580863232 00000100:00100000:3.0:1784043995.219003:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1784043995.219011:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3945931c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8434:x1870705580863232:12345-0@lo:700: 00000004:00080000:0.0:1784043995.226691:0:6490:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000004:00080000:0.0:1784043995.226916:0:8450:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:0.0:1784043995.227012:0:8450:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39503bdf80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8450:1870705580863488:0@lo:7: 00000100:00100000:0.0:1784043995.227087:0:8450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784043995.227115:0:8450:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b39455946c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784043995.227133:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39503bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1870705580863360:0@lo:13: 00000100:00100000:0.0:1784043995.227331:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784043995.227629:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580863488 00000100:00100000:2.0:1784043995.227637:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580863488 00000100:00100000:2.0:1784043995.227732:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1784043995.227740:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39503be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8450:x1870705580863488:12345-0@lo:7: 00000100:00100000:1.0:1784043995.229426:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580863360 00000100:00100000:1.0:1784043995.229436:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580863360 00000100:00100000:1.0:1784043995.229488:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1784043995.229497:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38427b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3638:x1870705580863360:12345-0@lo:13: 00002000:00000024:1.0:1784043995.229524:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923898368 avail 3692376064 00000100:00100000:1.0:1784043995.229599:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38427b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3638:x1870705580863360:12345-0@lo:13: Request processed in 103us (2424us total) trans 0 rc 0/0 00000100:00100000:1.0:1784043995.229608:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1784043995.231998:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1784043995.232128:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b39503bc700 x1870705580863360/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784044011 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784043995.232155:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39503bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1870705580863360:0@lo:13: 00002000:00080000:2.0:1784043995.233901:0:8427:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:2.0:1784043995.233912:0:8427:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:2.0:1784043995.234642:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39503be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8450:x1870705580863488:12345-0@lo:7: Request processed in 6431us (7083us total) trans 0 rc 0/0 00000100:00100000:2.0:1784043995.234657:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1784043995.234729:0:8450:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b39503bdf80 x1870705580863488/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1784044011 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784043995.234743:0:8450:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39503bdf80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8450:1870705580863488:0@lo:7: 00000004:00080000:2.0:1784043995.234755:0:8450:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 40000000:02000000:0.0:1784043995.235019:0:6518:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost 00000100:00100000:2.0:1784043995.235919:0:8450:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3842707100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8450:1870705580863616:0@lo:5: 00000100:00100000:2.0:1784043995.236609:0:8450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784043995.236639:0:8450:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3975ba90c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784043995.236641:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580863616 00000100:00100000:3.0:1784043995.236657:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580863616 00000100:00100000:3.0:1784043995.236708:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1784043995.236717:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3842704380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8450:x1870705580863616:12345-0@lo:5: 00002000:00080000:3.0:1784043995.236744:0:8428:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:3.0:1784043995.236747:0:8428:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000001:00080000:2.0:1784043995.242299:0:8421:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:2.0:1784043995.242318:0:8421:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00100000:2.0:1784043995.242322:0:8421:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:2.0:1784043995.242446:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3842704380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:8450:x1870705580863616:12345-0@lo:5: Request processed in 5726us (5834us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1784043995.242457:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1784043995.242514:0:8450:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b3842707100 x1870705580863616/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1784044011 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784043995.242525:0:8450:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1784043995.242532:0:8450:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3842707100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8450:1870705580863616:0@lo:5: 00000004:00080000:2.0:1784043995.242545:0:8450:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:2.0:1784043995.242597:0:8450:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3842707100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8450:1870705580863744:0@lo:700: 00000100:00100000:2.0:1784043995.242632:0:8450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784043995.242663:0:8450:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3975ba90c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784043995.242678:0:8435:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 2 min 2 max 16 00000100:00100000:2.0:1784043995.242685:0:8435:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_002' 00000100:00100000:2.0:1784043995.245168:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580863744 00000100:00100000:2.0:1784043995.245472:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580863744 00000100:00100000:2.0:1784043995.245605:0:8747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1784043995.245615:0:8747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3842706680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8450:x1870705580863744:12345-0@lo:700: 00000100:00100000:0.0:1784043995.252323:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3945931c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8434:x1870705580863232:12345-0@lo:700: Request processed in 33303us (33725us total) trans 0 rc 0/0 00000100:00100000:0.0:1784043995.252341:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1784043995.252346:0:8434:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b39459b4000 x1870705580863232/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1784044011 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784043995.252362:0:8434:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39459b4000 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8434:1870705580863232:0@lo:700: 40000000:02000000:3.0:1784043995.252381:0:8434:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] 00000100:00100000:3.0:1784043995.282752:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39503bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:8446:x1870705580863104:12345-0@lo:700: Request processed in 64264us (66434us total) trans 0 rc 0/0 00000100:00100000:3.0:1784043995.282771:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1784043995.283115:0:8446:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b39503bce00 x1870705580863104/t0(0) o700->lustre-OST0000-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1784044011 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784043995.283127:0:8446:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39503bce00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8446:1870705580863104:0@lo:700: 00000004:00080000:2.0:1784043995.291305:0:8446:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:2.0:1784043995.291340:0:8446:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3842706a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8446:1870705580864000:0@lo:7: 00000100:00100000:2.0:1784043995.291412:0:8446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784043995.291459:0:8446:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3975ba9540 going to sleep for 11 seconds 00000100:00100000:2.0:1784043995.291477:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3842705c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1870705580863872:0@lo:13: 00000100:00100000:2.0:1784043995.291499:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784043995.291539:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580864000 00000100:00100000:2.0:1784043995.291546:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580864000 00000100:00100000:2.0:1784043995.291583:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1784043995.291592:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3842704e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:8446:x1870705580864000:12345-0@lo:7: 00000100:00100000:1.0:1784043995.293397:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580863872 00000100:00100000:1.0:1784043995.293407:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580863872 00000100:00100000:1.0:1784043995.293451:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1784043995.293460:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3842707480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3639:x1870705580863872:12345-0@lo:13: 00002000:00000024:1.0:1784043995.293481:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923898368 avail 3692376064 00000100:00100000:1.0:1784043995.293551:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3842707480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3639:x1870705580863872:12345-0@lo:13: Request processed in 91us (2049us total) trans 0 rc 0/0 00000100:00100000:1.0:1784043995.293564:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1784043995.293631:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b3842705c00 x1870705580863872/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784044011 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784043995.293656:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3842705c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1870705580863872:0@lo:13: 00000100:00100000:3.0:1784043995.298552:0:8747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3842706680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8450:x1870705580863744:12345-0@lo:700: Request processed in 52931us (55912us total) trans 0 rc 0/0 00000100:00100000:3.0:1784043995.298567:0:8747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00002000:00080000:2.0:1784043995.299813:0:8426:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:2.0:1784043995.299820:0:8426:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x1:0x0] 00000100:00100000:2.0:1784043995.299891:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3842704e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:8446:x1870705580864000:12345-0@lo:7: Request processed in 8297us (8477us total) trans 0 rc 0/0 00000100:00100000:2.0:1784043995.299901:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1784043995.299948:0:8450:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b3842707100 x1870705580863744/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1784044011 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784043995.299962:0:8450:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3842707100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8450:1870705580863744:0@lo:700: 00010000:00080000:1.0:1784043995.299968:0:8446:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b3842706a00 x1870705580864000/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1784044011 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784043995.299977:0:8446:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3842706a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8446:1870705580864000:0@lo:7: 00000004:00080000:1.0:1784043995.299984:0:8446:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x1:0x0] 00000100:00100000:1.0:1784043995.300014:0:8446:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397a8a5c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8446:1870705580864128:0@lo:5: 00000100:00100000:1.0:1784043995.300047:0:8446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784043995.300078:0:8446:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b397f923c00 going to sleep for 11 seconds 00000100:00100000:2.0:1784043995.300716:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580864128 00000100:00100000:2.0:1784043995.300724:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580864128 00000100:00100000:2.0:1784043995.300769:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1784043995.300777:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397a8a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:8446:x1870705580864128:12345-0@lo:5: 00002000:00080000:2.0:1784043995.300811:0:8428:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:2.0:1784043995.301139:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397a8a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:8446:x1870705580864128:12345-0@lo:5: Request processed in 362us (1090us total) trans 0 rc 0/0 00000100:00100000:2.0:1784043995.301146:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1784043995.301225:0:8446:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b397a8a5c00 x1870705580864128/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1784044011 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784043995.301237:0:8446:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397a8a5c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8446:1870705580864128:0@lo:5: 00000004:00080000:1.0:1784043995.301248:0:8446:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x1:0x0] from OST, last_created [0x280000400:0x1:0x0]last_used is [0x280000400:0x1:0x0] 00000100:00100000:1.0:1784043995.301277:0:8446:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397a8a5c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8446:1870705580864256:0@lo:5: 00000100:00100000:1.0:1784043995.301313:0:8446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784043995.301332:0:8446:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b397f923c00 going to sleep for 11 seconds 00000100:00100000:1.0:1784043995.301348:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580864256 00000100:00100000:1.0:1784043995.301351:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580864256 00000100:00100000:1.0:1784043995.301380:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1784043995.301387:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397a8a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:8446:x1870705580864256:12345-0@lo:5: 00002000:00080000:1.0:1784043995.301414:0:8427:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:1.0:1784043995.303083:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397a8a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:8446:x1870705580864256:12345-0@lo:5: Request processed in 1691us (1764us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1784043995.303098:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:2.0:1784043995.303117:0:8446:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b397a8a5c00 x1870705580864256/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1784044011 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784043995.303131:0:8446:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397a8a5c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8446:1870705580864256:0@lo:5: 00000004:00080000:2.0:1784043995.303142:0:8446:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00000100:00100000:2.0:1784043995.303203:0:8446:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3842707100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8446:1870705580864384:0@lo:900: 00000100:00100000:2.0:1784043995.303246:0:8446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784043995.303269:0:8446:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b39758de840 going to sleep for 11 seconds 00000100:00100000:1.0:1784043995.304069:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580864384 00000100:00100000:1.0:1784043995.304077:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580864384 00000100:00100000:1.0:1784043995.304118:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1784043995.304126:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3842706300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:8446:x1870705580864384:12345-0@lo:900: 00000100:00100000:1.0:1784043995.304200:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3842706300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:8446:x1870705580864384:12345-0@lo:900: Request processed in 74us (952us total) trans 0 rc 0/0 00000100:00100000:1.0:1784043995.304206:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1784043995.304718:0:8446:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b3842707100 x1870705580864384/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1784044011 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784043995.304733:0:8446:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3842707100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8446:1870705580864384:0@lo:900: 00000004:02000040:2.0:1784043995.306991:0:8450:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 00000100:00100000:2.0:1784043995.312484:0:8450:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3842707b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8450:1870705580864512:0@lo:5: 00000100:00100000:2.0:1784043995.312890:0:8450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784043995.312976:0:8450:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b39758de840 going to sleep for 11 seconds 00000100:00100000:1.0:1784043995.316627:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580864512 00000100:00100000:1.0:1784043995.316642:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580864512 00000100:00100000:1.0:1784043995.316695:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1784043995.316705:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3842705f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:8450:x1870705580864512:12345-0@lo:5: 00002000:00080000:1.0:1784043995.329845:0:8428:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:1.0:1784043995.329867:0:8428:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 2 00000100:00100000:1.0:1784043995.338202:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3842705f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8450:x1870705580864512:12345-0@lo:5: Request processed in 21492us (25377us total) trans 4294967299 rc 0/0 00010000:00080000:2.0:1784043995.338260:0:8450:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b3842707b80 x1870705580864512/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1784044011 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784043995.338280:0:8450:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3842707b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8450:1870705580864512:0@lo:5: 00000004:00080000:2.0:1784043995.338326:0:8450:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x1:0x0]-[0x280000401:0x21:0x0] 00000100:00100000:1.0:1784043995.338337:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000001:02000400:0.0:1784043995.744922:0:8801:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg240-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1784043995.789374:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1784043996.495013:0:8853:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1784043996.495219:0:8853:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1784043996.813374:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1784043997.136678:0:8421:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000001:00080000:0.0:1784043997.136699:0:8421:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 10000000:01000000:1.0:1784043997.773300:0:6508:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1784043997.773308:0:6508:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9b396f3cf800 from 5 10000000:01000000:1.0:1784043997.773312:0:6508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1784043997.773615:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b394166a400/0x89871fc3aba17dcc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784043997.773628:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9b394166a400/0x89871fc3aba17dcc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784043997.773707:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9b394166a400/0x89871fc3aba17dcc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784043997.773746:0:6508:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397a8a4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580864640:0@lo:101: 00000100:00100000:1.0:1784043997.773811:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784043997.773965:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580864640 00000100:00100000:2.0:1784043997.773973:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580864640 00000100:00100000:2.0:1784043997.774041:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1784043997.774051:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3970edf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+19:6508:x1870705580864640:12345-0@lo:101: 00010000:00010000:2.0:1784043997.774064:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784043997.774080:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b3965d1cc00/0x89871fc3aba17dd3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x89871fc3aba17dcc expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784043997.774105:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b3965d1cc00/0x89871fc3aba17dd3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x89871fc3aba17dcc expref: 20 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784043997.774116:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b3965d1cc00/0x89871fc3aba17dd3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x89871fc3aba17dcc expref: 20 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784043997.774125:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3965d1cc00, rc 0) 00000100:00100000:2.0:1784043997.774200:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3970edf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+20:6508:x1870705580864640:12345-0@lo:101: Request processed in 126us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1784043997.774207:0:6508:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b397f923c00 going to sleep for 11 seconds 00000100:00100000:2.0:1784043997.774209:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1784043997.774236:0:6508:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397a8a4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580864640:0@lo:101: 00010000:00010000:1.0:1784043997.774251:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9b394166a400/0x89871fc3aba17dcc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba17dd3 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784043997.774260:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9b394166a400/0x89871fc3aba17dcc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x89871fc3aba17dd3 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784043997.774444:0:6508:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397a8a4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580864768:0@lo:256: 00000100:00100000:1.0:1784043997.774468:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784043997.774488:0:6508:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b397f923c00 going to sleep for 11 seconds 00000100:00100000:2.0:1784043997.774747:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580864768 00000100:00100000:2.0:1784043997.774753:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580864768 00000100:00100000:2.0:1784043997.774804:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1784043997.774812:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3970ede050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+20:6508:x1870705580864768:12345-0@lo:256: 20000000:01000000:2.0:1784043997.774827:0:6505:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1784043997.774844:0:6505:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1784043997.774848:0:6505:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:2.0:1784043997.774931:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3970ede050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+20:6508:x1870705580864768:12345-0@lo:256: Request processed in 119us (460us total) trans 0 rc 0/0 00000100:00100000:2.0:1784043997.774938:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1784043997.775209:0:6508:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397a8a4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580864768:0@lo:256: 10000000:01000000:3.0:1784043997.775283:0:6508:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1784043997.775291:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b394166a400/0x89871fc3aba17dcc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba17dd3 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043997.775301:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9b394166a400/0x89871fc3aba17dcc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba17dd3 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784043997.775312:0:6508:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1784043997.775314:0:6508:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9b397418c800 from 5 10000000:01000000:3.0:1784043997.775317:0:6508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1784043997.775340:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b39759f8000/0x89871fc3aba17dda lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043997.775356:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9b39759f8000/0x89871fc3aba17dda lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784043997.775364:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9b39759f8000/0x89871fc3aba17dda lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784043997.775378:0:6508:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b38420a8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580864896:0@lo:101: 00000100:00100000:3.0:1784043997.775410:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784043997.775440:0:6508:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3942ab0780 going to sleep for 11 seconds 00000100:00100000:2.0:1784043997.775608:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580864896 00000100:00100000:2.0:1784043997.775613:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580864896 00000100:00100000:2.0:1784043997.775653:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1784043997.775666:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3970edf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+20:6508:x1870705580864896:12345-0@lo:101: 00010000:00010000:2.0:1784043997.775675:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784043997.775685:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b3965d1d000/0x89871fc3aba17de1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x89871fc3aba17dda expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784043997.775715:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b3965d1d000/0x89871fc3aba17de1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x89871fc3aba17dda expref: 21 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784043997.775725:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b3965d1d000/0x89871fc3aba17de1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x89871fc3aba17dda expref: 21 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784043997.775733:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3965d1d000, rc 0) 00000100:00100000:2.0:1784043997.776067:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3970edf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+21:6508:x1870705580864896:12345-0@lo:101: Request processed in 400us (655us total) trans 0 rc 0/0 00000100:00100000:2.0:1784043997.776074:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1784043997.783011:0:6508:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b38420a8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580864896:0@lo:101: 00010000:00010000:0.0:1784043997.783045:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9b39759f8000/0x89871fc3aba17dda lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba17de1 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784043997.783077:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9b39759f8000/0x89871fc3aba17dda lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x89871fc3aba17de1 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784043997.783154:0:6508:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b38427b6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580865024:0@lo:256: 00000100:00100000:0.0:1784043997.783242:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784043997.783301:0:6508:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b397aa67b40 going to sleep for 11 seconds 00000100:00100000:1.0:1784043997.783574:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580865024 00000100:00100000:1.0:1784043997.783582:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580865024 00000100:00100000:1.0:1784043997.783644:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1784043997.783655:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3970edd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+21:6508:x1870705580865024:12345-0@lo:256: 20000000:01000000:1.0:1784043997.783679:0:6506:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1784043997.783712:0:6506:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1784043997.783715:0:6506:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:1.0:1784043997.784051:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3970edd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+21:6508:x1870705580865024:12345-0@lo:256: Request processed in 397us (808us total) trans 0 rc 0/0 00000100:00100000:1.0:1784043997.784058:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1784043997.784145:0:6508:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b38427b6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580865024:0@lo:256: 10000000:01000000:0.0:1784043997.784230:0:6508:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1784043997.784238:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b39759f8000/0x89871fc3aba17dda lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba17de1 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784043997.784247:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9b39759f8000/0x89871fc3aba17dda lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba17de1 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784043997.838811:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784043998.863649:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1784043998.983721:0:8955:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1784043998.983951:0:8955:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1784043999.309348:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397a8a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1870705580865152:0@lo:41: 00000100:00100000:2.0:1784043999.309420:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784043999.309457:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580865152 00000100:00100000:3.0:1784043999.309464:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580865152 00000100:00100000:3.0:1784043999.309518:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1784043999.309527:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3842704700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1870705580865152:12345-0@lo:41: 00000004:00000024:3.0:1784043999.309561:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:3.0:1784043999.309620:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3842704700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1870705580865152:12345-0@lo:41: Request processed in 94us (199us total) trans 0 rc 0/0 00000100:00100000:3.0:1784043999.309628:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1784043999.309650:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397a8a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1870705580865152:0@lo:41: 00010000:00010000:1.0:1784043999.886487:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1784043999.951804:0:9003:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1784043999.951815:0:9003:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=c0185879 00000100:00100000:1.0:1784044000.333653:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784044000.333688:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b38427b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1870705580865280:0@lo:13: 00000100:00100000:1.0:1784044000.333780:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044000.333904:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580865280 00000100:00100000:0.0:1784044000.333912:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580865280 00000100:00100000:0.0:1784044000.333972:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1784044000.333992:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397a8a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1870705580865280:12345-0@lo:13: 00002000:00000024:0.0:1784044000.334024:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784044000.334074:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397a8a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1870705580865280:12345-0@lo:13: Request processed in 94us (294us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044000.334082:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1784044000.334498:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3842705180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1870705580865408:0@lo:13: 00000100:00100000:2.0:1784044000.334547:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044000.334584:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580865408 00000100:00100000:2.0:1784044000.334588:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580865408 00000100:00100000:2.0:1784044000.334609:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1784044000.334614:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3842704a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1870705580865408:12345-0@lo:13: 00002000:00000024:2.0:1784044000.334625:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784044000.334654:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3842704a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1870705580865408:12345-0@lo:13: Request processed in 39us (106us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044000.334677:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1784044000.334713:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b3842705180 x1870705580865408/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784044016 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784044000.334723:0:3638:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000100:00100000:2.0:1784044000.334753:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3842705180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1870705580865408:0@lo:13: 00000100:00080000:1.0:1784044000.334856:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1784044000.334886:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b38427b6300 x1870705580865280/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784044016 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784044000.334894:0:3640:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1784044000.334906:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b38427b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1870705580865280:0@lo:13: 00000100:00100000:2.0:1784044000.335118:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b38427b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1870705580865920:0@lo:400: 00000100:00100000:2.0:1784044000.335170:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044000.335226:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1784044000.335233:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b38427b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:3638:1870705580865536:0@lo:400: 00000100:00100000:2.0:1784044000.335271:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044000.335294:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b38427b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1870705580866048:0@lo:400: 00000100:00100000:2.0:1784044000.335317:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044000.335355:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580865536 00000100:00100000:2.0:1784044000.335359:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580865536 00000100:00100000:2.0:1784044000.335388:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1784044000.335394:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3970edc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+21:3638:x1870705580865536:12345-0@lo:400: 00000100:00100000:2.0:1784044000.335428:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3970edc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+21:3638:x1870705580865536:12345-0@lo:400: Request processed in 33us (155us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044000.335434:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1784044000.335460:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580866048 00000100:00100000:2.0:1784044000.335463:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580866048 00000100:00100000:2.0:1784044000.335484:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1784044000.335489:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3842707b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1870705580866048:12345-0@lo:400: 00000100:00100000:2.0:1784044000.335519:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3842707b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1870705580866048:12345-0@lo:400: Request processed in 29us (200us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044000.335534:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1784044000.335559:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b38427b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:3638:1870705580865536:0@lo:400: 00000100:00100000:2.0:1784044000.335567:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b38427b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1870705580866048:0@lo:400: 00000100:00100000:1.0:1784044000.335715:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b38427b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1870705580865664:0@lo:400: 00000100:00100000:1.0:1784044000.335751:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044000.335774:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b38427b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3640:1870705580866176:0@lo:400: 00000100:00100000:1.0:1784044000.335793:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044000.335810:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1784044000.335815:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b38427b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1870705580865792:0@lo:400: 00000100:00100000:1.0:1784044000.335834:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044000.335851:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b38427b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1870705580866304:0@lo:400: 00000100:00100000:1.0:1784044000.335869:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044000.335886:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580865920 00000100:00100000:1.0:1784044000.335890:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580865920 00000100:00100000:1.0:1784044000.335911:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580865664 00000100:00100000:1.0:1784044000.335914:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580865664 00000100:00100000:1.0:1784044000.335924:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580866176 00000100:00100000:1.0:1784044000.335926:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580866176 00000100:00100000:1.0:1784044000.335943:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580866304 00000100:00100000:1.0:1784044000.335946:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580866304 00000100:00100000:1.0:1784044000.335960:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1784044000.335966:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3842705180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1870705580865920:12345-0@lo:400: 00000100:00100000:1.0:1784044000.336013:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3842705180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1870705580865920:12345-0@lo:400: Request processed in 47us (842us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044000.336025:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1784044000.336039:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1784044000.336045:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397a8a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1870705580865664:12345-0@lo:400: 00000100:00100000:1.0:1784044000.336076:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397a8a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1870705580865664:12345-0@lo:400: Request processed in 31us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044000.336083:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1784044000.336094:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1784044000.336100:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397a8a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1870705580866176:12345-0@lo:400: 00000100:00100000:1.0:1784044000.336123:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397a8a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1870705580866176:12345-0@lo:400: Request processed in 24us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044000.336129:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1784044000.336140:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1784044000.336145:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397a8a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1870705580866304:12345-0@lo:400: 00000100:00100000:1.0:1784044000.336170:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397a8a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1870705580866304:12345-0@lo:400: Request processed in 25us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044000.336199:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1784044000.336231:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580865792 00000100:00100000:1.0:1784044000.336234:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580865792 00000100:00100000:1.0:1784044000.336267:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1784044000.336273:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397a8a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1870705580865792:12345-0@lo:400: 00000100:00100000:1.0:1784044000.336301:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397a8a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1870705580865792:12345-0@lo:400: Request processed in 28us (466us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044000.336307:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:1.0:1784044000.336320:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1784044000.336323:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1784044000.336348:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b38427b5180 x1870705580865920/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044016 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784044000.336365:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b38427b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1870705580865920:0@lo:400: 00000100:00100000:1.0:1784044000.336388:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b38427b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1870705580865792:0@lo:400: 00010000:00080000:1.0:1784044000.336397:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b38427b7800 x1870705580866304/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044016 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784044000.336406:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b38427b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1870705580866304:0@lo:400: 00010000:00080000:1.0:1784044000.336413:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b38427b5f80 x1870705580865664/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044016 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784044000.336421:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b38427b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1870705580865664:0@lo:400: 00010000:00080000:1.0:1784044000.336429:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b38427b4000 x1870705580866176/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044016 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784044000.336437:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b38427b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3640:1870705580866176:0@lo:400: 00000100:00100000:3.0:1784044000.337086:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1784044000.337097:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3842704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1870705580866432:0@lo:41: 00000100:00100000:3.0:1784044000.337131:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044000.337322:0:7768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580866432 00000100:00100000:0.0:1784044000.337327:0:7768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580866432 00000100:00100000:0.0:1784044000.337364:0:7768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1784044000.337379:0:7768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38420aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1870705580866432:12345-0@lo:41: 00000004:00000024:0.0:1784044000.337404:0:7768:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:0.0:1784044000.337451:0:7768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38420aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1870705580866432:12345-0@lo:41: Request processed in 72us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044000.337457:0:7768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1784044000.337618:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3842704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1870705580866432:0@lo:41: 00010000:00010000:3.0:1784044000.909303:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784044001.939995:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784044002.958879:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784044003.983769:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784044004.431466:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784044004.431492:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397a8a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1870705580866560:0@lo:41: 00000100:00100000:1.0:1784044004.431617:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044004.431692:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580866560 00000100:00100000:1.0:1784044004.431700:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580866560 00000100:00100000:1.0:1784044004.431751:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1784044004.431761:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397a8a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1870705580866560:12345-0@lo:41: 00000004:00000024:1.0:1784044004.431796:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:1.0:1784044004.431860:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397a8a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1870705580866560:12345-0@lo:41: Request processed in 101us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044004.431868:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1784044004.431926:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397a8a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1870705580866560:0@lo:41: 00010000:00010000:3.0:1784044005.006068:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784044005.463226:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1784044005.463258:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3842704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1870705580866688:0@lo:13: 00000100:00100000:2.0:1784044005.463430:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044005.463501:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580866688 00000100:00100000:2.0:1784044005.463509:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580866688 00000100:00100000:2.0:1784044005.463565:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1784044005.463577:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3842707800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1870705580866688:12345-0@lo:13: 00002000:00000024:2.0:1784044005.463608:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784044005.463656:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3842707800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1870705580866688:12345-0@lo:13: Request processed in 82us (225us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044005.463664:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1784044005.463708:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b3842704000 x1870705580866688/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784044021 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784044005.463728:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3842704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1870705580866688:0@lo:13: 00000100:00100000:1.0:1784044005.464097:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784044005.464108:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397a8a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1870705580866816:0@lo:41: 00000100:00100000:1.0:1784044005.464158:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1784044005.464217:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784044005.464234:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580866816 00000100:00100000:1.0:1784044005.464238:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580866816 00000100:00100000:1.0:1784044005.464267:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1784044005.464273:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397aa55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1870705580866816:12345-0@lo:41: 00000004:00000024:1.0:1784044005.464296:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:1.0:1784044005.464344:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397aa55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1870705580866816:12345-0@lo:41: Request processed in 71us (186us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044005.464351:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1784044005.464384:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397a8a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1870705580866816:0@lo:41: 00000100:00100000:0.0:1784044005.471687:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b38427b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1870705580866944:0@lo:13: 00000100:00100000:0.0:1784044005.471758:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044005.471843:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580866944 00000100:00100000:0.0:1784044005.471851:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580866944 00000100:00100000:0.0:1784044005.471914:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1784044005.471923:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38427b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1870705580866944:12345-0@lo:13: 00002000:00000024:0.0:1784044005.471956:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784044005.472000:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38427b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1870705580866944:12345-0@lo:13: Request processed in 77us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044005.472008:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1784044005.472052:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b38427b5880 x1870705580866944/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784044021 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784044005.472072:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b38427b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1870705580866944:0@lo:13: 00000100:00100000:0.0:1784044005.472157:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b38427b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:3639:1870705580867072:0@lo:400: 00000100:00100000:0.0:1784044005.472231:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044005.472255:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b38427b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3639:1870705580867584:0@lo:400: 00000100:00100000:0.0:1784044005.472279:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044005.472887:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784044005.472900:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b38427b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3639:1870705580867456:0@lo:400: 00000100:00100000:0.0:1784044005.472944:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044005.472996:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580867072 00000100:00100000:0.0:1784044005.473001:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580867072 00000100:00100000:0.0:1784044005.473031:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1784044005.473037:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3970ede450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+21:3639:x1870705580867072:12345-0@lo:400: 00000100:00100000:0.0:1784044005.473076:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3970ede450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+21:3639:x1870705580867072:12345-0@lo:400: Request processed in 38us (844us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044005.473083:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1784044005.473110:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580867584 00000100:00100000:0.0:1784044005.473113:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580867584 00000100:00100000:0.0:1784044005.473140:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580867456 00000100:00100000:0.0:1784044005.473143:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580867456 00000100:00100000:0.0:1784044005.473156:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1784044005.473162:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38427b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1870705580867584:12345-0@lo:400: 00000100:00100000:0.0:1784044005.473245:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38427b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1870705580867584:12345-0@lo:400: Request processed in 83us (965us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044005.473252:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1784044005.473264:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1784044005.473269:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38427b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1870705580867456:12345-0@lo:400: 00000100:00100000:0.0:1784044005.473294:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38427b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1870705580867456:12345-0@lo:400: Request processed in 25us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044005.476249:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1784044005.476311:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b38427b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1870705580867200:0@lo:400: 00000100:00100000:0.0:1784044005.476381:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044005.476418:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b38427b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1870705580867712:0@lo:400: 00000100:00100000:0.0:1784044005.476438:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044005.476455:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784044005.476461:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b38427b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1870705580867328:0@lo:400: 00000100:00100000:0.0:1784044005.476491:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044005.476520:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580867200 00000100:00100000:0.0:1784044005.476527:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580867200 00000100:00100000:0.0:1784044005.476557:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580867712 00000100:00100000:0.0:1784044005.476560:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580867712 00000100:00100000:0.0:1784044005.476578:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1784044005.476584:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38427b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1870705580867200:12345-0@lo:400: 00000100:00100000:0.0:1784044005.476627:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38427b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1870705580867200:12345-0@lo:400: Request processed in 43us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044005.476633:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1784044005.476643:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1784044005.476648:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38427b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1870705580867712:12345-0@lo:400: 00000100:00100000:0.0:1784044005.476668:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38427b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1870705580867712:12345-0@lo:400: Request processed in 21us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044005.476673:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1784044005.476686:0:7768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580867328 00000100:00100000:0.0:1784044005.476689:0:7768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580867328 00000100:00100000:0.0:1784044005.476709:0:7768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1784044005.476715:0:7768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38427b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1870705580867328:12345-0@lo:400: 00000100:00100000:0.0:1784044005.476740:0:7768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38427b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1870705580867328:12345-0@lo:400: Request processed in 26us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044005.476746:0:7768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1784044005.476781:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b38427b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1870705580867328:0@lo:400: 00010000:00080000:0.0:1784044005.476794:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b38427b5500 x1870705580867200/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044021 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784044005.476805:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b38427b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1870705580867200:0@lo:400: 00010000:00080000:0.0:1784044005.476826:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b38427b5c00 x1870705580867712/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044021 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784044005.476834:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b38427b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1870705580867712:0@lo:400: 00010000:00080000:0.0:1784044005.476872:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b38427b4380 x1870705580867456/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044021 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784044005.476881:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b38427b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3639:1870705580867456:0@lo:400: 00000100:00100000:0.0:1784044005.476891:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b38427b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:3639:1870705580867072:0@lo:400: 00010000:00080000:0.0:1784044005.476902:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b38427b6680 x1870705580867584/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044021 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784044005.476910:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b38427b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3639:1870705580867584:0@lo:400: 00000100:00080000:1.0:1784044005.477145:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1784044005.477150:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1784044005.477153:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1784044006.037695:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784044007.055158:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784044008.077512:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784044009.102376:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784044009.550550:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784044009.550579:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397aa57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1870705580867840:0@lo:41: 00000100:00100000:1.0:1784044009.550834:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044009.552290:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580867840 00000100:00100000:3.0:1784044009.552301:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580867840 00000100:00100000:3.0:1784044009.552386:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1784044009.552399:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397aa54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1870705580867840:12345-0@lo:41: 00000004:00000024:3.0:1784044009.552442:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:3.0:1784044009.552533:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397aa54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1870705580867840:12345-0@lo:41: Request processed in 136us (1699us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044009.552541:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1784044009.553212:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397aa57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1870705580867840:0@lo:41: 00010000:00010000:0.0:1784044010.126206:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784044010.574122:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b38427b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1870705580868352:0@lo:400: 00000100:00100000:0.0:1784044010.574134:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b38427b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:3638:1870705580867968:0@lo:400: 00000100:00100000:3.0:1784044010.574212:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b38427b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3641:1870705580868480:0@lo:400: 00000100:00100000:0.0:1784044010.574230:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044010.574232:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044010.574312:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044010.574351:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580867968 00000100:00100000:3.0:1784044010.574359:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580867968 00000100:00100000:3.0:1784044010.574416:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1784044010.574426:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3970edfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+21:3638:x1870705580867968:12345-0@lo:400: 00000100:00100000:0.0:1784044010.574431:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3842704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1870705580868096:0@lo:13: 00000100:00100000:3.0:1784044010.574486:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3970edfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+21:3638:x1870705580867968:12345-0@lo:400: Request processed in 62us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044010.574495:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044010.574501:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1784044010.574524:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b38427b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1870705580868608:0@lo:400: 00000100:00100000:3.0:1784044010.574538:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580868480 00000100:00100000:3.0:1784044010.574543:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580868480 00000100:00100000:0.0:1784044010.574552:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044010.574574:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1784044010.574575:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b38427b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1870705580869120:0@lo:400: 00000100:00100000:3.0:1784044010.574584:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38420a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1870705580868480:12345-0@lo:400: 00000100:00100000:0.0:1784044010.574600:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044010.574627:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38420a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1870705580868480:12345-0@lo:400: Request processed in 45us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044010.574634:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1784044010.574645:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580869120 00000100:00100000:0.0:1784044010.574646:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b38427b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:3638:1870705580867968:0@lo:400: 00000100:00100000:3.0:1784044010.574649:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580869120 00000100:00100000:0.0:1784044010.574665:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1784044010.574674:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b38427b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1870705580868224:0@lo:400: 00000100:00100000:3.0:1784044010.574680:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1784044010.574688:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39503bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1870705580869120:12345-0@lo:400: 00000100:00100000:3.0:1784044010.574719:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39503bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1870705580869120:12345-0@lo:400: Request processed in 32us (120us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044010.574725:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1784044010.574754:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580868352 00000100:00100000:3.0:1784044010.574757:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580868352 00000100:00100000:3.0:1784044010.574775:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580868608 00000100:00100000:3.0:1784044010.574777:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580868608 00000100:00100000:3.0:1784044010.574788:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1784044010.574793:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3842705880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1870705580868352:12345-0@lo:400: 00000100:00100000:3.0:1784044010.574821:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3842705880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1870705580868352:12345-0@lo:400: Request processed in 28us (589us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044010.574826:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1784044010.574836:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1784044010.574840:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38427b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1870705580868608:12345-0@lo:400: 00000100:00100000:3.0:1784044010.574860:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38427b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1870705580868608:12345-0@lo:400: Request processed in 20us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044010.574865:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:3.0:1784044010.574879:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1784044010.574934:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b38427b5c00 x1870705580868480/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044026 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784044010.574946:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b38427b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3641:1870705580868480:0@lo:400: 00000100:00100000:3.0:1784044010.574953:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b38427b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3641:1870705580868992:0@lo:400: 00000100:00100000:0.0:1784044010.575009:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044010.575052:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b38427b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1870705580868736:0@lo:400: 00000100:00100000:0.0:1784044010.575077:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044010.575100:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b38427b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1870705580868608:0@lo:400: 00000100:00100000:2.0:1784044010.575108:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b38427b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1870705580868352:0@lo:400: 00010000:00080000:0.0:1784044010.575109:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b38427b4a80 x1870705580869120/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044026 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784044010.575118:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b38427b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1870705580869120:0@lo:400: 00000100:00100000:2.0:1784044010.575122:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b38427b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1870705580868864:0@lo:400: 00000100:00100000:0.0:1784044010.575127:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784044010.575133:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b38420ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1870705580869248:0@lo:13: 00000100:00100000:2.0:1784044010.575172:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044010.575226:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580868736 00000100:00100000:2.0:1784044010.575231:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580868736 00000100:00100000:2.0:1784044010.575260:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580868864 00000100:00100000:2.0:1784044010.575263:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580868864 00000100:00100000:2.0:1784044010.575278:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1784044010.575284:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39503bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1870705580868736:12345-0@lo:400: 00000100:00100000:2.0:1784044010.575372:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39503bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1870705580868736:12345-0@lo:400: Request processed in 87us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044010.575379:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1784044010.575391:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1784044010.575397:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3842706d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1870705580868864:12345-0@lo:400: 00000100:00100000:2.0:1784044010.575429:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3842706d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1870705580868864:12345-0@lo:400: Request processed in 32us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044010.575436:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:2.0:1784044010.575453:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1784044010.575467:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b38427b4700 x1870705580868864/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784044026 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784044010.575476:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b38427b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1870705580868864:0@lo:400: 00000100:00100000:3.0:1784044010.575540:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044010.575578:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580868224 00000100:00100000:3.0:1784044010.575582:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580868224 00000100:00100000:3.0:1784044010.575599:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580868992 00000100:00100000:3.0:1784044010.575602:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580868992 00000100:00100000:3.0:1784044010.575622:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1784044010.575630:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39503bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1870705580868224:12345-0@lo:400: 00000100:00100000:2.0:1784044010.575638:0:6511:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1784044010.575648:0:6511:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00080000:2.0:1784044010.575732:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784044010.575756:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1784044010.575764:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38420a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1870705580868992:12345-0@lo:400: 00000100:00100000:2.0:1784044010.575801:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38420a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1870705580868992:12345-0@lo:400: Request processed in 38us (261us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044010.575817:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1784044010.575925:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1784044010.575951:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b38427b7100 x1870705580868736/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784044026 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784044010.575961:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b38427b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1870705580868736:0@lo:400: 00000100:00100000:0.0:1784044010.575985:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580868096 00000100:00100000:0.0:1784044010.575989:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580868096 00000100:00100000:0.0:1784044010.576006:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580869248 00000100:00100000:0.0:1784044010.576009:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580869248 00000100:00100000:0.0:1784044010.576020:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1784044010.576025:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38427b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1870705580868096:12345-0@lo:13: 00002000:00000024:0.0:1784044010.576044:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784044010.576080:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38427b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1870705580868096:12345-0@lo:13: Request processed in 53us (1588us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044010.576086:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1784044010.576097:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1784044010.576104:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38427b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1870705580869248:12345-0@lo:13: 00002000:00000024:0.0:1784044010.576115:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784044010.576139:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38427b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1870705580869248:12345-0@lo:13: Request processed in 36us (216us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044010.576258:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39503bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1870705580868224:12345-0@lo:400: Request processed in 630us (1557us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044010.576283:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:3.0:1784044010.576317:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b38427b5180 x1870705580868992/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044026 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784044010.576327:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b38427b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3641:1870705580868992:0@lo:400: 00000100:00100000:0.0:1784044010.577023:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1784044010.577075:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b38420ab100 x1870705580869248/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784044026 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784044010.577090:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b38420ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1870705580869248:0@lo:13: 00010000:00080000:0.0:1784044010.577102:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b38427b5880 x1870705580868224/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044026 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784044010.577111:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b38427b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1870705580868224:0@lo:400: 00010000:00080000:0.0:1784044010.577122:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b3842704000 x1870705580868096/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784044026 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784044010.577133:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3842704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1870705580868096:0@lo:13: 00000100:00100000:2.0:1784044010.579422:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397aa57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1870705580869376:0@lo:41: 00000100:00100000:2.0:1784044010.579489:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044010.579672:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580869376 00000100:00100000:1.0:1784044010.579681:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580869376 00000100:00100000:1.0:1784044010.579747:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1784044010.579755:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3842705500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1870705580869376:12345-0@lo:41: 00000004:00000024:1.0:1784044010.579787:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:1.0:1784044010.579843:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3842705500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1870705580869376:12345-0@lo:41: Request processed in 89us (353us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044010.579850:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1784044010.579890:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397aa57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1870705580869376:0@lo:41: 00000020:01000004:1.0:1784044010.644917:0:9503:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1784044010.644921:0:9503:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:1.0:1784044010.644922:0:9503:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:1.0:1784044010.645055:0:9503:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9b384244a000 00000020:01000004:1.0:1784044010.645070:0:9503:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:1.0:1784044010.645084:0:9503:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1784044010.645109:0:9503:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9b384304b380) 00000020:00000080:1.0:1784044010.645128:0:9503:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1784044010.691770:0:9503:0:(scrub.c:229:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:2.0:1784044010.691881:0:9503:0:(scrub.c:229:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00080000:01000000:2.0:1784044010.705688:0:9503:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1784044010.706071:0:9503:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1784044010.706082:0:9503:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:2.0:1784044010.706093:0:9503:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x89871fc3aba17def 00000020:01000004:2.0:1784044010.706100:0:9503:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:2.0:1784044010.706120:0:9503:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.140@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1784044010.706123:0:9503:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.140@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1784044010.706129:0:9503:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1784044010.706353:0:9503:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:2.0:1784044010.706358:0:9503:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.140@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1784044010.732969:0:9503:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.140@tcp ctxt 0 is initialized 00000020:01000004:2.0:1784044010.733002:0:9503:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.202.140@tcp, index=0001, flags=0x20062 00000020:01000004:2.0:1784044010.733006:0:9503:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1784044010.733008:0:9503:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1784044010.733009:0:9503:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784044010.733011:0:9503:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784044010.733013:0:9503:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784044010.733014:0:9503:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784044010.733015:0:9503:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1784044010.733017:0:9503:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1784044010.733019:0:9503:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1784044010.733020:0:9503:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784044010.733021:0:9503:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1784044010.733025:0:9503:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:2.0:1784044010.733027:0:9503:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1784044010.733028:0:9503:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1784044010.733029:0:9503:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784044010.733030:0:9503:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784044010.733035:0:9503:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784044010.733036:0:9503:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784044010.733037:0:9503:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1784044010.733037:0:9503:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1784044010.733038:0:9503:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1784044010.733039:0:9503:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784044010.733040:0:9503:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1784044010.733071:0:9503:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1784044010.733091:0:9503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3842704000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:9503:1870705580869504:0@lo:253: 00000100:00100000:2.0:1784044010.733976:0:9503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044010.734029:0:9503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b38420db540 going to sleep for 11 seconds 00000100:00100000:3.0:1784044010.734047:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580869504 00000100:00100000:3.0:1784044010.734056:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580869504 00000100:00100000:3.0:1784044010.734115:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1784044010.734125:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3970eddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+21:9503:x1870705580869504:12345-0@lo:253: 20000000:01000000:3.0:1784044010.734167:0:6504:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1784044010.734172:0:6504:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:3.0:1784044010.734335:0:6504:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:3.0:1784044010.734339:0:6504:0:(mgs_llog.c:3858:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:3.0:1784044010.734625:0:6504:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1784044010.734736:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 20000000:01000000:3.0:1784044010.734750:0:6504:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:3.0:1784044010.734766:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 128 off8544 20000000:01000000:3.0:1784044010.734771:0:6504:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:3.0:1784044010.734782:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 112 off8656 00000040:00080000:3.0:1784044010.734795:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8880 00000040:00080000:3.0:1784044010.734870:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 20000000:01000000:3.0:1784044010.734884:0:6504:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.202.140@tcp 20000000:01000000:3.0:1784044010.734886:0:6504:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.140@tcp (null) (null) (null) 00000040:00080000:3.0:1784044010.734898:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 88 off14232 20000000:01000000:3.0:1784044010.734903:0:6504:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1784044010.734928:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 144 off14376 20000000:01000000:3.0:1784044010.734934:0:6504:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.202.140@tcp (null) (null) 00000040:00080000:3.0:1784044010.734944:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 152 off14528 20000000:01000000:3.0:1784044010.734950:0:6504:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:3.0:1784044010.734967:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 136 off14664 00000040:00080000:3.0:1784044010.734981:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14888 00000040:00080000:3.0:1784044010.735044:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].34, 224 off14176 20000000:01000000:3.0:1784044010.735053:0:6504:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.202.140@tcp 20000000:01000000:3.0:1784044010.735055:0:6504:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.140@tcp (null) (null) (null) 00000040:00080000:3.0:1784044010.735067:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].35, 88 off14264 20000000:01000000:3.0:1784044010.735072:0:6504:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1784044010.735083:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].36, 144 off14408 20000000:01000000:3.0:1784044010.735087:0:6504:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf003 lustre-OST0001_UUID 192.168.202.140@tcp (null) (null) 00000040:00080000:3.0:1784044010.735098:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].37, 152 off14560 20000000:01000000:3.0:1784044010.735102:0:6504:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:3.0:1784044010.735113:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].38, 136 off14696 00000040:00080000:3.0:1784044010.735126:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].39, 224 off14920 00000040:00080000:3.0:1784044010.736107:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14912 20000000:01000000:3.0:1784044010.736123:0:6504:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.202.140@tcp 20000000:01000000:3.0:1784044010.736125:0:6504:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.140@tcp (null) (null) (null) 00000040:00080000:3.0:1784044010.736137:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 88 off15000 20000000:01000000:3.0:1784044010.736143:0:6504:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1784044010.736477:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 128 off15128 20000000:01000000:3.0:1784044010.736485:0:6504:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.202.140@tcp (null) (null) 00000040:00080000:3.0:1784044010.736500:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].42, 144 off15272 20000000:01000000:3.0:1784044010.736506:0:6504:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:3.0:1784044010.736516:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].43, 128 off15400 00000040:00080000:3.0:1784044010.736530:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].44, 224 off15624 20000000:01000000:3.0:1784044010.736542:0:6504:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:3.0:1784044010.736544:0:6504:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1784044010.736548:0:6504:0:(mgs_llog.c:4177:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1784044010.736589:0:6504:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1784044010.736591:0:6504:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1784044010.737492:0:9509:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 31 marker 25 1->4: lustre sys.timeout 20000000:01000000:3.0:1784044010.737516:0:9509:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 33 marker 25 2->4: lustre sys.timeout 00000040:00080000:3.0:1784044010.737538:0:9509:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 40 count 40 00000040:00080000:2.0:1784044010.737971:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 224 off15112 00000040:00080000:2.0:1784044010.737997:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 80 off15192 00000040:00080000:2.0:1784044010.738026:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 224 off15416 20000000:01000000:2.0:1784044010.738039:0:6504:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:2.0:1784044010.738041:0:6504:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:3.0:1784044010.738525:0:9510:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 5 count 5 00000040:00080000:0.0:1784044010.743933:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9104 00000040:00080000:0.0:1784044010.743964:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 80 off9184 00000040:00080000:0.0:1784044010.743979:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9408 20000000:01000000:0.0:1784044010.743991:0:6504:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1784044010.743994:0:6504:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1784044010.745509:0:9511:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 26 1->4: lustre sys.timeout 20000000:01000000:1.0:1784044010.745559:0:9511:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 26 2->4: lustre sys.timeout 00000040:00080000:1.0:1784044010.745590:0:9511:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:2.0:1784044010.745769:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:2.0:1784044010.745803:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 80 off9712 00000040:00080000:2.0:1784044010.745826:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9936 20000000:01000000:2.0:1784044010.745844:0:6504:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:2.0:1784044010.745846:0:6504:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:0.0:1784044010.746369:0:9512:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 31 marker 27 1->4: lustre sys.timeout 20000000:01000000:0.0:1784044010.746451:0:9512:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 33 marker 27 2->4: lustre sys.timeout 00000040:00080000:0.0:1784044010.746467:0:9512:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 40 count 40 00000040:00080000:2.0:1784044010.746572:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].40, 224 off15144 00000040:00080000:2.0:1784044010.746590:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].41, 80 off15224 00000040:00080000:2.0:1784044010.746603:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].42, 224 off15448 20000000:01000000:2.0:1784044010.746610:0:6504:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1784044010.746613:0:6504:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:2.0:1784044010.747277:0:9513:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 36 marker 28 1->4: lustre sys.timeout 20000000:01000000:2.0:1784044010.747297:0:9513:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 38 marker 28 2->4: lustre sys.timeout 00000040:00080000:2.0:1784044010.747311:0:9513:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 45 count 45 00000040:00080000:0.0:1784044010.747467:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].45, 224 off15848 00000040:00080000:0.0:1784044010.747485:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].46, 80 off15928 00000040:00080000:0.0:1784044010.747498:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].47, 224 off16152 10000000:01000000:0.0:1784044010.747513:0:6504:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1784044010.747532:0:6504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b3982054c00/0x89871fc3aba17df6 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044010.747549:0:6504:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b3982054800/0x89871fc3aba17cde lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x89871fc3aba17cd7 expref: 21 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044010.747568:0:6504:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b394166bc00/0x89871fc3aba17cfa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x89871fc3aba17cec expref: 21 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044010.747576:0:6504:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b3965d1c800/0x89871fc3aba17d08 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x89871fc3aba17d01 expref: 21 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044010.747583:0:6504:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b3982054600/0x89871fc3aba17d39 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x89871fc3aba17d32 expref: 21 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044010.747590:0:6504:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b3982055c00/0x89871fc3aba17d47 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x89871fc3aba17d40 expref: 21 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044010.747596:0:6504:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b3965d1d800/0x89871fc3aba17d6a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x89871fc3aba17d63 expref: 21 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044010.747603:0:6504:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b3965d1d600/0x89871fc3aba17d86 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x89871fc3aba17d7f expref: 21 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044010.747611:0:6504:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b3982054c00/0x89871fc3aba17df6 lrc: 10/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044010.747648:0:6504:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b3965d1d600/0x89871fc3aba17d86 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x89871fc3aba17d7f expref: 21 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044010.747661:0:6504:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b3965d1d600/0x89871fc3aba17d86 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x89871fc3aba17d7f expref: 21 pid: 6505 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044010.747675:0:6504:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b38427b5880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6504:1870705580869632:0@lo:104: 00000100:00100000:0.0:1784044010.747735:0:6504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1784044010.747789:0:6504:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b3965d1d800/0x89871fc3aba17d6a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x89871fc3aba17d63 expref: 21 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044010.747798:0:6504:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b3965d1d800/0x89871fc3aba17d6a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x89871fc3aba17d63 expref: 21 pid: 6505 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044010.747807:0:6504:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b38427b4700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6504:1870705580869760:0@lo:104: 00000100:00100000:0.0:1784044010.747828:0:6504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1784044010.747885:0:6504:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b3982055c00/0x89871fc3aba17d47 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x89871fc3aba17d40 expref: 21 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044010.747894:0:6504:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b3982055c00/0x89871fc3aba17d47 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x89871fc3aba17d40 expref: 21 pid: 6504 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044010.747920:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580869632 00000100:00100000:3.0:1784044010.747926:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580869632 00000100:00100000:3.0:1784044010.747954:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580869760 00000100:00100000:3.0:1784044010.747956:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580869760 00000100:00100000:3.0:1784044010.747968:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1784044010.747975:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38427b7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+4:6504:x1870705580869632:12345-0@lo:104: 00010000:00010000:3.0:1784044010.747987:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.140@tcp lock: ffff9b394166b600/0x89871fc3aba17d7f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x89871fc3aba17d86 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044010.748038:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1784044010.748043:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38427b7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+4:6504:x1870705580869632:12345-0@lo:104: Request processed in 69us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044010.748050:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1784044010.748065:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1784044010.748071:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38427b4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+3:6504:x1870705580869760:12345-0@lo:104: 00010000:00010000:3.0:1784044010.748077:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.140@tcp lock: ffff9b3965d1c000/0x89871fc3aba17d63 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x89871fc3aba17d6a expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044010.748106:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1784044010.748111:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38427b4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+3:6504:x1870705580869760:12345-0@lo:104: Request processed in 41us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044010.748116:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00010000:3.0:1784044010.748130:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1784044010.748136:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: ffff9b394166b600/0x89871fc3aba17d7f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x89871fc3aba17d86 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044010.748143:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b394166b600 already unused, calling callback (ffffffffc113cc20) 10000000:00010000:3.0:1784044010.748166:0:6499:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: ffff9b394166b600/0x89871fc3aba17d7f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x89871fc3aba17d86 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044010.748191:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9b394166b600/0x89871fc3aba17d7f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x89871fc3aba17d86 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784044010.748199:0:6499:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9b394166b600/0x89871fc3aba17d7f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x89871fc3aba17d86 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784044010.748205:0:6499:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1784044010.748230:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.140@tcp lock: ffff9b394166b600/0x89871fc3aba17d7f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x89871fc3aba17d86 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044010.748236:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784044010.748253:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: ffff9b394166b600/0x89871fc3aba17d7f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x89871fc3aba17d86 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044010.748260:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9b394166b600/0x89871fc3aba17d7f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x89871fc3aba17d86 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044010.748283:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784044010.748287:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: ffff9b3965d1c000/0x89871fc3aba17d63 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x89871fc3aba17d6a expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044010.748292:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3965d1c000 already unused, calling callback (ffffffffc113cc20) 10000000:00010000:3.0:1784044010.748295:0:6499:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: ffff9b3965d1c000/0x89871fc3aba17d63 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x89871fc3aba17d6a expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044010.748302:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9b3965d1c000/0x89871fc3aba17d63 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x89871fc3aba17d6a expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784044010.748318:0:6499:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9b3965d1c000/0x89871fc3aba17d63 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x89871fc3aba17d6a expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784044010.748323:0:6499:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1784044010.748335:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.140@tcp lock: ffff9b3965d1c000/0x89871fc3aba17d63 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x89871fc3aba17d6a expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044010.748341:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784044010.748355:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: ffff9b3965d1c000/0x89871fc3aba17d63 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x89871fc3aba17d6a expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044010.748362:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9b3965d1c000/0x89871fc3aba17d63 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x89871fc3aba17d6a expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044010.748371:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784044010.748373:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784044010.748375:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784044010.748463:0:6504:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b38427b4a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6504:1870705580869888:0@lo:104: 00000100:00100000:0.0:1784044010.748487:0:6504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1784044010.748508:0:6504:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b3982054600/0x89871fc3aba17d39 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x89871fc3aba17d32 expref: 21 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044010.748517:0:6504:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b3982054600/0x89871fc3aba17d39 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x89871fc3aba17d32 expref: 21 pid: 6505 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044010.748526:0:6504:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b38427b6680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6504:1870705580870272:0@lo:104: 00000100:00100000:0.0:1784044010.748542:0:6504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1784044010.748567:0:6504:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b3965d1c800/0x89871fc3aba17d08 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x89871fc3aba17d01 expref: 21 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044010.748575:0:6504:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b3965d1c800/0x89871fc3aba17d08 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x89871fc3aba17d01 expref: 21 pid: 6505 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044010.748584:0:6504:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b384316df80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6504:1870705580870400:0@lo:104: 00000100:00100000:0.0:1784044010.748609:0:6504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1784044010.748622:0:6504:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b394166bc00/0x89871fc3aba17cfa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x89871fc3aba17cec expref: 21 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044010.748630:0:6504:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b394166bc00/0x89871fc3aba17cfa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x89871fc3aba17cec expref: 21 pid: 6504 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044010.748638:0:6504:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b384316c700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6504:1870705580870528:0@lo:104: 00010000:00010000:0.0:1784044010.748655:0:6504:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b3982054800/0x89871fc3aba17cde lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x89871fc3aba17cd7 expref: 21 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044010.748663:0:6504:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b3982054800/0x89871fc3aba17cde lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x89871fc3aba17cd7 expref: 21 pid: 6506 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044010.748671:0:6504:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b384316d180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6504:1870705580870656:0@lo:104: 00000100:00100000:0.0:1784044010.748684:0:6504:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b397ab49600 going to sleep for 11 seconds 00000100:00100000:0.0:1784044010.748701:0:6504:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b38427b5880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6504:1870705580869632:0@lo:104: 00000100:00100000:0.0:1784044010.748708:0:6504:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b38427b4700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6504:1870705580869760:0@lo:104: 00010000:00010000:1.0:1784044010.748769:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784044010.748856:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b38420aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:3641:1870705580870016:0@lo:103: 00000100:00100000:3.0:1784044010.748882:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044010.748946:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b38420a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:3638:1870705580870144:0@lo:103: 00000100:00100000:3.0:1784044010.748966:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044010.749038:0:6495:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1784044010.749051:0:6495:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044010.749060:0:6495:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044010.749068:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580869888 00000100:00100000:3.0:1784044010.749071:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580869888 00000100:00100000:3.0:1784044010.749086:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580870272 00000100:00100000:3.0:1784044010.749088:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580870272 00000100:00100000:3.0:1784044010.749095:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580870400 00000100:00100000:3.0:1784044010.749102:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580870400 00000100:00100000:3.0:1784044010.749116:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580870528 00000100:00100000:3.0:1784044010.749118:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580870528 00000100:00100000:3.0:1784044010.749125:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580870656 00000100:00100000:3.0:1784044010.749127:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580870656 00000100:00100000:3.0:1784044010.749136:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1784044010.749142:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38427b5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+7:6504:x1870705580869888:12345-0@lo:104: 00010000:00010000:3.0:1784044010.749162:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.140@tcp lock: ffff9b394166be00/0x89871fc3aba17d40 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x89871fc3aba17d47 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044010.749472:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1784044010.749479:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38427b5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+7:6504:x1870705580869888:12345-0@lo:104: Request processed in 337us (991us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044010.749485:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1784044010.749499:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1784044010.749505:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38427b5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+6:6504:x1870705580870272:12345-0@lo:104: 00010000:00010000:3.0:1784044010.749513:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.140@tcp lock: ffff9b394166ac00/0x89871fc3aba17d32 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x89871fc3aba17d39 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044010.749539:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1784044010.749543:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38427b5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+6:6504:x1870705580870272:12345-0@lo:104: Request processed in 39us (1000us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044010.749548:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1784044010.749558:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1784044010.749563:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397d764450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+5:6504:x1870705580870400:12345-0@lo:104: 00010000:00010000:3.0:1784044010.749569:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.140@tcp lock: ffff9b3982055200/0x89871fc3aba17d01 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x89871fc3aba17d08 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044010.749590:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1784044010.749599:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397d764450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+5:6504:x1870705580870400:12345-0@lo:104: Request processed in 36us (990us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044010.749604:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1784044010.749630:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1784044010.749635:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38420ab480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+4:6504:x1870705580870528:12345-0@lo:104: 00010000:00010000:3.0:1784044010.749642:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.140@tcp lock: ffff9b3982054e00/0x89871fc3aba17cec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x89871fc3aba17cfa expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044010.749664:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:3.0:1784044010.749668:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38420ab480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+4:6504:x1870705580870528:12345-0@lo:104: Request processed in 33us (616us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044010.749672:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1784044010.749682:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1784044010.749687:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38420ab100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+3:6504:x1870705580870656:12345-0@lo:104: 00010000:00010000:3.0:1784044010.749693:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.140@tcp lock: ffff9b3982055000/0x89871fc3aba17cd7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x89871fc3aba17cde expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044010.749712:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:3.0:1784044010.749716:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38420ab100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+3:6504:x1870705580870656:12345-0@lo:104: Request processed in 30us (655us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044010.749721:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00010000:3.0:1784044010.749734:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1784044010.749738:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: ffff9b394166be00/0x89871fc3aba17d40 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x89871fc3aba17d47 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044010.749745:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b394166be00 already unused, calling callback (ffffffffc113cc20) 10000000:00010000:3.0:1784044010.749749:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: ffff9b394166be00/0x89871fc3aba17d40 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x89871fc3aba17d47 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044010.749766:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9b394166be00/0x89871fc3aba17d40 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x89871fc3aba17d47 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784044010.749773:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9b394166be00/0x89871fc3aba17d40 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x89871fc3aba17d47 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784044010.749779:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1784044010.749799:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.140@tcp lock: ffff9b394166be00/0x89871fc3aba17d40 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x89871fc3aba17d47 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044010.749805:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784044010.749815:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: ffff9b394166be00/0x89871fc3aba17d40 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x89871fc3aba17d47 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044010.749823:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9b394166be00/0x89871fc3aba17d40 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x89871fc3aba17d47 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044010.749832:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1784044010.749836:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: ffff9b394166ac00/0x89871fc3aba17d32 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x89871fc3aba17d39 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044010.749841:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b394166ac00 already unused, calling callback (ffffffffc113cc20) 10000000:00010000:3.0:1784044010.749844:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: ffff9b394166ac00/0x89871fc3aba17d32 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x89871fc3aba17d39 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044010.749851:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9b394166ac00/0x89871fc3aba17d32 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x89871fc3aba17d39 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784044010.749858:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9b394166ac00/0x89871fc3aba17d32 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x89871fc3aba17d39 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784044010.749867:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1784044010.749878:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.140@tcp lock: ffff9b394166ac00/0x89871fc3aba17d32 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x89871fc3aba17d39 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044010.749884:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784044010.749893:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: ffff9b394166ac00/0x89871fc3aba17d32 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x89871fc3aba17d39 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044010.749899:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9b394166ac00/0x89871fc3aba17d32 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x89871fc3aba17d39 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044010.749908:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1784044010.749911:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: ffff9b3982055200/0x89871fc3aba17d01 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x89871fc3aba17d08 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044010.749917:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3982055200 already unused, calling callback (ffffffffc113cc20) 10000000:00010000:3.0:1784044010.749919:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: ffff9b3982055200/0x89871fc3aba17d01 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x89871fc3aba17d08 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044010.749926:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9b3982055200/0x89871fc3aba17d01 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x89871fc3aba17d08 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784044010.749933:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9b3982055200/0x89871fc3aba17d01 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x89871fc3aba17d08 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784044010.749938:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1784044010.749946:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.140@tcp lock: ffff9b3982055200/0x89871fc3aba17d01 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x89871fc3aba17d08 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044010.749952:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784044010.749960:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: ffff9b3982055200/0x89871fc3aba17d01 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x89871fc3aba17d08 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044010.749967:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9b3982055200/0x89871fc3aba17d01 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x89871fc3aba17d08 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044010.749975:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1784044010.749978:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: ffff9b3982054e00/0x89871fc3aba17cec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x89871fc3aba17cfa expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044010.749983:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3982054e00 already unused, calling callback (ffffffffc113cc20) 10000000:00010000:3.0:1784044010.749987:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: ffff9b3982054e00/0x89871fc3aba17cec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x89871fc3aba17cfa expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044010.749992:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9b3982054e00/0x89871fc3aba17cec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x89871fc3aba17cfa expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784044010.749998:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9b3982054e00/0x89871fc3aba17cec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x89871fc3aba17cfa expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784044010.750004:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1784044010.750013:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.140@tcp lock: ffff9b3982054e00/0x89871fc3aba17cec lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x89871fc3aba17cfa expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044010.750018:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784044010.750022:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: ffff9b3982054e00/0x89871fc3aba17cec lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x89871fc3aba17cfa expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044010.750029:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9b3982054e00/0x89871fc3aba17cec lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x89871fc3aba17cfa expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044010.750040:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784044010.750047:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: ffff9b3982055000/0x89871fc3aba17cd7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x89871fc3aba17cde expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044010.750054:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3982055000 already unused, calling callback (ffffffffc113cc20) 10000000:00010000:3.0:1784044010.750057:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: ffff9b3982055000/0x89871fc3aba17cd7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x89871fc3aba17cde expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044010.750065:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9b3982055000/0x89871fc3aba17cd7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x89871fc3aba17cde expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784044010.750071:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9b3982055000/0x89871fc3aba17cd7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x89871fc3aba17cde expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784044010.750076:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1784044010.750086:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.140@tcp lock: ffff9b3982055000/0x89871fc3aba17cd7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x89871fc3aba17cde expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044010.750091:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784044010.750095:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: ffff9b3982055000/0x89871fc3aba17cd7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x89871fc3aba17cde expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044010.750101:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9b3982055000/0x89871fc3aba17cd7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x89871fc3aba17cde expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044010.750112:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784044010.750114:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784044010.750116:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784044010.750126:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b38420a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:3640:1870705580870912:0@lo:103: 00000100:00100000:3.0:1784044010.750162:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1784044010.750240:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784044010.750276:0:6504:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b38427b4a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6504:1870705580869888:0@lo:104: 00000100:00100000:2.0:1784044010.750287:0:6504:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b38427b6680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6504:1870705580870272:0@lo:104: 00000100:00100000:1.0:1784044010.750293:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580870016 00000100:00100000:2.0:1784044010.750297:0:6504:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b384316df80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6504:1870705580870400:0@lo:104: 00000100:00100000:1.0:1784044010.750299:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580870016 00000100:00100000:2.0:1784044010.750315:0:6504:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b384316c700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6504:1870705580870528:0@lo:104: 00000100:00100000:2.0:1784044010.750326:0:6504:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b384316d180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6504:1870705580870656:0@lo:104: 00010000:00010000:1.0:1784044010.750326:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b3965d1d600/0x89871fc3aba17d86 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x89871fc3aba17d7f expref: 22 pid: 6505 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044010.750359:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580870144 00000100:00100000:1.0:1784044010.750362:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580870144 00010000:00010000:2.0:1784044010.750366:0:6504:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b3982054c00/0x89871fc3aba17df6 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044010.750375:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b3965d1d800/0x89871fc3aba17d6a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x89871fc3aba17d63 expref: 23 pid: 6505 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044010.750402:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1784044010.750407:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38420aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+23:3641:x1870705580870016:12345-0@lo:103: 00010000:00010000:1.0:1784044010.750416:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784044010.750421:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b3965d1d600/0x89871fc3aba17d86 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x89871fc3aba17d7f expref: 23 pid: 6505 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044010.750441:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b3965d1d600/0x89871fc3aba17d86 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x89871fc3aba17d7f expref: 23 pid: 6505 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044010.750454:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b3965d1d600/0x89871fc3aba17d86 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x89871fc3aba17d7f expref: 23 pid: 6505 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044010.750466:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784044010.750491:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38420aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+22:3641:x1870705580870016:12345-0@lo:103: Request processed in 84us (1607us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044010.750496:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1784044010.750509:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1784044010.750514:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38420a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+21:3638:x1870705580870144:12345-0@lo:103: 00010000:00010000:1.0:1784044010.750521:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784044010.750524:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b3965d1d800/0x89871fc3aba17d6a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x89871fc3aba17d63 expref: 21 pid: 6505 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044010.750533:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b3965d1d800/0x89871fc3aba17d6a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x89871fc3aba17d63 expref: 21 pid: 6505 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044010.750543:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b3965d1d800/0x89871fc3aba17d6a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x89871fc3aba17d63 expref: 21 pid: 6505 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044010.750550:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784044010.750567:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38420a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+20:3638:x1870705580870144:12345-0@lo:103: Request processed in 53us (1600us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044010.750573:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1784044010.751006:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784044010.751013:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b38420a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:3640:1870705580871040:0@lo:103: 00000100:00100000:3.0:1784044010.751053:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044010.751130:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b38420aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:3641:1870705580870016:0@lo:103: 00000100:00100000:0.0:1784044010.751171:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580870912 00000100:00100000:0.0:1784044010.751257:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580870912 00010000:00010000:0.0:1784044010.751282:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b3982054600/0x89871fc3aba17d39 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x89871fc3aba17d32 expref: 20 pid: 6505 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044010.751297:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580871040 00000100:00100000:0.0:1784044010.751300:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580871040 00010000:00010000:0.0:1784044010.751308:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b3965d1c800/0x89871fc3aba17d08 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x89871fc3aba17d01 expref: 21 pid: 6505 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044010.751319:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1784044010.751323:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38427b7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+21:3640:x1870705580870912:12345-0@lo:103: 00010000:00010000:0.0:1784044010.751336:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784044010.751341:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b3982054600/0x89871fc3aba17d39 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x89871fc3aba17d32 expref: 21 pid: 6505 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044010.751349:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b3982054600/0x89871fc3aba17d39 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x89871fc3aba17d32 expref: 21 pid: 6505 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044010.751360:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b3982054600/0x89871fc3aba17d39 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x89871fc3aba17d32 expref: 21 pid: 6505 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044010.751369:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784044010.751410:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38427b7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+20:3640:x1870705580870912:12345-0@lo:103: Request processed in 86us (1247us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044010.751417:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1784044010.751429:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1784044010.751433:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3944093850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+19:3640:x1870705580871040:12345-0@lo:103: 00010000:00010000:0.0:1784044010.751440:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784044010.751444:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b3965d1c800/0x89871fc3aba17d08 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x89871fc3aba17d01 expref: 19 pid: 6505 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044010.751452:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b3965d1c800/0x89871fc3aba17d08 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x89871fc3aba17d01 expref: 19 pid: 6505 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044010.751461:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b3965d1c800/0x89871fc3aba17d08 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x89871fc3aba17d01 expref: 19 pid: 6505 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044010.751470:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784044010.751486:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3944093850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+18:3640:x1870705580871040:12345-0@lo:103: Request processed in 53us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044010.751491:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1784044010.751913:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b38420a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:3639:1870705580870784:0@lo:103: 00000100:00100000:3.0:1784044010.751938:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044010.751987:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b38420a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:3639:1870705580871296:0@lo:103: 00000100:00100000:3.0:1784044010.752006:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044010.752075:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b38420a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:3640:1870705580871040:0@lo:103: 00000100:00100000:2.0:1784044010.752084:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b38420a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:3640:1870705580870912:0@lo:103: 00000100:00100000:3.0:1784044010.752100:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1784044010.752108:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b38420aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:3639:1870705580871168:0@lo:103: 00000100:00100000:3.0:1784044010.752127:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044010.752197:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580870784 00000100:00100000:0.0:1784044010.752201:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580870784 00010000:00010000:0.0:1784044010.752216:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b3982055c00/0x89871fc3aba17d47 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x89871fc3aba17d40 expref: 18 pid: 6504 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044010.752235:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580871296 00000100:00100000:0.0:1784044010.752238:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580871296 00010000:00010000:0.0:1784044010.752246:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b3982054800/0x89871fc3aba17cde lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x89871fc3aba17cd7 expref: 19 pid: 6506 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044010.752257:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1784044010.752261:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38427b4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+19:3639:x1870705580870784:12345-0@lo:103: 00010000:00010000:0.0:1784044010.752357:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784044010.752364:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b3982055c00/0x89871fc3aba17d47 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x89871fc3aba17d40 expref: 19 pid: 6504 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044010.752374:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b3982055c00/0x89871fc3aba17d47 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x89871fc3aba17d40 expref: 19 pid: 6504 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044010.752441:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b3982055c00/0x89871fc3aba17d47 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x89871fc3aba17d40 expref: 19 pid: 6504 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044010.752451:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784044010.752475:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38427b4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+18:3639:x1870705580870784:12345-0@lo:103: Request processed in 213us (536us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044010.752481:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1784044010.752493:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1784044010.752498:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38427b5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+17:3639:x1870705580871296:12345-0@lo:103: 00010000:00010000:0.0:1784044010.752505:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784044010.752508:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b3982054800/0x89871fc3aba17cde lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x89871fc3aba17cd7 expref: 17 pid: 6506 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044010.752522:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b3982054800/0x89871fc3aba17cde lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x89871fc3aba17cd7 expref: 17 pid: 6506 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044010.752532:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b3982054800/0x89871fc3aba17cde lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x89871fc3aba17cd7 expref: 17 pid: 6506 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044010.752541:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784044010.752559:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38427b5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+16:3639:x1870705580871296:12345-0@lo:103: Request processed in 62us (553us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044010.752564:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1784044010.752636:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b38420a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:3639:1870705580870784:0@lo:103: 00000100:00100000:3.0:1784044010.752643:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b38420a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:3639:1870705580871296:0@lo:103: 00000100:00100000:3.0:1784044010.752666:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b38420a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:3638:1870705580870144:0@lo:103: 00000100:00100000:0.0:1784044010.752706:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580871168 00000100:00100000:0.0:1784044010.752709:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580871168 00010000:00010000:0.0:1784044010.752722:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b394166bc00/0x89871fc3aba17cfa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x89871fc3aba17cec expref: 16 pid: 6504 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044010.752735:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1784044010.752740:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38427b5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+16:3639:x1870705580871168:12345-0@lo:103: 00010000:00010000:0.0:1784044010.752746:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784044010.752750:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b394166bc00/0x89871fc3aba17cfa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x89871fc3aba17cec expref: 16 pid: 6504 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044010.752758:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b394166bc00/0x89871fc3aba17cfa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x89871fc3aba17cec expref: 16 pid: 6504 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044010.752768:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b394166bc00/0x89871fc3aba17cfa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x89871fc3aba17cec expref: 16 pid: 6504 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044010.752780:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b3982054c00/0x89871fc3aba17df6 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044010.752796:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b3982054c00/0x89871fc3aba17df6 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044010.752810:0:6498:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b3982054c00/0x89871fc3aba17df6 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044010.752817:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b3982054c00/0x89871fc3aba17df6 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044010.752825:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b3982054c00/0x89871fc3aba17df6 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044010.752832:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b3982054c00/0x89871fc3aba17df6 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044010.752838:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3982054c00 already unused, calling callback (ffffffffc0b56230) 00010000:00010000:0.0:1784044010.752842:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b3982054c00/0x89871fc3aba17df6 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044010.752849:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b3982054c00/0x89871fc3aba17df6 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044010.752872:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b3982054c00/0x89871fc3aba17df6 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044010.752882:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784044010.752915:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38427b5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+15:3639:x1870705580871168:12345-0@lo:103: Request processed in 175us (786us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044010.752922:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:3.0:1784044010.752966:0:6504:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b3982054c00/0x89871fc3aba17df6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044010.752974:0:6504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b3982054c00/0x89871fc3aba17df6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044010.752981:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b3982054c00/0x89871fc3aba17df6 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1784044010.752993:0:6504:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1784044010.753203:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b38420aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:3639:1870705580871168:0@lo:103: 00000100:00100000:2.0:1784044010.756347:0:9503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3842704000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:9503:1870705580869504:0@lo:253: 10000000:01000000:2.0:1784044010.756366:0:9503:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1784044010.756369:0:9503:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1784044010.756371:0:9503:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1784044010.756373:0:9503:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784044010.756374:0:9503:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:2.0:1784044010.756376:0:9503:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784044010.756377:0:9503:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784044010.756378:0:9503:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1784044010.756380:0:9503:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1784044010.756381:0:9503:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784044010.756383:0:9503:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1784044010.756402:0:9503:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9b384244a000 from lustre-OST0001 10000000:01000000:2.0:1784044010.756429:0:9503:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1784044010.756431:0:9503:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1784044010.756440:0:9503:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9b394402b380 local copy 10000000:01000000:2.0:1784044010.756444:0:9503:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00000100:00100000:3.0:1784044010.756468:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3970eddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+14:9503:x1870705580869504:12345-0@lo:253: Request processed in 22145us (22295us total) trans 0 rc 0/0 00010000:00010000:2.0:1784044010.756479:0:9503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b3965d1c600/0x89871fc3aba17dfd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044010.756480:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00010000:00010000:2.0:1784044010.756494:0:9503:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.202.140@tcp lock: ffff9b3965d1c600/0x89871fc3aba17dfd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044010.756513:0:9503:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9b3965d1c600/0x89871fc3aba17dfd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044010.756532:0:9503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3842704000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:9503:1870705580871424:0@lo:101: 00000100:00100000:2.0:1784044010.756566:0:9503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044010.756602:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580871424 00000100:00100000:2.0:1784044010.756604:0:9503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b38420db9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784044010.756615:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580871424 00000100:00100000:3.0:1784044010.756658:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1784044010.756666:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3965efcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+14:9503:x1870705580871424:12345-0@lo:101: 00010000:00010000:3.0:1784044010.756678:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784044010.756690:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b39759f9e00/0x89871fc3aba17e04 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x89871fc3aba17dfd expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044010.756711:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b39759f9e00/0x89871fc3aba17e04 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x89871fc3aba17dfd expref: 15 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044010.756722:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b39759f9e00/0x89871fc3aba17e04 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x89871fc3aba17dfd expref: 15 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044010.756731:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b39759f9e00, rc 0) 00000100:00100000:3.0:1784044010.756800:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3965efcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+15:9503:x1870705580871424:12345-0@lo:101: Request processed in 134us (232us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044010.756806:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1784044010.756857:0:9503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3842704000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:9503:1870705580871424:0@lo:101: 00010000:00010000:0.0:1784044010.756876:0:9503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9b3965d1c600/0x89871fc3aba17dfd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x89871fc3aba17e04 expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044010.756885:0:9503:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9b3965d1c600/0x89871fc3aba17dfd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x89871fc3aba17e04 expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044010.757020:0:9503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b384316ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:9503:1870705580871552:0@lo:501: 00000100:00100000:0.0:1784044010.757046:0:9503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044010.757066:0:9503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b397ab49c00 going to sleep for 11 seconds 00000100:00100000:3.0:1784044010.757105:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580871552 00000100:00100000:3.0:1784044010.757108:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580871552 00000100:00100000:3.0:1784044010.757135:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1784044010.757141:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3970edec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+15:9503:x1870705580871552:12345-0@lo:501: 00000100:00100000:3.0:1784044010.757356:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3970edec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+15:9503:x1870705580871552:12345-0@lo:501: Request processed in 213us (308us total) trans 0 rc -2/-2 00000100:00100000:3.0:1784044010.757363:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1784044010.757512:0:9503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b384316ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:9503:1870705580871552:0@lo:501: 10000000:01000000:0.0:1784044010.757523:0:9503:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.140@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1784044010.757539:0:9503:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.140@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1784044010.757544:0:9503:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b3965d1c600/0x89871fc3aba17dfd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x89871fc3aba17e04 expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044010.757552:0:9503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b3965d1c600/0x89871fc3aba17dfd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x89871fc3aba17e04 expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044010.757559:0:9503:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.140@tcp lock: ffff9b3965d1c600/0x89871fc3aba17dfd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x89871fc3aba17e04 expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044010.757629:0:9503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1784044010.757649:0:9503:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9b384244a000 10000000:01000000:0.0:1784044010.757653:0:9503:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1784044010.757658:0:9503:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1784044010.757661:0:9503:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1784044010.757665:0:9503:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:0.0:1784044010.757667:0:9503:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1784044010.757687:0:9503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b3982054600/0x89871fc3aba17e0b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044010.757695:0:9503:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9b3982054600/0x89871fc3aba17e0b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044010.757703:0:9503:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9b3982054600/0x89871fc3aba17e0b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044010.757713:0:9503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b384316ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:9503:1870705580871680:0@lo:101: 00000100:00100000:0.0:1784044010.757736:0:9503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044010.757761:0:9503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b397ab49600 going to sleep for 11 seconds 00000100:00100000:3.0:1784044010.757797:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580871680 00000100:00100000:3.0:1784044010.757801:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580871680 00000100:00100000:3.0:1784044010.757832:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1784044010.757837:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3965efd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+15:9503:x1870705580871680:12345-0@lo:101: 00010000:00010000:3.0:1784044010.757844:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784044010.757857:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b39759f9200/0x89871fc3aba17e12 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x89871fc3aba17e0b expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044010.757871:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b39759f9200/0x89871fc3aba17e12 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x89871fc3aba17e0b expref: 16 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044010.757880:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b39759f9200/0x89871fc3aba17e12 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x89871fc3aba17e0b expref: 16 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044010.757896:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b39759f9200, rc 0) 00000100:00100000:3.0:1784044010.757927:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3965efd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+16:9503:x1870705580871680:12345-0@lo:101: Request processed in 89us (190us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044010.757933:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1784044010.757986:0:9503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b384316ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:9503:1870705580871680:0@lo:101: 00010000:00010000:0.0:1784044010.757996:0:9503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9b3982054600/0x89871fc3aba17e0b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba17e12 expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044010.758004:0:9503:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9b3982054600/0x89871fc3aba17e0b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x89871fc3aba17e12 expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044010.758047:0:9503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b384316ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:9503:1870705580871808:0@lo:501: 00000100:00100000:0.0:1784044010.758070:0:9503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044010.758090:0:9503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b397ab49600 going to sleep for 11 seconds 00000100:00100000:2.0:1784044010.758113:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580871808 00000100:00100000:2.0:1784044010.758118:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580871808 00000100:00100000:2.0:1784044010.758161:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1784044010.758168:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3965efc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+16:9503:x1870705580871808:12345-0@lo:501: 00000100:00100000:2.0:1784044010.758302:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3965efc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+16:9503:x1870705580871808:12345-0@lo:501: Request processed in 134us (230us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044010.758311:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1784044010.758331:0:9503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b384316ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:9503:1870705580871808:0@lo:501: 00000100:00100000:0.0:1784044010.758359:0:9503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b384316ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:9503:1870705580871936:0@lo:503: 00000100:00100000:0.0:1784044010.758498:0:9503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044010.758522:0:9503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b397ab49600 going to sleep for 11 seconds 00000100:00100000:3.0:1784044010.758565:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580871936 00000100:00100000:3.0:1784044010.758569:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580871936 00000100:00100000:3.0:1784044010.758597:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1784044010.758603:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3965efbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+16:9503:x1870705580871936:12345-0@lo:503: 00000100:00100000:3.0:1784044010.758677:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3965efbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+16:9503:x1870705580871936:12345-0@lo:503: Request processed in 73us (178us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044010.758683:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1784044010.758748:0:9503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b384316ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:9503:1870705580871936:0@lo:503: 00000040:00080000:0.0:1784044010.758972:0:9503:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1784044010.759040:0:9503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b384316ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:9503:1870705580872064:0@lo:502: 00000100:00100000:0.0:1784044010.759068:0:9503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044010.759089:0:9503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b397ab49600 going to sleep for 11 seconds 00000100:00100000:3.0:1784044010.759133:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580872064 00000100:00100000:3.0:1784044010.759136:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580872064 00000100:00100000:3.0:1784044010.759199:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1784044010.759207:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3965efac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+16:9503:x1870705580872064:12345-0@lo:502: 00000100:00100000:3.0:1784044010.759265:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3965efac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+16:9503:x1870705580872064:12345-0@lo:502: Request processed in 59us (196us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044010.759364:0:9503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b384316ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:9503:1870705580872064:0@lo:502: 00000040:00080000:0.0:1784044010.759544:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1784044010.759567:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:0.0:1784044010.759580:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:0.0:1784044010.759591:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:0.0:1784044010.759603:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:0.0:1784044010.759614:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:0.0:1784044010.759631:0:9503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b384316ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:9503:1870705580872192:0@lo:502: 00000100:00100000:0.0:1784044010.759660:0:9503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044010.759679:0:9503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b397ab49600 going to sleep for 11 seconds 00000100:00100000:0.0:1784044010.759690:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580872192 00000100:00100000:0.0:1784044010.759693:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580872192 00000100:00100000:3.0:1784044010.759783:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00010000:00010000:1.0:1784044010.759915:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784044010.759923:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: ffff9b3965d1c600/0x89871fc3aba17dfd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x89871fc3aba17e04 expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044010.759936:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3965d1c600 already unused, calling callback (ffffffffc113cc20) 10000000:00010000:1.0:1784044010.759940:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: ffff9b3965d1c600/0x89871fc3aba17dfd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x89871fc3aba17e04 expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044010.759948:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9b3965d1c600/0x89871fc3aba17dfd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x89871fc3aba17e04 expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784044010.759956:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9b3965d1c600/0x89871fc3aba17dfd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x89871fc3aba17e04 expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784044010.759961:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:0.0:1784044010.760064:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1784044010.760071:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3965ef8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+16:9503:x1870705580872192:12345-0@lo:502: 00000100:00100000:0.0:1784044010.760262:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3965ef8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+16:9503:x1870705580872192:12345-0@lo:502: Request processed in 191us (601us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044010.760269:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00010000:00010000:0.0:1784044010.760309:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.140@tcp lock: ffff9b3965d1c600/0x89871fc3aba17dfd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x89871fc3aba17e04 expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044010.760316:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784044010.760338:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: ffff9b3965d1c600/0x89871fc3aba17dfd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x89871fc3aba17e04 expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044010.760345:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9b3965d1c600/0x89871fc3aba17dfd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x89871fc3aba17e04 expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044010.760366:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784044010.760368:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784044010.760370:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784044010.760483:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1784044010.760495:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b384316c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:3641:1870705580872320:0@lo:103: 00000100:00100000:3.0:1784044010.760526:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044010.760588:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580872320 00000100:00100000:0.0:1784044010.760592:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580872320 00000100:00100000:0.0:1784044010.760628:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1784044010.760634:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38427b7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+16:3641:x1870705580872320:12345-0@lo:103: 00010000:00010000:0.0:1784044010.760644:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784044010.760656:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b39759f9e00/0x89871fc3aba17e04 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x89871fc3aba17dfd expref: 16 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044010.760667:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784044010.760689:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38427b7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+15:3641:x1870705580872320:12345-0@lo:103: Request processed in 55us (163us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044010.760696:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1784044010.760746:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b384316c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:3641:1870705580872320:0@lo:103: 00000100:00100000:1.0:1784044010.760788:0:9503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b384316ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:9503:1870705580872192:0@lo:502: 00000040:00080000:1.0:1784044010.760834:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:1.0:1784044010.760843:0:9503:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 7 count 8 00000020:01000000:2.0:1784044010.762351:0:9514:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1784044010.762360:0:9514:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:2.0:1784044010.762365:0:9514:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784044010.762368:0:9514:0:(obd_config.c:1561:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:2.0:1784044010.762373:0:9514:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1784044010.762387:0:9514:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9b38424519c0) 00000020:00000080:2.0:1784044010.762408:0:9514:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type obdfilter with refcount 2 00000020:00000080:2.0:1784044010.762412:0:9514:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1784044010.762481:0:9514:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9b384244a000 from lustre-OST0001, refs=2 00080000:01000000:2.0:1784044010.762489:0:9514:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:2.0:1784044010.762496:0:9514:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x89871fc3aba17e20 00010000:00010000:3.0:1784044010.770642:0:9514:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:02000400:3.0:1784044010.771371:0:9514:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:3.0:1784044010.774768:0:9514:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:3.0:1784044010.776095:0:9514:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:3.0:1784044010.783770:0:9514:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:3.0:1784044010.783985:0:9514:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:3.0:1784044010.792832:0:9514:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0001: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:3.0:1784044010.794718:0:9514:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:3.0:1784044010.794731:0:9514:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784044010.794737:0:9514:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784044010.794739:0:9514:0:(obd_config.c:1561:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:3.0:1784044010.794742:0:9514:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784044010.794746:0:9514:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784044010.794748:0:9514:0:(obd_config.c:1561:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:3.0:1784044010.794751:0:9514:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1784044010.794753:0:9514:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1784044010.794773:0:9514:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784044010.794775:0:9514:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784044010.794777:0:9514:0:(obd_config.c:1561:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000040:00080000:3.0:1784044010.794780:0:9514:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:1.0:1784044010.794870:0:9503:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:1.0:1784044010.794904:0:9503:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1784044010.794924:0:9503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b3982054600/0x89871fc3aba17e0b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba17e12 expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044010.794937:0:9503:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9b3982054600/0x89871fc3aba17e0b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba17e12 expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784044010.794945:0:9503:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9b384244a000 from 1 10000000:01000000:1.0:1784044010.794948:0:9503:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1784044010.794981:0:9503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b394166bc00/0x89871fc3aba17e27 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044010.794989:0:9503:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9b394166bc00/0x89871fc3aba17e27 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044010.795008:0:9503:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9b394166bc00/0x89871fc3aba17e27 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044010.795032:0:9503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397aa57100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:9503:1870705580872448:0@lo:101: 00000100:00100000:1.0:1784044010.795105:0:9503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044010.795143:0:9503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b397b763000 going to sleep for 11 seconds 00000100:00100000:3.0:1784044010.796505:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580872448 00000100:00100000:3.0:1784044010.796516:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580872448 00000100:00100000:2.0:1784044010.796620:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1784044010.796631:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3965ef9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+15:9503:x1870705580872448:12345-0@lo:101: 00010000:00010000:2.0:1784044010.796652:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784044010.796665:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b3965d1c600/0x89871fc3aba17e2e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x89871fc3aba17e27 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044010.796698:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b3965d1c600/0x89871fc3aba17e2e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x89871fc3aba17e27 expref: 16 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044010.796709:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b3965d1c600/0x89871fc3aba17e2e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x89871fc3aba17e27 expref: 16 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044010.796718:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3965d1c600, rc 0) 00000100:00100000:2.0:1784044010.796776:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3965ef9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+16:9503:x1870705580872448:12345-0@lo:101: Request processed in 147us (1671us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044010.796783:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1784044010.797251:0:9503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397aa57100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:9503:1870705580872448:0@lo:101: 00010000:00010000:3.0:1784044010.797328:0:9503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9b394166bc00/0x89871fc3aba17e27 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba17e2e expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044010.797342:0:9503:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9b394166bc00/0x89871fc3aba17e27 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x89871fc3aba17e2e expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044010.797515:0:9503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b38427b6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:9503:1870705580872576:0@lo:501: 00000100:00100000:3.0:1784044010.797615:0:9503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044010.797649:0:9503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3843150540 going to sleep for 11 seconds 00000100:00100000:2.0:1784044010.797717:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580872576 00000100:00100000:2.0:1784044010.797722:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580872576 00000100:00100000:2.0:1784044010.797759:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1784044010.797765:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3965ef9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+16:9503:x1870705580872576:12345-0@lo:501: 00000100:00100000:2.0:1784044010.797968:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3965ef9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+16:9503:x1870705580872576:12345-0@lo:501: Request processed in 202us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044010.797975:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1784044010.801363:0:9503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b38427b6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:9503:1870705580872576:0@lo:501: 00000100:00100000:2.0:1784044010.801514:0:9503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3842707100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:9503:1870705580872704:0@lo:503: 00000100:00100000:2.0:1784044010.801587:0:9503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044010.801631:0:9503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b38420dbd80 going to sleep for 11 seconds 00000100:00100000:1.0:1784044010.801643:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580872704 00000100:00100000:1.0:1784044010.801650:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580872704 00000100:00100000:1.0:1784044010.801739:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1784044010.801750:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3965ef8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+16:9503:x1870705580872704:12345-0@lo:503: 00000100:00100000:1.0:1784044010.801868:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3965ef8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+16:9503:x1870705580872704:12345-0@lo:503: Request processed in 121us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044010.801876:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1784044010.801951:0:9503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3842707100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:9503:1870705580872704:0@lo:503: 00000040:00080000:0.0:1784044010.802216:0:9503:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1784044010.802290:0:9503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b384316f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:9503:1870705580872832:0@lo:502: 00000100:00100000:0.0:1784044010.802325:0:9503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044010.802621:0:9503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b397ab496c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784044010.802699:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580872832 00000100:00100000:3.0:1784044010.802705:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580872832 00000100:00100000:3.0:1784044010.802730:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1784044010.802737:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3965efa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+16:9503:x1870705580872832:12345-0@lo:502: 00000100:00100000:3.0:1784044010.802822:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3965efa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+16:9503:x1870705580872832:12345-0@lo:502: Request processed in 85us (497us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044010.802829:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1784044010.802954:0:9503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b384316f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:9503:1870705580872832:0@lo:502: 00000040:00080000:0.0:1784044010.803139:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:0.0:1784044010.803206:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:0.0:1784044010.803231:0:9503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b384316f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:9503:1870705580872960:0@lo:502: 00000100:00100000:0.0:1784044010.803261:0:9503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044010.803344:0:9503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b397ab496c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784044010.803462:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580872960 00000100:00100000:3.0:1784044010.803466:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580872960 00000100:00100000:3.0:1784044010.803498:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1784044010.803506:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3965ef8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+16:9503:x1870705580872960:12345-0@lo:502: 00000100:00100000:3.0:1784044010.803627:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3965ef8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+16:9503:x1870705580872960:12345-0@lo:502: Request processed in 121us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044010.803635:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1784044010.803955:0:9503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b384316f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:9503:1870705580872960:0@lo:502: 00000040:00080000:0.0:1784044010.803993:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:0.0:1784044010.804000:0:9503:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:0.0:1784044010.804576:0:9518:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784044010.804586:0:9518:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784044010.804589:0:9518:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1784044010.804595:0:9518:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9b384244a000 00000020:00000080:0.0:1784044010.804598:0:9518:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1784044010.804610:0:9518:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784044010.804612:0:9518:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784044010.804614:0:9518:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1784044010.804616:0:9518:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:3.0:1784044010.804809:0:9503:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1784044010.804840:0:9503:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1784044010.804944:0:9503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b394166bc00/0x89871fc3aba17e27 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba17e2e expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044010.804955:0:9503:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9b394166bc00/0x89871fc3aba17e27 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba17e2e expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784044010.805012:0:9503:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1784044010.805020:0:9503:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9b384244a000 10000000:01000000:3.0:1784044010.805023:0:9503:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9b384244a000 10000000:01000000:3.0:1784044010.805026:0:9503:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1784044010.805032:0:9503:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9b384244a000 from 1 10000000:01000000:3.0:1784044010.805034:0:9503:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1784044010.805059:0:9503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b39759f8400/0x89871fc3aba17e35 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044010.805068:0:9503:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9b39759f8400/0x89871fc3aba17e35 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044010.805077:0:9503:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9b39759f8400/0x89871fc3aba17e35 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044010.805092:0:9503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b38427b4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:9503:1870705580873088:0@lo:101: 00000100:00100000:3.0:1784044010.805127:0:9503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044010.805248:0:9503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3843150780 going to sleep for 11 seconds 00000100:00100000:1.0:1784044010.805449:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580873088 00000100:00100000:1.0:1784044010.805455:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580873088 00000100:00100000:1.0:1784044010.805533:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1784044010.805542:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3965efb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+16:9503:x1870705580873088:12345-0@lo:101: 00010000:00010000:1.0:1784044010.805552:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784044010.805565:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b394166ac00/0x89871fc3aba17e3c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x89871fc3aba17e35 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044010.805586:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b394166ac00/0x89871fc3aba17e3c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x89871fc3aba17e35 expref: 17 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044010.805600:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b394166ac00/0x89871fc3aba17e3c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x89871fc3aba17e35 expref: 17 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044010.805620:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b394166ac00, rc 0) 00000100:00100000:1.0:1784044010.805664:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3965efb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+17:9503:x1870705580873088:12345-0@lo:101: Request processed in 125us (536us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044010.805671:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1784044010.805745:0:9503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b38427b4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:9503:1870705580873088:0@lo:101: 00010000:00010000:2.0:1784044010.805761:0:9503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9b39759f8400/0x89871fc3aba17e35 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba17e3c expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044010.805772:0:9503:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9b39759f8400/0x89871fc3aba17e35 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x89871fc3aba17e3c expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044010.805882:0:9503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3842706a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:9503:1870705580873216:0@lo:501: 00000100:00100000:2.0:1784044010.805909:0:9503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044010.805929:0:9503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3975915a80 going to sleep for 11 seconds 00000100:00100000:1.0:1784044010.805962:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580873216 00000100:00100000:1.0:1784044010.805967:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580873216 00000100:00100000:1.0:1784044010.806023:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1784044010.806030:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3965ef9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+17:9503:x1870705580873216:12345-0@lo:501: 00000100:00100000:1.0:1784044010.806120:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3965ef9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+17:9503:x1870705580873216:12345-0@lo:501: Request processed in 90us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044010.806126:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1784044010.806204:0:9503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3842706a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:9503:1870705580873216:0@lo:501: 00000100:00100000:2.0:1784044010.806233:0:9503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3842706a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:9503:1870705580873344:0@lo:503: 00000100:00100000:2.0:1784044010.806266:0:9503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044010.806436:0:9503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3975915a80 going to sleep for 11 seconds 00000100:00100000:0.0:1784044010.806511:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580873344 00000100:00100000:0.0:1784044010.806567:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580873344 00000100:00100000:0.0:1784044010.806589:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1784044010.806596:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3965efa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+17:9503:x1870705580873344:12345-0@lo:503: 00000100:00100000:0.0:1784044010.806672:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3965efa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+17:9503:x1870705580873344:12345-0@lo:503: Request processed in 71us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044010.806679:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1784044010.806933:0:9503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3842706a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:9503:1870705580873344:0@lo:503: 00000040:00080000:2.0:1784044010.807531:0:9503:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1784044010.807588:0:9503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3842706a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:9503:1870705580873472:0@lo:502: 00000100:00100000:2.0:1784044010.807621:0:9503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044010.807649:0:9503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3975915a80 going to sleep for 11 seconds 00000100:00100000:0.0:1784044010.807918:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580873472 00000100:00100000:0.0:1784044010.807923:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580873472 00000100:00100000:0.0:1784044010.807953:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1784044010.807959:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3965efb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+17:9503:x1870705580873472:12345-0@lo:502: 00000100:00100000:0.0:1784044010.808043:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3965efb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+17:9503:x1870705580873472:12345-0@lo:502: Request processed in 82us (420us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044010.808049:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1784044010.808115:0:9503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3842706a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:9503:1870705580873472:0@lo:502: 00000040:00080000:2.0:1784044010.808405:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1784044010.808428:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1784044010.808440:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1784044010.808452:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1784044010.808462:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1784044010.808473:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1784044010.808485:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1784044010.808496:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1784044010.808507:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1784044010.808527:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1784044010.808539:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1784044010.808550:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1784044010.808562:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1784044010.808579:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1784044010.808590:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1784044010.808601:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1784044010.808612:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1784044010.808623:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1784044010.808634:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1784044010.808645:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1784044010.808656:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1784044010.808666:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1784044010.808678:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1784044010.808689:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1784044010.808700:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:2.0:1784044010.808718:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:2.0:1784044010.808731:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:2.0:1784044010.808741:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:2.0:1784044010.808753:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:2.0:1784044010.808763:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:2.0:1784044010.808775:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:2.0:1784044010.808785:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:2.0:1784044010.808810:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:2.0:1784044010.808822:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:2.0:1784044010.808834:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:2.0:1784044010.808844:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:2.0:1784044010.808864:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000040:00080000:2.0:1784044010.808876:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:2.0:1784044010.808888:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14912 00000040:00080000:2.0:1784044010.808898:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 88 off15000 00000040:00080000:2.0:1784044010.808909:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 128 off15128 00000040:00080000:2.0:1784044010.808929:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 144 off15272 00000040:00080000:2.0:1784044010.808941:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 128 off15400 00000040:00080000:2.0:1784044010.808951:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 224 off15624 00000040:00080000:2.0:1784044010.808963:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15848 00000040:00080000:2.0:1784044010.808973:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].46, 80 off15928 00000100:00100000:2.0:1784044010.808996:0:9503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3842706a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:9503:1870705580873600:0@lo:502: 00000100:00100000:2.0:1784044010.809030:0:9503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044010.809316:0:9503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3975915a80 going to sleep for 11 seconds 00000100:00100000:1.0:1784044010.809369:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580873600 00000100:00100000:1.0:1784044010.809375:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580873600 00000100:00100000:1.0:1784044010.809582:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1784044010.809590:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3965ef9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+17:9503:x1870705580873600:12345-0@lo:502: 00000100:00100000:1.0:1784044010.809670:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3965ef9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+17:9503:x1870705580873600:12345-0@lo:502: Request processed in 80us (638us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044010.809677:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1784044010.809695:0:9503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3842706a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:9503:1870705580873600:0@lo:502: 00000040:00080000:2.0:1784044010.809735:0:9503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].47, 224 off16152 00000040:00080000:2.0:1784044010.809742:0:9503:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 47 count 48 00000020:01000004:1.0:1784044010.810664:0:9519:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1784044010.810677:0:9519:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9b38430499c0) 00000020:00000080:1.0:1784044010.810698:0:9519:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type lwp with refcount 2 00000020:01000004:1.0:1784044010.810857:0:9519:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9b384244a000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1784044010.810862:0:9519:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9b384244a000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1784044010.810864:0:9519:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9b384244a000 3 00010000:00080000:1.0:1784044010.810899:0:9519:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9b384345d800@lustre-MDT0000-lwp-OST0001: add connection 192.168.202.140@tcp at head 00010000:00010000:3.0:1784044010.814614:0:9519:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-9 is initialized 00000020:00000080:3.0:1784044010.814722:0:9519:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1784044010.814766:0:9519:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1784044010.814778:0:9519:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x89871fc3aba17e4a 00000100:00080000:3.0:1784044010.814788:0:9519:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1784044010.814793:0:9519:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9b384345d800 using connection 192.168.202.140@tcp/0@lo 00000100:00100000:3.0:1784044010.814825:0:9519:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b38427b4700 x1870705580873728/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1784044010.814857:0:9519:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1784044010.815064:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b38427b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3637:1870705580873728:0@lo:38: 00000100:00100000:1.0:1784044010.815140:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044010.815352:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580873728 00000100:00100000:2.0:1784044010.815360:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580873728 00000100:00100000:2.0:1784044010.815456:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1784044010.815464:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397aa56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3637:x1870705580873728:12345-0@lo:38: 00010000:00080000:2.0:1784044010.815487:0:6511:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 203 last 0 00000020:00000080:2.0:1784044010.815515:0:6511:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x89871fc3aba17e51 00000020:01000004:3.0:1784044010.815555:0:9519:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1784044010.815577:0:9519:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff9b3843563380) 00000004:00100000:2.0:1784044010.815588:0:6511:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000020:00000080:3.0:1784044010.815595:0:9519:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type lwp with refcount 2 00000100:00080000:2.0:1784044010.815622:0:6511:0:(import.c:65:import_set_state_nolock()) ffff9b3843443800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784044010.815681:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397aa56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1870705580873728:12345-0@lo:38: Request processed in 216us (539us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044010.815689:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000020:01000004:2.0:1784044010.816250:0:9519:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9b384244a000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1784044010.816255:0:9519:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9b384244a000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1784044010.816258:0:9519:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9b384244a000 3 00010000:00080000:2.0:1784044010.816282:0:9519:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9b3843441000@lustre-MDT0001-lwp-OST0001: add connection 192.168.202.140@tcp at head 00010000:00080000:1.0:1784044010.817499:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b38427b4700 x1870705580873728/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784044020 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784044010.817513:0:3637:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1784044010.817521:0:3637:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:1.0:1784044010.817528:0:3637:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1784044010.817533:0:3637:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1784044010.817535:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9b384345d800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1784044010.817541:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b38427b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3637:1870705580873728:0@lo:38: 00000100:00100000:1.0:1784044010.817610:0:9521:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397aa55c00 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:9521:1870705580873856:0@lo:901: 00000100:00100000:1.0:1784044010.817654:0:9521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044010.817688:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580873856 00000100:00100000:1.0:1784044010.817693:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580873856 00000100:00100000:1.0:1784044010.817738:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1784044010.817745:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397aa56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-OST0001_UUID+5:9521:x1870705580873856:12345-0@lo:901: 00000100:00100000:1.0:1784044010.817824:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397aa56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-OST0001_UUID+5:9521:x1870705580873856:12345-0@lo:901: Request processed in 79us (169us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044010.817831:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:1.0:1784044010.817848:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784044010.817856:0:9521:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b397b969240 going to sleep for 11 seconds 00010000:00080000:1.0:1784044010.817868:0:9521:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b397aa55c00 x1870705580873856/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1784044026 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784044010.817879:0:9521:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397aa55c00 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:9521:1870705580873856:0@lo:901: 00010000:00010000:2.0:1784044010.818494:0:9519:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-10 is initialized 00000020:00000080:2.0:1784044010.818587:0:9519:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:2.0:1784044010.818628:0:9519:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1784044010.818638:0:9519:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0x89871fc3aba17e5f 00000100:00080000:2.0:1784044010.818647:0:9519:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1784044010.818653:0:9519:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff9b3843441000 using connection 192.168.202.140@tcp/0@lo 00000100:00100000:2.0:1784044010.818680:0:9519:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b3842706a00 x1870705580873984/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1784044010.818703:0:9519:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:1.0:1784044010.819120:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3842706a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3637:1870705580873984:0@lo:38: 00000100:00100000:1.0:1784044010.819191:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044010.819542:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580873984 00000100:00100000:3.0:1784044010.819553:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580873984 00000100:00100000:3.0:1784044010.819617:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1784044010.819623:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397aa55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3637:x1870705580873984:12345-0@lo:38: 00010000:00080000:3.0:1784044010.819647:0:6512:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 203 last 0 00000020:00000080:3.0:1784044010.819696:0:6512:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0x89871fc3aba17e66 00000004:00100000:3.0:1784044010.819711:0:6512:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1784044010.819737:0:6512:0:(import.c:65:import_set_state_nolock()) ffff9b397b804800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1784044010.819781:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397aa55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1870705580873984:12345-0@lo:38: Request processed in 157us (606us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044010.819789:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1784044010.819879:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b3842706a00 x1870705580873984/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784044020 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784044010.819888:0:3637:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1784044010.819895:0:3637:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 1 00000100:00080000:3.0:1784044010.819903:0:3637:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1784044010.819907:0:3637:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1784044010.819910:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9b3843441000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1784044010.819916:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3842706a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3637:1870705580873984:0@lo:38: 00000040:00080000:2.0:1784044010.825426:0:9519:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000020:01000000:0.0:1784044010.825736:0:9503:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-47 (rc=0) 10000000:01000000:0.0:1784044010.825775:0:9503:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1784044010.825799:0:9503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b39759f8400/0x89871fc3aba17e35 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba17e3c expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044010.825819:0:9503:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9b39759f8400/0x89871fc3aba17e35 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba17e3c expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1784044010.825868:0:9503:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1784044010.825871:0:9503:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1784044010.825873:0:9503:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784044010.825874:0:9503:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1784044010.825876:0:9503:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784044010.825877:0:9503:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784044010.825879:0:9503:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1784044010.825881:0:9503:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1784044010.825882:0:9503:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1784044010.825884:0:9503:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784044010.825886:0:9503:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1784044010.825890:0:9503:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:0.0:1784044010.825893:0:9503:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1784044010.825894:0:9503:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1784044010.825895:0:9503:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784044010.825897:0:9503:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1784044010.825898:0:9503:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784044010.825899:0:9503:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784044010.825900:0:9503:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1784044010.825901:0:9503:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1784044010.825903:0:9503:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1784044010.825904:0:9503:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784044010.825905:0:9503:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1784044010.825931:0:9503:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1784044010.825950:0:9503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b384316f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:9503:1870705580874112:0@lo:253: 00000100:00100000:0.0:1784044010.826039:0:9503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044010.826093:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580874112 00000100:00100000:0.0:1784044010.826100:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580874112 00000100:00100000:0.0:1784044010.826165:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1784044010.826196:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3965ef8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+17:9503:x1870705580874112:12345-0@lo:253: 20000000:01000000:0.0:1784044010.826290:0:6506:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1784044010.826378:0:6506:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:0.0:1784044010.826503:0:9503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b397ab49f00 going to sleep for 11 seconds 20000000:01000000:1.0:1784044010.831448:0:6506:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1784044010.831468:0:6506:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1784044010.831739:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3965ef8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+17:9503:x1870705580874112:12345-0@lo:253: Request processed in 5560us (5696us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044010.831752:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1784044010.831758:0:9503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b384316f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:9503:1870705580874112:0@lo:253: 10000000:01000000:0.0:1784044010.831777:0:9503:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1784044010.831781:0:9503:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1784044010.831783:0:9503:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1784044010.831786:0:9503:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784044010.831787:0:9503:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1784044010.831789:0:9503:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784044010.831791:0:9503:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784044010.831792:0:9503:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1784044010.831794:0:9503:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1784044010.831796:0:9503:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1784044010.831797:0:9503:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784044010.831799:0:9503:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1784044010.831816:0:9503:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:2.0:1784044010.831827:0:6527:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1784044010.831833:0:6527:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1784044010.831855:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b3965d1c800/0x89871fc3aba17e6d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044010.831870:0:6527:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b3965d1cc00/0x89871fc3aba17dd3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x89871fc3aba17dcc expref: 16 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044010.831878:0:6527:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b3965d1d000/0x89871fc3aba17de1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x89871fc3aba17dda expref: 16 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044010.831896:0:6527:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b3965d1c800/0x89871fc3aba17e6d lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044010.831934:0:6527:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b3965d1d000/0x89871fc3aba17de1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x89871fc3aba17dda expref: 16 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044010.831947:0:6527:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b3965d1d000/0x89871fc3aba17de1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x89871fc3aba17dda expref: 16 pid: 6504 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044010.831960:0:6527:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3842705c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6527:1870705580874240:0@lo:104: 00000100:00100000:2.0:1784044010.831994:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1784044010.832045:0:6527:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b3965d1cc00/0x89871fc3aba17dd3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x89871fc3aba17dcc expref: 16 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044010.832053:0:6527:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b3965d1cc00/0x89871fc3aba17dd3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x89871fc3aba17dcc expref: 16 pid: 6506 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044010.832073:0:6527:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3842707100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6527:1870705580874368:0@lo:104: 00000100:00100000:2.0:1784044010.832093:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044010.832107:0:6527:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3975915a80 going to sleep for 11 seconds 00000100:00100000:2.0:1784044010.832123:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580874240 00000100:00100000:2.0:1784044010.832130:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580874240 00000100:00100000:2.0:1784044010.832194:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580874368 00000100:00100000:2.0:1784044010.832197:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580874368 00000100:00100000:2.0:1784044010.832210:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1784044010.832218:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3842706a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+4:6527:x1870705580874240:12345-0@lo:104: 00010000:00010000:2.0:1784044010.832395:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.140@tcp lock: ffff9b39759f8000/0x89871fc3aba17dda lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x89871fc3aba17de1 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044010.832473:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1784044010.832479:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3842706a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+4:6527:x1870705580874240:12345-0@lo:104: Request processed in 261us (485us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044010.832485:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1784044010.832498:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1784044010.832503:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3842704000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+3:6527:x1870705580874368:12345-0@lo:104: 00010000:00010000:2.0:1784044010.832511:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.140@tcp lock: ffff9b394166a400/0x89871fc3aba17dcc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x89871fc3aba17dd3 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044010.832553:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1784044010.832558:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3842704000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+3:6527:x1870705580874368:12345-0@lo:104: Request processed in 56us (465us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044010.832565:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:2.0:1784044010.832579:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1784044010.832584:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: ffff9b39759f8000/0x89871fc3aba17dda lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x89871fc3aba17de1 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044010.832596:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b39759f8000 already unused, calling callback (ffffffffc113cc20) 10000000:00010000:2.0:1784044010.832599:0:6499:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: ffff9b39759f8000/0x89871fc3aba17dda lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x89871fc3aba17de1 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044010.832608:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9b39759f8000/0x89871fc3aba17dda lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x89871fc3aba17de1 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784044010.832615:0:6499:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9b39759f8000/0x89871fc3aba17dda lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x89871fc3aba17de1 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784044010.832620:0:6499:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1784044010.832653:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.140@tcp lock: ffff9b39759f8000/0x89871fc3aba17dda lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x89871fc3aba17de1 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044010.832660:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784044010.832677:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: ffff9b39759f8000/0x89871fc3aba17dda lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x89871fc3aba17de1 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044010.832684:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9b39759f8000/0x89871fc3aba17dda lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x89871fc3aba17de1 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044010.832695:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784044010.832699:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: ffff9b394166a400/0x89871fc3aba17dcc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x89871fc3aba17dd3 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044010.832705:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b394166a400 already unused, calling callback (ffffffffc113cc20) 10000000:00010000:2.0:1784044010.832707:0:6499:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: ffff9b394166a400/0x89871fc3aba17dcc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x89871fc3aba17dd3 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044010.832723:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9b394166a400/0x89871fc3aba17dcc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x89871fc3aba17dd3 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784044010.832730:0:6499:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9b394166a400/0x89871fc3aba17dcc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x89871fc3aba17dd3 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784044010.832735:0:6499:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1784044010.832746:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.140@tcp lock: ffff9b394166a400/0x89871fc3aba17dcc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x89871fc3aba17dd3 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044010.832751:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784044010.832761:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: ffff9b394166a400/0x89871fc3aba17dcc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x89871fc3aba17dd3 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044010.832768:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9b394166a400/0x89871fc3aba17dcc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x89871fc3aba17dd3 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044010.832780:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784044010.832782:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784044010.832783:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784044010.832790:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1784044010.832799:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b38436a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:3639:1870705580874624:0@lo:103: 00000100:00100000:2.0:1784044010.832822:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044010.832907:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b38436a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:3641:1870705580874496:0@lo:103: 00000100:00100000:3.0:1784044010.832932:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044010.833015:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580874624 00000100:00100000:2.0:1784044010.833019:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580874624 00010000:00010000:2.0:1784044010.833035:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b3965d1cc00/0x89871fc3aba17dd3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x89871fc3aba17dcc expref: 17 pid: 6506 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044010.833057:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580874496 00000100:00100000:2.0:1784044010.833060:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580874496 00010000:00010000:2.0:1784044010.833075:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b3965d1d000/0x89871fc3aba17de1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x89871fc3aba17dda expref: 18 pid: 6504 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044010.833088:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1784044010.833093:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38436a2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+18:3639:x1870705580874624:12345-0@lo:103: 00010000:00010000:2.0:1784044010.833101:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784044010.833106:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b3965d1cc00/0x89871fc3aba17dd3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x89871fc3aba17dcc expref: 18 pid: 6506 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044010.833115:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b3965d1cc00/0x89871fc3aba17dd3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x89871fc3aba17dcc expref: 18 pid: 6506 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044010.833129:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784044010.833165:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38436a2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+18:3639:x1870705580874624:12345-0@lo:103: Request processed in 71us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044010.833171:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1784044010.833203:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1784044010.833208:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38427b5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+17:3641:x1870705580874496:12345-0@lo:103: 00010000:00010000:2.0:1784044010.833216:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784044010.833220:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b3965d1d000/0x89871fc3aba17de1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x89871fc3aba17dda expref: 17 pid: 6504 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044010.833239:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b3965d1d000/0x89871fc3aba17de1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x89871fc3aba17dda expref: 17 pid: 6504 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044010.833251:0:6496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b3965d1c800/0x89871fc3aba17e6d lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044010.833258:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b3965d1c800/0x89871fc3aba17e6d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1784044010.833280:0:6496:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.011531532s 00010000:00010000:2.0:1784044010.833284:0:6496:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b3965d1c800/0x89871fc3aba17e6d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044010.833292:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b3965d1c800/0x89871fc3aba17e6d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044010.833299:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b3965d1c800/0x89871fc3aba17e6d lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044010.833306:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b3965d1c800/0x89871fc3aba17e6d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044010.833312:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3965d1c800 already unused, calling callback (ffffffffc0b56230) 00010000:00010000:2.0:1784044010.833315:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b3965d1c800/0x89871fc3aba17e6d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044010.833321:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b3965d1c800/0x89871fc3aba17e6d lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044010.833330:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b3965d1c800/0x89871fc3aba17e6d lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044010.833338:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784044010.833360:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38427b5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+17:3641:x1870705580874496:12345-0@lo:103: Request processed in 152us (428us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044010.833367:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1784044010.833391:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b38436a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:3639:1870705580874624:0@lo:103: 00000100:00100000:3.0:1784044010.833925:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b38436a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:3641:1870705580874496:0@lo:103: 00010000:00010000:1.0:1784044010.834101:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b3965d1d000/0x89871fc3aba17de1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x89871fc3aba17dda expref: 16 pid: 6504 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044010.834113:0:6527:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3842705c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6527:1870705580874240:0@lo:104: 00010000:00010000:1.0:1784044010.834122:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b3965d1cc00/0x89871fc3aba17dd3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x89871fc3aba17dcc expref: 15 pid: 6506 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044010.834130:0:6527:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3842707100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6527:1870705580874368:0@lo:104: 00010000:00010000:1.0:1784044010.834143:0:6527:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b3965d1c800/0x89871fc3aba17e6d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044010.834164:0:6527:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b3965d1c800/0x89871fc3aba17e6d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044010.834170:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b3965d1c800/0x89871fc3aba17e6d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044010.834295:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b3965d1c800/0x89871fc3aba17e6d lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044010.835377:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:10000000:0.0:1784044010.838263:0:9503:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:0.0:1784044010.838513:0:9503:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:0.0:1784044010.838704:0:9503:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:0.0:1784044010.838878:0:9503:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:0.0:1784044010.839070:0:9503:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:0.0:1784044010.839559:0:9503:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00000001:00000004:0.0:1784044010.840850:0:9503:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:1.0:1784044010.847304:0:9503:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:1.0:1784044010.847314:0:9503:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:1.0:1784044010.847347:0:9503:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1784044010.847387:0:9503:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.140@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1784044010.847404:0:9503:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=50 00000080:00000004:1.0:1784044010.847435:0:9503:0:(super25.c:181:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:1.0:1784044010.848137:0:9503:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1784044010.848368:0:9503:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:0.0:1784044011.150341:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1784044011.658157:0:9576:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1784044011.661093:0:9576:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1784044012.179349:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784044013.209736:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784044014.224316:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784044014.673874:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b384316f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1870705580874752:0@lo:41: 00000100:00100000:0.0:1784044014.673944:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044014.674078:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580874752 00000100:00100000:3.0:1784044014.674085:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580874752 00000100:00100000:3.0:1784044014.674144:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1784044014.674161:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b384316d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1870705580874752:12345-0@lo:41: 00000004:00000024:3.0:1784044014.674221:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446354944 avail 1300115456 00000100:00100000:3.0:1784044014.674266:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b384316d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1870705580874752:12345-0@lo:41: Request processed in 105us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044014.674273:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1784044014.674316:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b384316f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1870705580874752:0@lo:41: 00010000:00010000:0.0:1784044015.245360:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784044015.696867:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397aa54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1870705580874880:0@lo:41: 00000100:00100000:0.0:1784044015.696935:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044015.697006:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784044015.697013:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b38427b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1870705580875008:0@lo:13: 00000100:00100000:0.0:1784044015.697039:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044015.697077:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580875008 00000100:00100000:0.0:1784044015.697084:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580875008 00000100:00100000:0.0:1784044015.697153:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1784044015.697162:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b384316d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1870705580875008:12345-0@lo:13: 00002000:00000024:0.0:1784044015.697217:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784044015.697257:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b384316d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1870705580875008:12345-0@lo:13: Request processed in 96us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044015.697264:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:0.0:1784044015.697283:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1784044015.697311:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b38427b4700 x1870705580875008/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784044031 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784044015.697328:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b38427b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1870705580875008:0@lo:13: 00000100:00100000:1.0:1784044015.697802:0:7768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580874880 00000100:00100000:1.0:1784044015.697807:0:7768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580874880 00000100:00100000:1.0:1784044015.697839:0:7768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1784044015.697846:0:7768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b384316ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1870705580874880:12345-0@lo:41: 00000004:00000024:1.0:1784044015.697869:0:7768:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:1.0:1784044015.697907:0:7768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b384316ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1870705580874880:12345-0@lo:41: Request processed in 61us (972us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044015.697913:0:7768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1784044015.697942:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397aa54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1870705580874880:0@lo:41: 00000100:00100000:2.0:1784044015.698303:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1784044015.698320:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b38436a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1870705580875136:0@lo:13: 00000100:00100000:2.0:1784044015.698351:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044015.698378:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580875136 00000100:00100000:2.0:1784044015.698382:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580875136 00000100:00100000:2.0:1784044015.698414:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1784044015.698420:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38436a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1870705580875136:12345-0@lo:13: 00002000:00000024:2.0:1784044015.698432:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784044015.698462:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38436a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1870705580875136:12345-0@lo:13: Request processed in 42us (110us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044015.698468:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:2.0:1784044015.698484:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1784044015.698498:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b38436a0380 x1870705580875136/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784044031 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784044015.698510:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b38436a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1870705580875136:0@lo:13: 00000100:00100000:0.0:1784044016.205554:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b384316f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:3639:1870705580875264:0@lo:400: 00000100:00100000:0.0:1784044016.205623:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044016.205682:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b384316ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1870705580875776:0@lo:400: 00000100:00100000:0.0:1784044016.205708:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044016.205726:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b384316fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3639:1870705580876288:0@lo:400: 00000100:00100000:0.0:1784044016.205761:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044016.205785:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1784044016.205790:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b384316dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3639:1870705580875648:0@lo:400: 00000100:00100000:0.0:1784044016.205810:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044016.205827:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b384316e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3639:1870705580876160:0@lo:400: 00000100:00100000:0.0:1784044016.205845:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044016.205888:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b384316c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1870705580875392:0@lo:400: 00000100:00100000:0.0:1784044016.206082:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044016.206113:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b384316ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1870705580875904:0@lo:400: 00000100:00100000:0.0:1784044016.206139:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044016.206199:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b384316f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3640:1870705580876416:0@lo:400: 00000100:00100000:0.0:1784044016.206225:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044016.206239:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1784044016.206246:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b384316e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1870705580875520:0@lo:400: 00000100:00100000:0.0:1784044016.206267:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044016.206286:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b384316f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1870705580876032:0@lo:400: 00000100:00100000:0.0:1784044016.206305:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044016.206322:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b384316ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3640:1870705580876544:0@lo:400: 00000100:00100000:0.0:1784044016.206345:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044016.206423:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580875776 00000100:00100000:0.0:1784044016.206430:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580875776 00000100:00100000:0.0:1784044016.206474:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580875520 00000100:00100000:0.0:1784044016.206477:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580875520 00000100:00100000:0.0:1784044016.206493:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1784044016.206500:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b384316c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1870705580875776:12345-0@lo:400: 00000100:00100000:0.0:1784044016.206553:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b384316c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1870705580875776:12345-0@lo:400: Request processed in 52us (844us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044016.206560:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1784044016.206576:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1784044016.206581:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39759b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1870705580875520:12345-0@lo:400: 00000100:00100000:0.0:1784044016.206610:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39759b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1870705580875520:12345-0@lo:400: Request processed in 29us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044016.206624:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1784044016.206645:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580876288 00000100:00100000:0.0:1784044016.206649:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580876288 00000100:00100000:0.0:1784044016.206677:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580875648 00000100:00100000:0.0:1784044016.206681:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580875648 00000100:00100000:0.0:1784044016.206690:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580876160 00000100:00100000:0.0:1784044016.206692:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580876160 00000100:00100000:0.0:1784044016.206703:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580875392 00000100:00100000:0.0:1784044016.206705:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580875392 00000100:00100000:0.0:1784044016.206712:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580876416 00000100:00100000:0.0:1784044016.206714:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580876416 00000100:00100000:0.0:1784044016.206724:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580876544 00000100:00100000:0.0:1784044016.206726:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580876544 00000100:00100000:0.0:1784044016.206968:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1784044016.206975:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b384316d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1870705580876288:12345-0@lo:400: 00000100:00100000:0.0:1784044016.207002:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b384316d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1870705580876288:12345-0@lo:400: Request processed in 29us (1241us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044016.207007:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1784044016.207018:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1784044016.207024:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b384316c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1870705580875648:12345-0@lo:400: 00000100:00100000:0.0:1784044016.207043:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b384316c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1870705580875648:12345-0@lo:400: Request processed in 20us (1233us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044016.207048:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1784044016.207056:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1784044016.207060:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b384316df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1870705580876160:12345-0@lo:400: 00000100:00100000:0.0:1784044016.207092:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b384316df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1870705580876160:12345-0@lo:400: Request processed in 32us (1246us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044016.207109:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1784044016.207125:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1784044016.207129:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39759b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1870705580875392:12345-0@lo:400: 00000100:00100000:0.0:1784044016.207162:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39759b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1870705580875392:12345-0@lo:400: Request processed in 21us (1069us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044016.207167:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1784044016.207200:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1784044016.207206:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39759b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1870705580876416:12345-0@lo:400: 00000100:00100000:0.0:1784044016.207228:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39759b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1870705580876416:12345-0@lo:400: Request processed in 22us (1002us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044016.207232:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1784044016.207241:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1784044016.207246:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39759b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1870705580876544:12345-0@lo:400: 00000100:00100000:0.0:1784044016.207267:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39759b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1870705580876544:12345-0@lo:400: Request processed in 20us (922us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044016.207272:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1784044016.207297:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580875904 00000100:00100000:0.0:1784044016.207301:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580875904 00000100:00100000:0.0:1784044016.207324:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580876032 00000100:00100000:0.0:1784044016.207326:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580876032 00000100:00100000:0.0:1784044016.207338:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1784044016.207343:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39759b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1870705580875904:12345-0@lo:400: 00000100:00100000:0.0:1784044016.207372:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39759b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1870705580875904:12345-0@lo:400: Request processed in 28us (1233us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044016.207571:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1784044016.207584:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1784044016.207590:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39759b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1870705580876032:12345-0@lo:400: 00000100:00100000:0.0:1784044016.207619:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39759b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1870705580876032:12345-0@lo:400: Request processed in 29us (1313us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044016.207642:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:0.0:1784044016.207667:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1784044016.207671:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1784044016.207705:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b384316e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1870705580875520:0@lo:400: 00010000:00080000:0.0:1784044016.207718:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b384316f480 x1870705580876032/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784044032 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784044016.207727:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b384316f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1870705580876032:0@lo:400: 00010000:00080000:0.0:1784044016.207850:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b384316ca80 x1870705580876544/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044032 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784044016.207860:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b384316ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3640:1870705580876544:0@lo:400: 00010000:00080000:0.0:1784044016.207870:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b384316c380 x1870705580875392/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044032 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784044016.207878:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b384316c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1870705580875392:0@lo:400: 00010000:00080000:0.0:1784044016.207888:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b384316ce00 x1870705580875904/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784044032 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784044016.207895:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b384316ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1870705580875904:0@lo:400: 00010000:00080000:0.0:1784044016.207903:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b384316f800 x1870705580876416/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044032 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784044016.207980:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b384316f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3640:1870705580876416:0@lo:400: 00010000:00080000:0.0:1784044016.208022:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b384316dc00 x1870705580875648/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044032 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784044016.208031:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b384316dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3639:1870705580875648:0@lo:400: 00010000:00080000:0.0:1784044016.208052:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b384316e300 x1870705580876160/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044032 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784044016.208060:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b384316e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3639:1870705580876160:0@lo:400: 00000100:00100000:0.0:1784044016.208069:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b384316ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1870705580875776:0@lo:400: 00010000:00080000:0.0:1784044016.208078:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b384316fb80 x1870705580876288/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044032 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784044016.208085:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b384316fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3639:1870705580876288:0@lo:400: 00000100:00100000:0.0:1784044016.208622:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580875264 00000100:00100000:0.0:1784044016.208688:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580875264 00000100:00100000:0.0:1784044016.209596:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1784044016.209607:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3965efb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+15:3639:x1870705580875264:12345-0@lo:400: 00000100:00100000:0.0:1784044016.209688:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3965efb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+15:3639:x1870705580875264:12345-0@lo:400: Request processed in 84us (4065us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044016.209695:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 10000000:01000000:2.0:1784044016.212288:0:6508:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1784044016.212294:0:6508:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9b3975aa3000 from 39 10000000:01000000:2.0:1784044016.212300:0:6508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1784044016.212343:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b3965d1d000/0x89871fc3aba17e74 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044016.212353:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9b3965d1d000/0x89871fc3aba17e74 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044016.212363:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9b3965d1d000/0x89871fc3aba17e74 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044016.212386:0:6508:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b38436a0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580876672:0@lo:101: 00000100:00100000:2.0:1784044016.212446:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044016.214425:0:6508:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3975915240 going to sleep for 11 seconds 00000100:00100000:3.0:1784044016.214505:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580876672 00000100:00100000:3.0:1784044016.214514:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580876672 00000100:00100000:3.0:1784044016.214559:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1784044016.214568:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3965efa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+15:6508:x1870705580876672:12345-0@lo:101: 00010000:00010000:3.0:1784044016.214582:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784044016.214600:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b39759f8a00/0x89871fc3aba17e7b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x89871fc3aba17e74 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044016.214636:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b39759f8a00/0x89871fc3aba17e7b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x89871fc3aba17e74 expref: 16 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044016.214647:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b39759f8a00/0x89871fc3aba17e7b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x89871fc3aba17e74 expref: 16 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044016.214655:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b39759f8a00, rc 0) 00000100:00100000:3.0:1784044016.214706:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3965efa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+16:6508:x1870705580876672:12345-0@lo:101: Request processed in 139us (2260us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044016.214713:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1784044016.218961:0:6508:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b38436a0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580876672:0@lo:101: 00010000:00010000:3.0:1784044016.218991:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9b3965d1d000/0x89871fc3aba17e74 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba17e7b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044016.219018:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9b3965d1d000/0x89871fc3aba17e74 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x89871fc3aba17e7b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044016.219113:0:6508:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b38427b4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580876800:0@lo:501: 00000100:00100000:3.0:1784044016.219381:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044016.219414:0:6508:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3942e1ab40 going to sleep for 11 seconds 00000100:00100000:3.0:1784044016.219443:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580876800 00000100:00100000:3.0:1784044016.219449:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580876800 00000100:00100000:3.0:1784044016.219485:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1784044016.219493:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3950377450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+16:6508:x1870705580876800:12345-0@lo:501: 00000100:00100000:3.0:1784044016.219616:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3950377450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+16:6508:x1870705580876800:12345-0@lo:501: Request processed in 124us (235us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044016.219623:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1784044016.219673:0:6508:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b38427b4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580876800:0@lo:501: 00000100:00100000:3.0:1784044016.219698:0:6508:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b38427b4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580876928:0@lo:503: 00000100:00100000:3.0:1784044016.219840:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044016.219855:0:6508:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3942e1ab40 going to sleep for 11 seconds 00000100:00100000:3.0:1784044016.219866:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580876928 00000100:00100000:3.0:1784044016.219869:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580876928 00000100:00100000:3.0:1784044016.219885:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1784044016.219891:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3950374050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+16:6508:x1870705580876928:12345-0@lo:503: 00000100:00100000:3.0:1784044016.219976:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3950374050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+16:6508:x1870705580876928:12345-0@lo:503: Request processed in 85us (137us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044016.219983:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1784044016.220022:0:6508:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b38427b4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580876928:0@lo:503: 00000100:00100000:3.0:1784044016.220323:0:9810:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b38427b4a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:9810:1870705580877056:0@lo:502: 00000100:00100000:3.0:1784044016.220354:0:9810:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044016.220371:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580877056 00000100:00100000:3.0:1784044016.220374:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580877056 00000100:00100000:3.0:1784044016.220389:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1784044016.220393:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3950375450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+16:9810:x1870705580877056:12345-0@lo:502: 00000100:00100000:3.0:1784044016.220453:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3950375450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+16:9810:x1870705580877056:12345-0@lo:502: Request processed in 58us (98us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044016.220459:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1784044016.220482:0:9810:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3942e1a300 going to sleep for 11 seconds 00000100:00100000:3.0:1784044016.220492:0:9810:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b38427b4a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:9810:1870705580877056:0@lo:502: 00000100:00100000:3.0:1784044016.220523:0:9810:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b38427b4a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:9810:1870705580877184:0@lo:502: 00000100:00100000:3.0:1784044016.220550:0:9810:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044016.220566:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580877184 00000100:00100000:3.0:1784044016.220569:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580877184 00000100:00100000:3.0:1784044016.220583:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1784044016.220587:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3950376450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+16:9810:x1870705580877184:12345-0@lo:502: 00000100:00100000:1.0:1784044016.220721:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b384316f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:3639:1870705580875264:0@lo:400: 00000100:00100000:3.0:1784044016.221800:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3950376450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+16:9810:x1870705580877184:12345-0@lo:502: Request processed in 1142us (1179us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044016.221809:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1784044016.221847:0:9810:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3942e1a300 going to sleep for 11 seconds 00000100:00100000:3.0:1784044016.221863:0:9810:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b38427b4a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:9810:1870705580877184:0@lo:502: 00000040:00080000:3.0:1784044016.221884:0:9810:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:3.0:1784044016.222059:0:6508:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:3.0:1784044016.222074:0:6508:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1784044016.222088:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b3965d1d000/0x89871fc3aba17e74 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba17e7b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044016.222107:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9b3965d1d000/0x89871fc3aba17e74 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba17e7b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784044016.222116:0:6508:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1784044016.222119:0:6508:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:3.0:1784044016.222122:0:6508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1784044016.222146:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b39759f9400/0x89871fc3aba17e82 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044016.222164:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9b39759f9400/0x89871fc3aba17e82 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044016.222186:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9b39759f9400/0x89871fc3aba17e82 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044016.222200:0:6508:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b38427b4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580877312:0@lo:101: 00000100:00100000:3.0:1784044016.222235:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044016.222248:0:6508:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3942e1a300 going to sleep for 11 seconds 00000100:00100000:3.0:1784044016.222260:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580877312 00000100:00100000:3.0:1784044016.222263:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580877312 00000100:00100000:3.0:1784044016.222283:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1784044016.222289:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3950377c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+16:6508:x1870705580877312:12345-0@lo:101: 00010000:00010000:3.0:1784044016.222297:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784044016.222309:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b39759f9c00/0x89871fc3aba17e89 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x89871fc3aba17e82 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044016.222329:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b39759f9c00/0x89871fc3aba17e89 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x89871fc3aba17e82 expref: 17 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044016.222345:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b39759f9c00/0x89871fc3aba17e89 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x89871fc3aba17e82 expref: 17 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044016.222354:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b39759f9c00, rc 0) 00000100:00100000:3.0:1784044016.222384:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3950377c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+17:6508:x1870705580877312:12345-0@lo:101: Request processed in 95us (148us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044016.222390:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1784044016.222417:0:6508:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b38427b4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580877312:0@lo:101: 00010000:00010000:3.0:1784044016.222428:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9b39759f9400/0x89871fc3aba17e82 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba17e89 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044016.222436:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9b39759f9400/0x89871fc3aba17e82 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x89871fc3aba17e89 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044016.222477:0:6508:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b38427b4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580877440:0@lo:501: 00000100:00100000:3.0:1784044016.222499:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044016.222510:0:6508:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3942e1a300 going to sleep for 11 seconds 00000100:00100000:3.0:1784044016.222519:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580877440 00000100:00100000:3.0:1784044016.222522:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580877440 00000100:00100000:3.0:1784044016.222537:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1784044016.222541:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3950375c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+17:6508:x1870705580877440:12345-0@lo:501: 00000100:00100000:3.0:1784044016.222874:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3950375c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+17:6508:x1870705580877440:12345-0@lo:501: Request processed in 86us (128us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044016.222880:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1784044016.222920:0:6508:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b38427b4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580877440:0@lo:501: 00000100:00100000:3.0:1784044016.222942:0:6508:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b38427b4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580877568:0@lo:503: 00000100:00100000:3.0:1784044016.222978:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044016.222990:0:6508:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3942e1a300 going to sleep for 11 seconds 00000100:00100000:3.0:1784044016.223000:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580877568 00000100:00100000:3.0:1784044016.223003:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580877568 00000100:00100000:3.0:1784044016.223019:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1784044016.223024:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3950374c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+17:6508:x1870705580877568:12345-0@lo:503: 00000100:00100000:3.0:1784044016.223087:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3950374c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+17:6508:x1870705580877568:12345-0@lo:503: Request processed in 62us (108us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044016.223092:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1784044016.223137:0:6508:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b38427b4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580877568:0@lo:503: 00000100:00100000:1.0:1784044016.227599:0:9811:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397aa54e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:9811:1870705580877696:0@lo:502: 00000100:00100000:1.0:1784044016.227688:0:9811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044016.227728:0:9811:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b397b969840 going to sleep for 11 seconds 00000100:00100000:1.0:1784044016.228071:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580877696 00000100:00100000:1.0:1784044016.228078:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580877696 00000100:00100000:1.0:1784044016.228134:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1784044016.228143:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3950376c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+17:9811:x1870705580877696:12345-0@lo:502: 00000100:00100000:1.0:1784044016.228278:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3950376c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+17:9811:x1870705580877696:12345-0@lo:502: Request processed in 135us (589us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044016.228285:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1784044016.228339:0:9811:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397aa54e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:9811:1870705580877696:0@lo:502: 00000020:01000000:1.0:1784044016.228366:0:9811:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1784044016.228374:0:9811:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784044016.228376:0:9811:0:(obd_config.c:1561:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:1.0:1784044016.228388:0:9811:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1784044016.228390:0:9811:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1784044016.228405:0:9811:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397aa54e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:9811:1870705580877824:0@lo:502: 00000100:00100000:1.0:1784044016.228438:0:9811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044016.228456:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580877824 00000100:00100000:1.0:1784044016.228459:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580877824 00000100:00100000:1.0:1784044016.228475:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1784044016.228480:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3950375850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+17:9811:x1870705580877824:12345-0@lo:502: 00000100:00100000:1.0:1784044016.228533:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3950375850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+17:9811:x1870705580877824:12345-0@lo:502: Request processed in 52us (94us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044016.228539:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1784044016.228562:0:9811:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b397b969840 going to sleep for 11 seconds 00000100:00100000:1.0:1784044016.228572:0:9811:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397aa54e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:9811:1870705580877824:0@lo:502: 00000020:01000000:1.0:1784044016.228588:0:9811:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784044016.228591:0:9811:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784044016.228593:0:9811:0:(obd_config.c:1561:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000040:00080000:1.0:1784044016.228596:0:9811:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:1.0:1784044016.236247:0:6508:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:1.0:1784044016.236283:0:6508:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1784044016.236295:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b39759f9400/0x89871fc3aba17e82 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba17e89 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044016.236307:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9b39759f9400/0x89871fc3aba17e82 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba17e89 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784044016.236317:0:6508:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1784044016.236320:0:6508:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9b396f3cf800 from 39 10000000:01000000:1.0:1784044016.236323:0:6508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1784044016.236377:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b394166ae00/0x89871fc3aba17e90 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044016.236402:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9b394166ae00/0x89871fc3aba17e90 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044016.236414:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9b394166ae00/0x89871fc3aba17e90 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044016.236440:0:6508:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397aa54e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580877952:0@lo:101: 00000100:00100000:1.0:1784044016.236521:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044016.236550:0:6508:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b397b969840 going to sleep for 11 seconds 00000100:00100000:1.0:1784044016.236577:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580877952 00000100:00100000:1.0:1784044016.236584:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580877952 00000100:00100000:1.0:1784044016.236620:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1784044016.236627:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3950374450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+17:6508:x1870705580877952:12345-0@lo:101: 00010000:00010000:1.0:1784044016.236640:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784044016.236653:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b394166b800/0x89871fc3aba17e97 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x89871fc3aba17e90 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044016.236675:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b394166b800/0x89871fc3aba17e97 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x89871fc3aba17e90 expref: 18 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044016.236685:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b394166b800/0x89871fc3aba17e97 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x89871fc3aba17e90 expref: 18 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044016.236694:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b394166b800, rc 0) 00000100:00100000:1.0:1784044016.236731:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3950374450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+18:6508:x1870705580877952:12345-0@lo:101: Request processed in 104us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044016.236739:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1784044016.236785:0:6508:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397aa54e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580877952:0@lo:101: 00010000:00010000:1.0:1784044016.236805:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9b394166ae00/0x89871fc3aba17e90 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba17e97 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044016.236814:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9b394166ae00/0x89871fc3aba17e90 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x89871fc3aba17e97 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044016.236865:0:6508:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397aa54e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580878080:0@lo:501: 00000100:00100000:1.0:1784044016.236888:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044016.236902:0:6508:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b397b969840 going to sleep for 11 seconds 00000100:00100000:1.0:1784044016.236925:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580878080 00000100:00100000:1.0:1784044016.236928:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580878080 00000100:00100000:1.0:1784044016.236944:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1784044016.236949:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3950376850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+18:6508:x1870705580878080:12345-0@lo:501: 00000100:00100000:1.0:1784044016.237063:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3950376850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+18:6508:x1870705580878080:12345-0@lo:501: Request processed in 112us (173us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044016.237069:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1784044016.237093:0:6508:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397aa54e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580878080:0@lo:501: 00000100:00100000:1.0:1784044016.237292:0:6508:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397aa54e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580878208:0@lo:503: 00000100:00100000:1.0:1784044016.237325:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044016.237339:0:6508:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b397b969840 going to sleep for 11 seconds 00000100:00100000:1.0:1784044016.237347:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580878208 00000100:00100000:1.0:1784044016.237350:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580878208 00000100:00100000:1.0:1784044016.237365:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1784044016.237369:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3950374850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+18:6508:x1870705580878208:12345-0@lo:503: 00000100:00100000:1.0:1784044016.237440:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3950374850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+18:6508:x1870705580878208:12345-0@lo:503: Request processed in 70us (114us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044016.237447:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1784044016.237489:0:6508:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397aa54e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580878208:0@lo:503: 00000100:00100000:0.0:1784044016.239200:0:9812:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39759b5880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:9812:1870705580878336:0@lo:502: 00000100:00100000:0.0:1784044016.239257:0:9812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044016.239289:0:9812:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3951e2b0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784044016.239570:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580878336 00000100:00100000:1.0:1784044016.239577:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580878336 00000100:00100000:1.0:1784044016.239617:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1784044016.239624:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3950377850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+18:9812:x1870705580878336:12345-0@lo:502: 00000100:00100000:1.0:1784044016.239721:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3950377850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+18:9812:x1870705580878336:12345-0@lo:502: Request processed in 98us (463us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044016.239729:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1784044016.239776:0:9812:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39759b5880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:9812:1870705580878336:0@lo:502: 00000100:00100000:1.0:1784044016.239818:0:9812:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397aa54e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:9812:1870705580878464:0@lo:502: 00000100:00100000:1.0:1784044016.239849:0:9812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044016.239867:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580878464 00000100:00100000:1.0:1784044016.239870:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580878464 00000100:00100000:1.0:1784044016.239884:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1784044016.239889:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3950375050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+18:9812:x1870705580878464:12345-0@lo:502: 00000100:00100000:0.0:1784044016.239995:0:9812:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b397b969f00 going to sleep for 11 seconds 00000100:00100000:0.0:1784044016.240199:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3950375050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+18:9812:x1870705580878464:12345-0@lo:502: Request processed in 308us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044016.240206:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1784044016.240450:0:9812:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397aa54e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:9812:1870705580878464:0@lo:502: 00000040:00080000:1.0:1784044016.240469:0:9812:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:0.0:1784044016.240596:0:6508:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:0.0:1784044016.240614:0:6508:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1784044016.240623:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b394166ae00/0x89871fc3aba17e90 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba17e97 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044016.240644:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9b394166ae00/0x89871fc3aba17e90 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba17e97 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784044016.240653:0:6508:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1784044016.240655:0:6508:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9b396f3cf800 from 6 10000000:01000000:0.0:1784044016.240657:0:6508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1784044016.240681:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b3982055000/0x89871fc3aba17e9e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044016.240689:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9b3982055000/0x89871fc3aba17e9e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044016.240698:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9b3982055000/0x89871fc3aba17e9e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044016.240709:0:6508:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39759b6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580878592:0@lo:101: 00000100:00100000:0.0:1784044016.240735:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044016.240761:0:6508:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b397f922300 going to sleep for 11 seconds 00000100:00100000:1.0:1784044016.241385:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580878592 00000100:00100000:1.0:1784044016.241390:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580878592 00000100:00100000:1.0:1784044016.241427:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1784044016.241434:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3950377050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+18:6508:x1870705580878592:12345-0@lo:101: 00010000:00010000:1.0:1784044016.241443:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784044016.241456:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b394166b000/0x89871fc3aba17ea5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x89871fc3aba17e9e expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044016.241476:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b394166b000/0x89871fc3aba17ea5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x89871fc3aba17e9e expref: 19 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044016.241494:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b394166b000/0x89871fc3aba17ea5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x89871fc3aba17e9e expref: 19 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044016.241501:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b394166b000, rc 0) 00000100:00100000:1.0:1784044016.241536:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3950377050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+19:6508:x1870705580878592:12345-0@lo:101: Request processed in 103us (800us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044016.241542:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1784044016.241575:0:6508:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39759b6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580878592:0@lo:101: 00010000:00010000:1.0:1784044016.241586:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9b3982055000/0x89871fc3aba17e9e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba17ea5 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044016.241594:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9b3982055000/0x89871fc3aba17e9e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x89871fc3aba17ea5 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044016.241639:0:6508:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397aa54e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580878720:0@lo:256: 00000100:00100000:1.0:1784044016.241669:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044016.241687:0:6508:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b397b969480 going to sleep for 11 seconds 00000100:00100000:1.0:1784044016.241699:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580878720 00000100:00100000:1.0:1784044016.241702:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580878720 00000100:00100000:1.0:1784044016.241723:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1784044016.241729:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3950376050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+19:6508:x1870705580878720:12345-0@lo:256: 20000000:01000000:1.0:1784044016.241742:0:6506:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1784044016.241756:0:6506:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1784044016.241759:0:6506:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:1.0:1784044016.241824:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3950376050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+19:6508:x1870705580878720:12345-0@lo:256: Request processed in 95us (154us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044016.241831:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1784044016.241866:0:6508:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397aa54e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580878720:0@lo:256: 10000000:01000000:1.0:1784044016.241904:0:6508:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1784044016.242033:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b3982055000/0x89871fc3aba17e9e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba17ea5 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044016.242497:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9b3982055000/0x89871fc3aba17e9e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba17ea5 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784044016.242506:0:6508:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:1.0:1784044016.242508:0:6508:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 34 10000000:01000000:1.0:1784044016.242510:0:6508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1784044016.242527:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b394166b600/0x89871fc3aba17eac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044016.242534:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9b394166b600/0x89871fc3aba17eac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044016.242542:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9b394166b600/0x89871fc3aba17eac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044016.242554:0:6508:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397aa54e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580878848:0@lo:101: 00000100:00100000:1.0:1784044016.242581:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044016.242652:0:6508:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b397b969480 going to sleep for 11 seconds 00000100:00100000:0.0:1784044016.245771:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580878848 00000100:00100000:0.0:1784044016.245783:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580878848 00000100:00100000:0.0:1784044016.245848:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1784044016.245858:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3950370c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+19:6508:x1870705580878848:12345-0@lo:101: 00010000:00010000:0.0:1784044016.245871:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784044016.245887:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b3982054c00/0x89871fc3aba17eb3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x89871fc3aba17eac expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044016.245923:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b3982054c00/0x89871fc3aba17eb3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x89871fc3aba17eac expref: 20 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044016.245949:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b3982054c00/0x89871fc3aba17eb3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x89871fc3aba17eac expref: 20 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044016.245957:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3982054c00, rc 0) 00000100:00100000:0.0:1784044016.246414:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3950370c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+20:6508:x1870705580878848:12345-0@lo:101: Request processed in 557us (3831us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044016.246421:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1784044016.253292:0:6508:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397aa54e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580878848:0@lo:101: 00010000:00010000:3.0:1784044016.253320:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9b394166b600/0x89871fc3aba17eac lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba17eb3 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044016.253331:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9b394166b600/0x89871fc3aba17eac lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x89871fc3aba17eb3 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044016.253419:0:6508:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b38427b4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580878976:0@lo:501: 00000100:00100000:3.0:1784044016.253478:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044016.253506:0:6508:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3942e1a300 going to sleep for 11 seconds 00000100:00100000:2.0:1784044016.253999:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580878976 00000100:00100000:2.0:1784044016.254006:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580878976 00000100:00100000:2.0:1784044016.254249:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1784044016.254260:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3950371850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+20:6508:x1870705580878976:12345-0@lo:501: 00000100:00100000:2.0:1784044016.254403:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3950371850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+20:6508:x1870705580878976:12345-0@lo:501: Request processed in 145us (924us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044016.254410:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1784044016.254737:0:6508:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b38427b4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580878976:0@lo:501: 00000100:00100000:3.0:1784044016.254772:0:6508:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b38427b4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580879104:0@lo:503: 00000100:00100000:3.0:1784044016.254810:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044016.254831:0:6508:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3942e1a300 going to sleep for 11 seconds 00000100:00100000:0.0:1784044016.254893:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580879104 00000100:00100000:0.0:1784044016.254897:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580879104 00000100:00100000:0.0:1784044016.254944:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1784044016.254952:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3950370450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+20:6508:x1870705580879104:12345-0@lo:503: 00000100:00100000:3.0:1784044016.255260:0:6508:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b38427b4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580879104:0@lo:503: 00000100:00100000:3.0:1784044016.255450:0:9813:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b38427b4a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:9813:1870705580879232:0@lo:502: 00000100:00100000:3.0:1784044016.255481:0:9813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044016.255500:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580879232 00000100:00100000:3.0:1784044016.255504:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580879232 00000100:00100000:3.0:1784044016.255523:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1784044016.255529:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3950372850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+21:9813:x1870705580879232:12345-0@lo:502: 00000100:00100000:3.0:1784044016.255599:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3950372850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+21:9813:x1870705580879232:12345-0@lo:502: Request processed in 69us (115us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044016.255606:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1784044016.255632:0:9813:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3942e1a6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784044016.255643:0:9813:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b38427b4a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:9813:1870705580879232:0@lo:502: 00000020:01000000:3.0:1784044016.255661:0:9813:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1784044016.255667:0:9813:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:3.0:1784044016.255673:0:9813:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784044016.255675:0:9813:0:(obd_config.c:1561:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1784044016.255681:0:9813:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1784044016.255684:0:9813:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.202.140@tcp to nid 0x20000c0a8ca8c (192.168.202.140@tcp) 00000020:01000000:3.0:1784044016.255702:0:9813:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:3.0:1784044016.255705:0:9813:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1784044016.255721:0:9813:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff9b38435619c0) 00000020:00000080:3.0:1784044016.255743:0:9813:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type osp with refcount 2 00000020:00000080:3.0:1784044016.255749:0:9813:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1784044016.255827:0:9813:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:3.0:1784044016.255834:0:9813:0:(osd_handler.c:8929:osd_obd_connect()) connect #5 00000020:00000080:3.0:1784044016.255841:0:9813:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x89871fc3aba17ec1 00010000:00080000:3.0:1784044016.255868:0:9813:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9b396f2f4000@lustre-OST0001-osc-MDT0001: add connection 192.168.202.140@tcp at head 00000100:00100000:0.0:1784044016.257190:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3950370450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+20:6508:x1870705580879104:12345-0@lo:503: Request processed in 85us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044016.257205:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00010000:00010000:3.0:1784044016.258516:0:9813:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-11 is initialized 00000040:01000000:3.0:1784044016.258651:0:9813:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:3.0:1784044016.258669:0:9813:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:3.0:1784044016.258833:0:9813:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1784044016.258961:0:9813:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1784044016.262464:0:9813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:3.0:1784044016.262625:0:9813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:0.0:1784044016.277443:0:9814:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1784044016.277451:0:9814:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00010000:00010000:2.0:1784044016.285080:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1784044016.294960:0:9813:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1784044016.294974:0:9813:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1784044016.295019:0:9813:0:(lod_lov.c:129:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1784044016.295044:0:9813:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x89871fc3aba17ec8 00000100:00080000:1.0:1784044016.295054:0:9813:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1784044016.295060:0:9813:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9b396f2f4000 using connection 192.168.202.140@tcp/0@lo 00000100:00100000:1.0:1784044016.295108:0:9813:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b397aa57480 x1870705580879360/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1784044016.295144:0:9813:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:0.0:1784044016.295196:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397aa57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1870705580879360:0@lo:8: 00000020:01000000:1.0:1784044016.295215:0:9813:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784044016.295219:0:9813:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784044016.295220:0:9813:0:(obd_config.c:1561:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1784044016.295223:0:9813:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1784044016.295227:0:9813:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784044016.295228:0:9813:0:(obd_config.c:1561:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:1.0:1784044016.295230:0:9813:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1784044016.295232:0:9813:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1784044016.295253:0:9813:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397aa56300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:9813:1870705580879488:0@lo:502: 00000100:00100000:0.0:1784044016.295271:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044016.298867:0:9813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044016.298934:0:9813:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b397b969b40 going to sleep for 11 seconds 00000100:00100000:2.0:1784044016.302333:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580879488 00000100:00100000:2.0:1784044016.302347:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580879488 00000100:00100000:2.0:1784044016.302421:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1784044016.302431:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3950370850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+20:9813:x1870705580879488:12345-0@lo:502: 00000100:00100000:2.0:1784044016.302588:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3950370850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+20:9813:x1870705580879488:12345-0@lo:502: Request processed in 159us (3728us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044016.302596:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1784044016.306270:0:9813:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397aa56300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:9813:1870705580879488:0@lo:502: 00000020:01000000:1.0:1784044016.306341:0:9813:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784044016.306354:0:9813:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784044016.306356:0:9813:0:(obd_config.c:1561:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000040:00080000:1.0:1784044016.306362:0:9813:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000020:01000000:2.0:1784044016.306772:0:6508:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 34-42 (rc=0) 10000000:01000000:2.0:1784044016.306793:0:6508:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1784044016.306804:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b394166b600/0x89871fc3aba17eac lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba17eb3 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044016.306815:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9b394166b600/0x89871fc3aba17eac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba17eb3 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784044016.306825:0:6508:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1784044016.306828:0:6508:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9b397418c800 from 39 10000000:01000000:2.0:1784044016.306831:0:6508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1784044016.306865:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b3965d1cc00/0x89871fc3aba17ecf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044016.306898:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9b3965d1cc00/0x89871fc3aba17ecf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044016.306909:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9b3965d1cc00/0x89871fc3aba17ecf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044016.306929:0:6508:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b38436a2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580879616:0@lo:101: 00000100:00100000:2.0:1784044016.306993:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044016.307032:0:6508:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3975915240 going to sleep for 11 seconds 00000100:00100000:2.0:1784044016.307062:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580879616 00000100:00100000:2.0:1784044016.307067:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580879616 00000100:00100000:2.0:1784044016.307120:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1784044016.307129:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3950373850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+20:6508:x1870705580879616:12345-0@lo:101: 00010000:00010000:2.0:1784044016.307142:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784044016.307155:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b3965d1c800/0x89871fc3aba17ed6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x89871fc3aba17ecf expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044016.307207:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b3965d1c800/0x89871fc3aba17ed6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x89871fc3aba17ecf expref: 21 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044016.307218:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b3965d1c800/0x89871fc3aba17ed6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x89871fc3aba17ecf expref: 21 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044016.307226:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3965d1c800, rc 0) 00000100:00100000:2.0:1784044016.307262:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3950373850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+21:6508:x1870705580879616:12345-0@lo:101: Request processed in 133us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044016.307268:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1784044016.307320:0:6508:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b38436a2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580879616:0@lo:101: 00010000:00010000:2.0:1784044016.307338:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9b3965d1cc00/0x89871fc3aba17ecf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba17ed6 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044016.307348:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9b3965d1cc00/0x89871fc3aba17ecf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x89871fc3aba17ed6 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044016.307411:0:6508:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b38436a2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580879744:0@lo:501: 00000100:00100000:2.0:1784044016.307436:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044016.307450:0:6508:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3843703540 going to sleep for 11 seconds 00000100:00100000:2.0:1784044016.307461:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580879744 00000100:00100000:2.0:1784044016.307464:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580879744 00000100:00100000:2.0:1784044016.307481:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1784044016.307487:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3950371050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+21:6508:x1870705580879744:12345-0@lo:501: 00000100:00100000:2.0:1784044016.307594:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3950371050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+21:6508:x1870705580879744:12345-0@lo:501: Request processed in 106us (156us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044016.307601:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1784044016.307764:0:6508:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b38436a2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580879744:0@lo:501: 00000100:00100000:2.0:1784044016.307792:0:6508:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b38436a2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580879872:0@lo:503: 00000100:00100000:2.0:1784044016.307826:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044016.307839:0:6508:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3843703540 going to sleep for 11 seconds 00000100:00100000:2.0:1784044016.307850:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580879872 00000100:00100000:2.0:1784044016.307854:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580879872 00000100:00100000:2.0:1784044016.307873:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1784044016.307880:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3950373050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+21:6508:x1870705580879872:12345-0@lo:503: 00000100:00100000:2.0:1784044016.307945:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3950373050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+21:6508:x1870705580879872:12345-0@lo:503: Request processed in 66us (118us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044016.307951:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1784044016.307988:0:6508:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b38436a2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580879872:0@lo:503: 00000100:00100000:1.0:1784044016.308918:0:9816:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397aa56300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:9816:1870705580880000:0@lo:502: 00000100:00100000:1.0:1784044016.308961:0:9816:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044016.308992:0:9816:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b397b969b40 going to sleep for 11 seconds 00000100:00100000:2.0:1784044016.309046:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580880000 00000100:00100000:2.0:1784044016.309051:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580880000 00000100:00100000:2.0:1784044016.309080:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1784044016.309087:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3950372050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+21:9816:x1870705580880000:12345-0@lo:502: 00000100:00100000:2.0:1784044016.309210:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3950372050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+21:9816:x1870705580880000:12345-0@lo:502: Request processed in 123us (247us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044016.309216:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1784044016.309318:0:9816:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397aa56300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:9816:1870705580880000:0@lo:502: 00000100:00100000:1.0:1784044016.309356:0:9816:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397aa56300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:9816:1870705580880128:0@lo:502: 00000100:00100000:1.0:1784044016.309388:0:9816:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044016.309408:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580880128 00000100:00100000:1.0:1784044016.309411:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580880128 00000100:00100000:1.0:1784044016.309434:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1784044016.309440:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3950373450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+21:9816:x1870705580880128:12345-0@lo:502: 00000100:00100000:1.0:1784044016.309499:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3950373450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+21:9816:x1870705580880128:12345-0@lo:502: Request processed in 60us (110us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044016.309505:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1784044016.309535:0:9816:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b397b969b40 going to sleep for 11 seconds 00000100:00100000:1.0:1784044016.309546:0:9816:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397aa56300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:9816:1870705580880128:0@lo:502: 00000040:00080000:1.0:1784044016.309567:0:9816:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000100:00100000:0.0:1784044016.312051:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580879360 00000100:00100000:0.0:1784044016.312063:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580879360 00000100:00100000:0.0:1784044016.312124:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1784044016.312131:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39759b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3637:x1870705580879360:12345-0@lo:8: 00010000:00080000:0.0:1784044016.312202:0:8428:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 209 last 0 00000020:00000080:0.0:1784044016.312232:0:8428:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x89871fc3aba17edd 00002000:00100000:0.0:1784044016.312245:0:8428:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff9b384317d000 ocd_connect_flags: 0xa044401443000026 ocd_version: 21136a2 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:0.0:1784044016.312263:0:8428:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00000001:00000004:0.0:1784044016.312267:0:8428:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:0.0:1784044016.312327:0:8428:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1784044016.312551:0:8428:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:0.0:1784044016.312576:0:8428:0:(import.c:65:import_set_state_nolock()) ffff9b384317d800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1784044016.312663:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39759b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:3637:x1870705580879360:12345-0@lo:8: Request processed in 531us (17391us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044016.312670:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:0.0:1784044016.312713:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b397aa57480 x1870705580879360/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1784044026 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784044016.312723:0:3637:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1784044016.313833:0:3637:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 1 00000100:00080000:0.0:1784044016.313846:0:3637:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1784044016.313852:0:3637:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1784044016.313855:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9b396f2f4000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1784044016.313874:0:3637:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1784044016.313881:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397aa57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1870705580879360:0@lo:8: 00000004:00080000:0.0:1784044016.313915:0:9814:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000020:01000000:2.0:1784044016.313962:0:6508:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 00000004:00080000:0.0:1784044016.313982:0:9814:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 209484807106ns, next at 0ns, rc = 0 00080000:00080000:0.0:1784044016.313987:0:9814:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0001: async commit OSD 10000000:01000000:2.0:1784044016.313988:0:6508:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1784044016.313998:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b3965d1cc00/0x89871fc3aba17ecf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba17ed6 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044016.314009:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9b3965d1cc00/0x89871fc3aba17ecf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba17ed6 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784044016.314018:0:6508:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1784044016.314020:0:6508:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9b397418c800 from 6 10000000:01000000:2.0:1784044016.314023:0:6508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1784044016.314063:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b3965d1c000/0x89871fc3aba17ee4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044016.314071:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9b3965d1c000/0x89871fc3aba17ee4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044016.314080:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9b3965d1c000/0x89871fc3aba17ee4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044016.314112:0:6508:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b38436a2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580880256:0@lo:101: 00000100:00100000:2.0:1784044016.314201:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044016.314231:0:6508:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3843703600 going to sleep for 11 seconds 00000100:00100000:0.0:1784044016.315847:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580880256 00000100:00100000:0.0:1784044016.315859:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580880256 00000100:00100000:0.0:1784044016.315906:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1784044016.315915:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3950371450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+21:6508:x1870705580880256:12345-0@lo:101: 00010000:00010000:0.0:1784044016.315929:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784044016.315943:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b3982054800/0x89871fc3aba17eeb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x89871fc3aba17ee4 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044016.315978:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b3982054800/0x89871fc3aba17eeb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x89871fc3aba17ee4 expref: 22 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044016.315990:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b3982054800/0x89871fc3aba17eeb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x89871fc3aba17ee4 expref: 22 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044016.315999:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3982054800, rc 0) 00000100:00100000:0.0:1784044016.316068:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3950371450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+22:6508:x1870705580880256:12345-0@lo:101: Request processed in 154us (1893us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044016.316075:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1784044016.322851:0:6508:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b38436a2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580880256:0@lo:101: 00010000:00010000:2.0:1784044016.322882:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9b3965d1c000/0x89871fc3aba17ee4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba17eeb expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044016.322896:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9b3965d1c000/0x89871fc3aba17ee4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x89871fc3aba17eeb expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044016.322968:0:6508:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b38436a2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580880384:0@lo:256: 00000100:00100000:2.0:1784044016.323033:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044016.323196:0:6508:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3843703600 going to sleep for 11 seconds 00000100:00100000:2.0:1784044016.323230:0:9815:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b38436a0e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9815:1870705580880512:0@lo:700: 00000100:00100000:2.0:1784044016.323261:0:9815:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044016.323296:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580880512 00000100:00100000:2.0:1784044016.323302:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580880512 00000100:00100000:2.0:1784044016.324833:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1784044016.324848:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38436a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:9815:x1870705580880512:12345-0@lo:700: 00000100:00100000:2.0:1784044016.324899:0:8434:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b38436a2300 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8434:1870705580880640:0@lo:700: 00000100:00100000:2.0:1784044016.324944:0:8434:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044016.324967:0:8434:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3843703300 going to sleep for 11 seconds 00000100:00080000:2.0:1784044016.324985:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784044016.325009:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580880640 00000100:00100000:2.0:1784044016.325015:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580880640 00000100:00100000:2.0:1784044016.326209:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1784044016.326220:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38436a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8434:x1870705580880640:12345-0@lo:700: 00000100:00100000:2.0:1784044016.326641:0:9815:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3843703cc0 going to sleep for 11 seconds 00000004:00080000:2.0:1784044016.328014:0:7443:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00000100:00100000:0.0:1784044016.328868:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580880384 00000100:00100000:0.0:1784044016.328881:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580880384 00000100:00100000:0.0:1784044016.328942:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1784044016.328956:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3950370050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+22:6508:x1870705580880384:12345-0@lo:256: 20000000:01000000:0.0:1784044016.328985:0:6504:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1784044016.329006:0:6504:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1784044016.329009:0:6504:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:0.0:1784044016.329171:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3950370050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+22:6508:x1870705580880384:12345-0@lo:256: Request processed in 219us (6136us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044016.329199:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1784044016.329380:0:6508:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b38436a2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580880384:0@lo:256: 10000000:01000000:2.0:1784044016.329436:0:6508:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1784044016.329445:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b3965d1c000/0x89871fc3aba17ee4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba17eeb expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044016.329804:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9b3965d1c000/0x89871fc3aba17ee4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba17eeb expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784044016.329813:0:6508:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1784044016.329816:0:6508:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:2.0:1784044016.329818:0:6508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1784044016.329857:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b3965d1d800/0x89871fc3aba17ef2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044016.329865:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9b3965d1d800/0x89871fc3aba17ef2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044016.329872:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9b3965d1d800/0x89871fc3aba17ef2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044016.329888:0:6508:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b38436a2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580880768:0@lo:101: 00000100:00100000:2.0:1784044016.330072:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044016.333886:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580880768 00000100:00100000:1.0:1784044016.333900:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580880768 00000100:00100000:1.0:1784044016.333972:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1784044016.333982:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3950372450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+22:6508:x1870705580880768:12345-0@lo:101: 00010000:00010000:1.0:1784044016.334000:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784044016.334017:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b394166be00/0x89871fc3aba17ef9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x89871fc3aba17ef2 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044016.334056:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b394166be00/0x89871fc3aba17ef9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x89871fc3aba17ef2 expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044016.334068:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b394166be00/0x89871fc3aba17ef9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x89871fc3aba17ef2 expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044016.334077:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b394166be00, rc 0) 00000100:00100000:2.0:1784044016.334135:0:6508:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3843703600 going to sleep for 11 seconds 00000100:00100000:1.0:1784044016.334147:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3950372450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+23:6508:x1870705580880768:12345-0@lo:101: Request processed in 166us (4074us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044016.334165:0:6508:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b38436a2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580880768:0@lo:101: 00010000:00010000:2.0:1784044016.334208:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9b3965d1d800/0x89871fc3aba17ef2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba17ef9 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044016.334219:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9b3965d1d800/0x89871fc3aba17ef2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x89871fc3aba17ef9 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044016.334311:0:6508:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b38436a2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580880896:0@lo:501: 00000100:00100000:2.0:1784044016.334497:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044016.334511:0:6508:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3843703600 going to sleep for 11 seconds 00000100:00100000:1.0:1784044016.334826:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1784044016.334856:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580880896 00000100:00100000:1.0:1784044016.334859:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580880896 00000100:00100000:1.0:1784044016.334873:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1784044016.334877:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3950373c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+23:6508:x1870705580880896:12345-0@lo:501: 00000100:00100000:1.0:1784044016.334966:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3950373c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+23:6508:x1870705580880896:12345-0@lo:501: Request processed in 87us (469us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044016.334973:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1784044016.336073:0:6508:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b38436a2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580880896:0@lo:501: 00000100:00100000:2.0:1784044016.336136:0:6508:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b38436a2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580881024:0@lo:503: 00000100:00100000:2.0:1784044016.336210:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044016.336245:0:6508:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3843703600 going to sleep for 11 seconds 00000100:00100000:1.0:1784044016.336253:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580881024 00000100:00100000:1.0:1784044016.336259:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580881024 00000100:00100000:1.0:1784044016.336297:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1784044016.336305:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3950371c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+23:6508:x1870705580881024:12345-0@lo:503: 00000100:00100000:1.0:1784044016.337346:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3950371c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+23:6508:x1870705580881024:12345-0@lo:503: Request processed in 1038us (1132us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044016.337356:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1784044016.337445:0:6508:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b38436a2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580881024:0@lo:503: 00000100:00100000:2.0:1784044016.338149:0:9817:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b38436a2a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:9817:1870705580881152:0@lo:502: 00000100:00100000:2.0:1784044016.338213:0:9817:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044016.338241:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580881152 00000100:00100000:2.0:1784044016.338246:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580881152 00000100:00100000:2.0:1784044016.338282:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1784044016.338291:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3950372c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+23:9817:x1870705580881152:12345-0@lo:502: 00000100:00100000:2.0:1784044016.338859:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3950372c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+23:9817:x1870705580881152:12345-0@lo:502: Request processed in 567us (644us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044016.338867:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1784044016.338917:0:9817:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3843703180 going to sleep for 11 seconds 00000100:00100000:2.0:1784044016.338934:0:9817:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b38436a2a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:9817:1870705580881152:0@lo:502: 00000020:01000000:2.0:1784044016.338970:0:9817:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1784044016.338978:0:9817:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1784044016.338985:0:9817:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784044016.338987:0:9817:0:(obd_config.c:1561:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1784044016.338991:0:9817:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1784044016.339001:0:9817:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.202.140@tcp to nid 0x20000c0a8ca8c (192.168.202.140@tcp) 00000020:01000000:2.0:1784044016.339024:0:9817:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1784044016.339028:0:9817:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1784044016.339042:0:9817:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9b3842454d40) 00000020:00000080:2.0:1784044016.339067:0:9817:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type osp with refcount 2 00000020:00000080:2.0:1784044016.339073:0:9817:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1784044016.339156:0:9817:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1784044016.339163:0:9817:0:(osd_handler.c:8929:osd_obd_connect()) connect #7 00000020:00000080:2.0:1784044016.339170:0:9817:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x89871fc3aba17f07 00010000:00080000:2.0:1784044016.339235:0:9817:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9b3842127000@lustre-OST0001-osc-MDT0000: add connection 192.168.202.140@tcp at head 00010000:00010000:2.0:1784044016.339537:0:9817:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-12 is initialized 40000000:02000000:0.0:1784044016.348355:0:6518:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost 00000040:01000000:2.0:1784044016.350828:0:9817:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:2.0:1784044016.350857:0:9817:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1784044016.351047:0:9817:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1784044016.351248:0:9817:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1784044016.351543:0:9817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:2.0:1784044016.352465:0:9817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:2.0:1784044016.353699:0:9820:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1784044016.353705:0:9820:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1784044016.357650:0:9817:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1784044016.357666:0:9817:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1784044016.357709:0:9817:0:(lod_lov.c:129:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1784044016.357735:0:9817:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x89871fc3aba17f0e 00000100:00080000:2.0:1784044016.357746:0:9817:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1784044016.357752:0:9817:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9b3842127000 using connection 192.168.202.140@tcp/0@lo 00000100:00100000:2.0:1784044016.357790:0:9817:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b38436a2a00 x1870705580881280/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1784044016.357813:0:9817:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1784044016.357862:0:9817:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784044016.357866:0:9817:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784044016.357873:0:9817:0:(obd_config.c:1561:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1784044016.357876:0:9817:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784044016.357880:0:9817:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784044016.357881:0:9817:0:(obd_config.c:1561:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:2.0:1784044016.357884:0:9817:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1784044016.357886:0:9817:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1784044016.357914:0:9817:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b38436a1f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:9817:1870705580881408:0@lo:502: 00000100:00100000:2.0:1784044016.358001:0:9817:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044016.358042:0:9817:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3843703000 going to sleep for 11 seconds 00000100:00100000:2.0:1784044016.358061:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b38436a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1870705580881280:0@lo:8: 00000100:00100000:2.0:1784044016.358089:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044016.358128:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580881280 00000100:00100000:2.0:1784044016.358135:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580881280 00000100:00100000:2.0:1784044016.358162:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1784044016.358169:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38436a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3637:x1870705580881280:12345-0@lo:8: 00010000:00080000:2.0:1784044016.358222:0:8427:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 209 last 0 00000020:00000080:2.0:1784044016.358255:0:8427:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x89871fc3aba17f15 00002000:00100000:2.0:1784044016.358270:0:8427:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9b3843447000 ocd_connect_flags: 0xa044401443000026 ocd_version: 21136a2 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1784044016.358275:0:8427:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:2.0:1784044016.358278:0:8427:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1784044016.358344:0:8427:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1784044016.358365:0:8427:0:(import.c:65:import_set_state_nolock()) ffff9b3843444800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784044016.358413:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38436a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3637:x1870705580881280:12345-0@lo:8: Request processed in 242us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044016.358421:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:2.0:1784044016.358456:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b38436a2a00 x1870705580881280/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1784044026 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784044016.358462:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580881408 00000100:00100000:2.0:1784044016.358467:0:3637:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00100000:1.0:1784044016.358470:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580881408 00000100:00080000:2.0:1784044016.358482:0:3637:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1784044016.358489:0:3637:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1784044016.358495:0:3637:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1784044016.358498:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9b3842127000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1784044016.358508:0:3637:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1784044016.358512:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1784044016.358515:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b38436a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1870705580881280:0@lo:8: 00000100:00100000:1.0:1784044016.358525:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3970ede850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+23:9817:x1870705580881408:12345-0@lo:502: 00000004:00080000:2.0:1784044016.358540:0:9820:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1784044016.358596:0:9820:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 209529421094ns, next at 0ns, rc = 0 00080000:00080000:2.0:1784044016.358602:0:9820:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:1.0:1784044016.358646:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3970ede850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+23:9817:x1870705580881408:12345-0@lo:502: Request processed in 125us (645us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044016.358654:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1784044016.359238:0:9817:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b38436a1f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:9817:1870705580881408:0@lo:502: 00000020:01000000:1.0:1784044016.359263:0:9817:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784044016.359269:0:9817:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784044016.359270:0:9817:0:(obd_config.c:1561:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000040:00080000:1.0:1784044016.359274:0:9817:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000020:01000000:2.0:1784044016.361408:0:6508:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-42 (rc=0) 10000000:01000000:2.0:1784044016.361445:0:6508:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1784044016.361456:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b3965d1d800/0x89871fc3aba17ef2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba17ef9 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044016.361469:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9b3965d1d800/0x89871fc3aba17ef2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba17ef9 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784044016.361480:0:6508:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1784044016.361483:0:6508:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff9b394402b380 from 1 10000000:01000000:2.0:1784044016.361486:0:6508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1784044016.361520:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b3965d1d600/0x89871fc3aba17f1c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044016.361528:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9b3965d1d600/0x89871fc3aba17f1c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044016.361537:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9b3965d1d600/0x89871fc3aba17f1c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044016.361560:0:6508:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b38436a2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580881536:0@lo:101: 00000100:00100000:2.0:1784044016.362077:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044016.362135:0:6508:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3843703f00 going to sleep for 11 seconds 00000100:00100000:0.0:1784044016.362144:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38436a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8434:x1870705580880640:12345-0@lo:700: Request processed in 35923us (37196us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044016.362156:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1784044016.362875:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580881536 00000100:00100000:2.0:1784044016.362885:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580881536 00000100:00100000:1.0:1784044016.363167:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1784044016.363194:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3970edc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+23:6508:x1870705580881536:12345-0@lo:101: 00010000:00010000:1.0:1784044016.363211:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784044016.363227:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b394166a400/0x89871fc3aba17f23 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x89871fc3aba17f1c expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044016.363259:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b394166a400/0x89871fc3aba17f23 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x89871fc3aba17f1c expref: 24 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044016.363270:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b394166a400/0x89871fc3aba17f23 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x89871fc3aba17f1c expref: 24 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044016.363279:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b394166a400, rc 0) 00000100:00100000:1.0:1784044016.363331:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3970edc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+24:6508:x1870705580881536:12345-0@lo:101: Request processed in 142us (1255us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044016.363338:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1784044016.363384:0:6508:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b38436a2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580881536:0@lo:101: 00010000:00010000:1.0:1784044016.363401:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9b3965d1d600/0x89871fc3aba17f1c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba17f23 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044016.363409:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9b3965d1d600/0x89871fc3aba17f1c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x89871fc3aba17f23 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044016.363479:0:6508:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397aa56300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580881664:0@lo:501: 00000100:00100000:1.0:1784044016.363510:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044016.363546:0:6508:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b39452e9f00 going to sleep for 11 seconds 00010000:00080000:2.0:1784044016.363553:0:8434:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b38436a2300 x1870705580880640/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1784044032 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784044016.363566:0:8434:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b38436a2300 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8434:1870705580880640:0@lo:700: 40000000:02000000:2.0:1784044016.363576:0:8434:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] 00000100:00100000:3.0:1784044016.364557:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580881664 00000100:00100000:3.0:1784044016.364564:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580881664 00000100:00100000:3.0:1784044016.364601:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1784044016.364609:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3970edf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+24:6508:x1870705580881664:12345-0@lo:501: 00000100:00100000:3.0:1784044016.364951:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3970edf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+24:6508:x1870705580881664:12345-0@lo:501: Request processed in 342us (1440us total) trans 0 rc -2/-2 00000100:00100000:3.0:1784044016.364960:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1784044016.366033:0:6508:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397aa56300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580881664:0@lo:501: 10000000:01000000:0.0:1784044016.366081:0:6508:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1784044016.366108:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b3965d1d600/0x89871fc3aba17f1c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba17f23 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044016.366120:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9b3965d1d600/0x89871fc3aba17f1c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba17f23 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:3.0:1784044016.378521:0:9505:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00100000:3.0:1784044016.378531:0:9505:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:2.0:1784044016.378704:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38436a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:9815:x1870705580880512:12345-0@lo:700: Request processed in 53856us (55435us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044016.378718:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1784044016.378764:0:9815:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b38436a0e00 x1870705580880512/t0(0) o700->lustre-OST0001-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1784044032 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784044016.378778:0:9815:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b38436a0e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9815:1870705580880512:0@lo:700: 00000004:00080000:3.0:1784044016.378978:0:6490:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000004:00080000:0.0:1784044016.381933:0:9821:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:0.0:1784044016.381965:0:9821:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39759b4380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9821:1870705580881920:0@lo:7: 00000100:00100000:0.0:1784044016.382027:0:9821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044016.382058:0:9821:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b397f922300 going to sleep for 11 seconds 00000100:00100000:3.0:1784044016.382121:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1784044016.382139:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39759b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1870705580881792:0@lo:13: 00000100:00100000:3.0:1784044016.382207:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044016.382256:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580881792 00000100:00100000:3.0:1784044016.382264:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580881792 00000100:00100000:3.0:1784044016.382319:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1784044016.382327:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38427b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1870705580881792:12345-0@lo:13: 00002000:00000024:3.0:1784044016.382356:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923947520 avail 3692425216 00000100:00100000:3.0:1784044016.382412:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38427b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1870705580881792:12345-0@lo:13: Request processed in 85us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044016.382418:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:3.0:1784044016.382439:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1784044016.382469:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b39759b7100 x1870705580881792/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784044032 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784044016.382499:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39759b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1870705580881792:0@lo:13: 00000100:00100000:1.0:1784044016.384381:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580881920 00000100:00100000:1.0:1784044016.384392:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580881920 00000100:00100000:1.0:1784044016.384464:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1784044016.384474:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39759b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:9821:x1870705580881920:12345-0@lo:7: 00000004:00080000:2.0:1784044016.389775:0:9815:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:2.0:1784044016.389804:0:9815:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b38436a2300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9815:1870705580882176:0@lo:7: 00000100:00100000:2.0:1784044016.389869:0:9815:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044016.389907:0:9815:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3843703cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1784044016.389925:0:8428:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1784044016.389931:0:8428:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:2.0:1784044016.389946:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784044016.389958:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b38436a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1870705580882048:0@lo:13: 00000100:00100000:2.0:1784044016.389983:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044016.390051:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580882048 00000100:00100000:3.0:1784044016.390058:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580882048 00000100:00100000:3.0:1784044016.390114:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1784044016.390125:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38436a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1870705580882048:12345-0@lo:13: 00002000:00000024:3.0:1784044016.390146:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923947520 avail 3692425216 00000100:00100000:3.0:1784044016.390208:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38436a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1870705580882048:12345-0@lo:13: Request processed in 85us (223us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044016.390216:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:3.0:1784044016.390257:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b38436a0e00 x1870705580882048/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784044032 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784044016.390275:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b38436a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1870705580882048:0@lo:13: 00002000:00080000:1.0:1784044016.395990:0:8426:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:1.0:1784044016.396000:0:8426:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:1.0:1784044016.396388:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39759b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:9821:x1870705580881920:12345-0@lo:7: Request processed in 11911us (14355us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044016.396405:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1784044016.396431:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580882176 00000100:00100000:1.0:1784044016.396438:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580882176 00000100:00100000:1.0:1784044016.396474:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1784044016.396491:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38436a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:9815:x1870705580882176:12345-0@lo:7: 00010000:00080000:2.0:1784044016.398373:0:9821:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b39759b4380 x1870705580881920/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1784044032 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784044016.398400:0:9821:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39759b4380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9821:1870705580881920:0@lo:7: 00000004:00080000:2.0:1784044016.398420:0:9821:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:2.0:1784044016.398458:0:9821:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b38436a0000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9821:1870705580882304:0@lo:5: 00000100:00100000:2.0:1784044016.398507:0:9821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044016.398526:0:9821:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3843703300 going to sleep for 11 seconds 00000100:00100000:2.0:1784044016.401245:0:8427:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1784044016.401261:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580882304 00000100:00100000:2.0:1784044016.401269:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580882304 00000100:00100000:3.0:1784044016.401537:0:9822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1784044016.401547:0:9822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38436a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:9821:x1870705580882304:12345-0@lo:5: 00002000:00080000:3.0:1784044016.401577:0:9822:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:3.0:1784044016.401582:0:9822:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00002000:00080000:1.0:1784044016.407606:0:8426:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:1.0:1784044016.407615:0:8426:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x1:0x0] 00000100:00100000:1.0:1784044016.407719:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38436a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:9815:x1870705580882176:12345-0@lo:7: Request processed in 11234us (17845us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044016.407730:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:1.0:1784044016.408906:0:9815:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b38436a2300 x1870705580882176/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1784044032 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784044016.408925:0:9815:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b38436a2300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9815:1870705580882176:0@lo:7: 00000004:00080000:1.0:1784044016.408939:0:9815:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x1:0x0] 00000100:00100000:1.0:1784044016.408982:0:9815:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397aa57b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9815:1870705580882432:0@lo:5: 00000100:00100000:1.0:1784044016.409025:0:9815:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044016.409600:0:9815:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3843695c00 going to sleep for 11 seconds 00000100:00100000:1.0:1784044016.409655:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580882432 00000100:00100000:1.0:1784044016.409662:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580882432 00000100:00100000:1.0:1784044016.410265:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1784044016.410277:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397aa55f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:9815:x1870705580882432:12345-0@lo:5: 00002000:00080000:1.0:1784044016.410309:0:8427:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:1.0:1784044016.410355:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397aa55f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:9815:x1870705580882432:12345-0@lo:5: Request processed in 80us (1328us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044016.410361:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:0.0:1784044016.410448:0:9815:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b397aa57b80 x1870705580882432/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1784044032 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784044016.410463:0:9815:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397aa57b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9815:1870705580882432:0@lo:5: 00000004:00080000:0.0:1784044016.410474:0:9815:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x1:0x0] from OST, last_created [0x2c0000400:0x1:0x0]last_used is [0x2c0000400:0x1:0x0] 00000100:00100000:0.0:1784044016.410508:0:9815:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39759b5c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9815:1870705580882560:0@lo:5: 00000100:00100000:0.0:1784044016.410537:0:9815:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044016.410595:0:9815:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b397f922f00 going to sleep for 11 seconds 00000100:00100000:1.0:1784044016.410633:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580882560 00000100:00100000:1.0:1784044016.410638:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580882560 00000100:00100000:1.0:1784044016.410713:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1784044016.410721:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39759b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:9815:x1870705580882560:12345-0@lo:5: 00002000:00080000:1.0:1784044016.410746:0:8427:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 2 00000100:00100000:3.0:1784044016.412467:0:9822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38436a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:9821:x1870705580882304:12345-0@lo:5: Request processed in 10917us (13955us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1784044016.412479:0:9822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:0.0:1784044016.413092:0:9821:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b38436a0000 x1870705580882304/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1784044032 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784044016.413122:0:9821:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b38436a0000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9821:1870705580882304:0@lo:5: 00000004:00080000:0.0:1784044016.413138:0:9821:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:0.0:1784044016.413198:0:9821:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39759b4e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9821:1870705580882688:0@lo:700: 00000100:00100000:0.0:1784044016.413231:0:9821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044016.413260:0:9821:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b397f922300 going to sleep for 11 seconds 00000100:00100000:1.0:1784044016.414877:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39759b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:9815:x1870705580882560:12345-0@lo:5: Request processed in 4150us (4332us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1784044016.414891:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1784044016.415267:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580882688 00000100:00100000:2.0:1784044016.415275:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580882688 00000100:00100000:2.0:1784044016.415323:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1784044016.415332:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39759b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+6:9821:x1870705580882688:12345-0@lo:700: 00010000:00080000:3.0:1784044016.419743:0:9815:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b39759b5c00 x1870705580882560/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1784044032 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784044016.419835:0:9815:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39759b5c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9815:1870705580882560:0@lo:5: 00000004:00080000:3.0:1784044016.419853:0:9815:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x1:0x0]-[0x2c0000400:0x21:0x0] 00000100:00100000:3.0:1784044016.419902:0:9815:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b38427b6680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:9815:1870705580882816:0@lo:900: 00000100:00100000:3.0:1784044016.419981:0:9815:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044016.420017:0:9815:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3942e1ac00 going to sleep for 11 seconds 00000001:00080000:3.0:1784044016.422424:0:9505:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00000001:00080000:3.0:1784044016.422442:0:9505:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000100:00100000:2.0:1784044016.422575:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39759b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:9821:x1870705580882688:12345-0@lo:700: Request processed in 7240us (9339us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044016.422587:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1784044016.422679:0:9821:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b39759b4e00 x1870705580882688/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1784044032 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784044016.422691:0:9821:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1784044016.422719:0:9821:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39759b4e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9821:1870705580882688:0@lo:700: 00000100:00100000:1.0:1784044016.423066:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580882816 00000100:00100000:1.0:1784044016.423075:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580882816 00000100:00100000:1.0:1784044016.423136:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1784044016.423146:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38427b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:9815:x1870705580882816:12345-0@lo:900: 00000100:00100000:1.0:1784044016.423220:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38427b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:9815:x1870705580882816:12345-0@lo:900: Request processed in 76us (3238us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044016.423227:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1784044016.423267:0:9815:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b38427b6680 x1870705580882816/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1784044032 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784044016.423278:0:9815:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b38427b6680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:9815:1870705580882816:0@lo:900: 00000004:02000040:0.0:1784044016.432228:0:9821:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 00000100:00100000:1.0:1784044016.443520:0:9821:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397aa54700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9821:1870705580882944:0@lo:5: 00000100:00100000:1.0:1784044016.443598:0:9821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044016.443683:0:9821:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3843695900 going to sleep for 11 seconds 00000100:00100000:2.0:1784044016.450501:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580882944 00000100:00100000:2.0:1784044016.450516:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580882944 00000100:00100000:2.0:1784044016.450572:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1784044016.450583:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397aa55180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:9821:x1870705580882944:12345-0@lo:5: 00002000:00080000:2.0:1784044016.453956:0:8426:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:2.0:1784044016.453976:0:8426:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 2 00000100:00100000:3.0:1784044016.493770:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397aa55180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:9821:x1870705580882944:12345-0@lo:5: Request processed in 43184us (50166us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1784044016.493784:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:2.0:1784044016.503260:0:9821:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b397aa54700 x1870705580882944/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1784044032 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784044016.503282:0:9821:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397aa54700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9821:1870705580882944:0@lo:5: 00000004:00080000:2.0:1784044016.503300:0:9821:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x1:0x0]-[0x2c0000401:0x21:0x0] 00000001:02000400:2.0:1784044017.082350:0:9876:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg240-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1784044017.297816:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1784044018.027338:0:9928:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1784044018.029032:0:9928:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1784044018.317341:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1784044018.948727:0:9505:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00010000:00010000:2.0:1784044019.342062:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784044019.789591:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39759b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1870705580883072:0@lo:41: 00000100:00100000:2.0:1784044019.789671:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044019.789797:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580883072 00000100:00100000:1.0:1784044019.789816:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580883072 00000100:00100000:1.0:1784044019.789877:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1784044019.789886:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38436a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1870705580883072:12345-0@lo:41: 00000004:00000024:1.0:1784044019.789920:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446322176 avail 1300082688 00000100:00100000:1.0:1784044019.796900:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38436a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1870705580883072:12345-0@lo:41: Request processed in 7006us (7219us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044019.796932:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1784044019.797390:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39759b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1870705580883072:0@lo:41: 00010000:00010000:3.0:1784044020.366860:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784044020.814777:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784044020.814804:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b38427b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1870705580883200:0@lo:13: 00000100:00100000:3.0:1784044020.814880:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044020.814939:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580883200 00000100:00100000:3.0:1784044020.814946:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580883200 00000100:00100000:3.0:1784044020.814998:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1784044020.815009:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38420aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1870705580883200:12345-0@lo:13: 00002000:00000024:3.0:1784044020.815038:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784044020.815764:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38420aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1870705580883200:12345-0@lo:13: Request processed in 754us (881us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044020.815773:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:3.0:1784044020.815799:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1784044020.815828:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b38427b6680 x1870705580883200/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784044036 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784044020.815863:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b38427b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1870705580883200:0@lo:13: 00000100:00100000:2.0:1784044020.816610:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b38420a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1870705580883328:0@lo:13: 00000100:00100000:2.0:1784044020.816756:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044020.816818:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580883328 00000100:00100000:3.0:1784044020.816824:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580883328 00000100:00100000:3.0:1784044020.816866:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1784044020.816874:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38436a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1870705580883328:12345-0@lo:13: 00002000:00000024:3.0:1784044020.816890:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784044020.822284:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397aa54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1870705580883456:0@lo:41: 00000100:00100000:0.0:1784044020.822372:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044020.822441:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580883456 00000100:00100000:0.0:1784044020.822450:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580883456 00000100:00100000:0.0:1784044020.822506:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1784044020.822516:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39759b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1870705580883456:12345-0@lo:41: 00000004:00000024:0.0:1784044020.822555:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1784044020.822600:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39759b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1870705580883456:12345-0@lo:41: Request processed in 85us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044020.822607:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1784044020.822661:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397aa54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1870705580883456:0@lo:41: 00000100:00080000:0.0:1784044020.828868:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784044020.829391:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38436a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1870705580883328:12345-0@lo:13: Request processed in 12511us (12628us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044020.829405:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:2.0:1784044020.831237:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b38420a9c00 x1870705580883328/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784044036 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784044020.831265:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b38420a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1870705580883328:0@lo:13: 00000020:00000004:0.0:1784044021.258563:0:10030:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1784044021.258778:0:10030:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1784044021.401952:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784044021.837779:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b38436a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1870705580883968:0@lo:13: 00000100:00100000:1.0:1784044021.837878:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044021.837935:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1784044021.837942:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b38420a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1870705580883840:0@lo:400: 00000100:00100000:1.0:1784044021.837968:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044021.837996:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b38420a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3641:1870705580883712:0@lo:400: 00000100:00100000:1.0:1784044021.838018:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044021.838034:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1784044021.838039:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b38420a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:3641:1870705580883584:0@lo:400: 00000100:00100000:1.0:1784044021.838074:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044021.838096:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397aa54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1870705580884096:0@lo:13: 00000100:00100000:1.0:1784044021.838118:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044021.838149:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580883968 00000100:00100000:1.0:1784044021.838157:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580883968 00000100:00100000:1.0:1784044021.838233:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580884096 00000100:00100000:1.0:1784044021.838237:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580884096 00000100:00100000:1.0:1784044021.838255:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1784044021.838264:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397aa57800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1870705580883968:12345-0@lo:13: 00002000:00000024:1.0:1784044021.839625:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784044021.839687:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397aa57800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1870705580883968:12345-0@lo:13: Request processed in 1420us (1805us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044021.839696:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1784044021.839722:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1784044021.839730:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397aa54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1870705580884096:12345-0@lo:13: 00002000:00000024:1.0:1784044021.839744:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784044021.839800:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397aa54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1870705580884096:12345-0@lo:13: Request processed in 56us (1665us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044021.839806:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1784044021.839832:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580883840 00000100:00100000:1.0:1784044021.839837:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580883840 00000100:00100000:1.0:1784044021.839868:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1784044021.839874:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397aa55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1870705580883840:12345-0@lo:400: 00000100:00100000:1.0:1784044021.839907:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397aa55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1870705580883840:12345-0@lo:400: Request processed in 32us (1937us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044021.839913:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1784044021.839934:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580883712 00000100:00100000:1.0:1784044021.839945:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580883712 00000100:00100000:1.0:1784044021.839971:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1784044021.839977:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397aa56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1870705580883712:12345-0@lo:400: 00000100:00100000:1.0:1784044021.840004:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397aa56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1870705580883712:12345-0@lo:400: Request processed in 27us (1985us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044021.840010:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:1.0:1784044021.840027:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784044021.840077:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b38420a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1870705580883840:0@lo:400: 00010000:00080000:1.0:1784044021.840091:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b38436a1500 x1870705580883968/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784044037 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784044021.840101:0:3639:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000100:00100000:1.0:1784044021.840118:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b38436a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1870705580883968:0@lo:13: 00000100:00100000:1.0:1784044021.840134:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1784044021.840141:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b38420abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1870705580884352:0@lo:400: 00000100:00100000:1.0:1784044021.840169:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044021.840229:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b38420a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3641:1870705580884224:0@lo:400: 00000100:00100000:1.0:1784044021.840261:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1784044021.840295:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b397aa54000 x1870705580884096/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784044037 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784044021.840303:0:3641:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1784044021.840315:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397aa54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1870705580884096:0@lo:13: 00010000:00080000:1.0:1784044021.840326:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b38420a8a80 x1870705580883712/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044037 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784044021.840335:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b38420a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3641:1870705580883712:0@lo:400: 00000100:00100000:1.0:1784044021.840355:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580884352 00000100:00100000:0.0:1784044021.841535:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580883584 00000100:00100000:0.0:1784044021.841543:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580883584 00000100:00100000:0.0:1784044021.841594:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1784044021.841603:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3970edd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+24:3641:x1870705580883584:12345-0@lo:400: 00000100:00100000:0.0:1784044021.841659:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3970edd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+24:3641:x1870705580883584:12345-0@lo:400: Request processed in 58us (3584us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044021.841666:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1784044021.844129:0:9501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580884224 00000100:00100000:0.0:1784044021.844140:0:9501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580884224 00000100:00100000:0.0:1784044021.844205:0:9501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1784044021.844214:0:9501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397aa57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1870705580884224:12345-0@lo:400: 00000100:00100000:0.0:1784044021.844286:0:9501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397aa57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1870705580884224:12345-0@lo:400: Request processed in 74us (4024us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044021.844302:0:9501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:0.0:1784044021.844359:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b38420a9f80 x1870705580884224/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044037 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784044021.844373:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b38420a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3641:1870705580884224:0@lo:400: 00000100:00100000:0.0:1784044021.844386:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b38420a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:3641:1870705580883584:0@lo:400: 00000100:00100000:1.0:1784044021.844732:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580884352 00000100:00100000:1.0:1784044021.846516:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b38420aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1870705580884480:0@lo:400: 00000100:00100000:1.0:1784044021.846579:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044021.847478:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b38420a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1870705580884608:0@lo:400: 00000100:00100000:3.0:1784044021.847517:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044021.847554:0:9822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580884480 00000100:00100000:3.0:1784044021.847561:0:9822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580884480 00000100:00100000:3.0:1784044021.847600:0:9822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580884608 00000100:00100000:3.0:1784044021.847604:0:9822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580884608 00000100:00100000:3.0:1784044021.848033:0:9822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1784044021.848043:0:9822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397aa54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3639:x1870705580884480:12345-0@lo:400: 00000100:00100000:3.0:1784044021.848115:0:9822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397aa54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3639:x1870705580884480:12345-0@lo:400: Request processed in 74us (1536us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044021.848122:0:9822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1784044021.848139:0:9822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1784044021.848144:0:9822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38420aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3640:x1870705580884608:12345-0@lo:400: 00000100:00100000:3.0:1784044021.848202:0:9822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38420aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3640:x1870705580884608:12345-0@lo:400: Request processed in 30us (656us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044021.848209:0:9822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1784044021.848274:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b38420aaa00 x1870705580884480/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784044037 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784044021.848295:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b38420aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1870705580884480:0@lo:400: 00010000:00080000:3.0:1784044021.853529:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b38420a8e00 x1870705580884608/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784044037 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784044021.853566:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b38420a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1870705580884608:0@lo:400: 00000100:00100000:2.0:1784044021.853810:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1784044021.853823:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b38436a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3639:1870705580884864:0@lo:400: 00000100:00100000:2.0:1784044021.853886:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044021.853934:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b38436a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3639:1870705580884992:0@lo:400: 00000100:00100000:2.0:1784044021.853955:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044021.853983:0:9501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580884864 00000100:00100000:2.0:1784044021.853988:0:9501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580884864 00000100:00100000:2.0:1784044021.854034:0:9501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580884992 00000100:00100000:2.0:1784044021.854037:0:9501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580884992 00000100:00100000:2.0:1784044021.854072:0:9501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1784044021.854081:0:9501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38436a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1870705580884864:12345-0@lo:400: 00000100:00100000:2.0:1784044021.854137:0:9501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38436a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1870705580884864:12345-0@lo:400: Request processed in 48us (241us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044021.854155:0:9501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1784044021.854196:0:9501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1784044021.854203:0:9501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38436a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1870705580884992:12345-0@lo:400: 00000100:00100000:2.0:1784044021.854232:0:9501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38436a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1870705580884992:12345-0@lo:400: Request processed in 31us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044021.854237:0:9501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:2.0:1784044021.854260:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b38436a0e00 x1870705580884992/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044037 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784044021.854269:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b38436a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3639:1870705580884992:0@lo:400: 00010000:00080000:2.0:1784044021.854278:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b38436a0000 x1870705580884864/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044037 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1784044021.854429:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1784044021.854433:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1784044021.854441:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784044021.854451:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b38436a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3640:1870705580884736:0@lo:400: 00000100:00100000:1.0:1784044021.854480:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044021.854503:0:9501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580884736 00000100:00100000:1.0:1784044021.854506:0:9501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580884736 00000100:00100000:1.0:1784044021.854533:0:9501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1784044021.854538:0:9501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397aa56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1870705580884736:12345-0@lo:400: 00000100:00100000:1.0:1784044021.854570:0:9501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397aa56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1870705580884736:12345-0@lo:400: Request processed in 31us (89us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044021.854576:0:9501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:1.0:1784044021.854591:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1784044021.854606:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b38436a1500 x1870705580884736/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044037 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784044021.854728:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b38436a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3640:1870705580884736:0@lo:400: 00000100:00100000:2.0:1784044021.854836:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b38436a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3639:1870705580884864:0@lo:400: 00000100:00100000:3.0:1784044021.854896:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1784044021.857316:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1784044021.857328:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397aa54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1870705580884352:12345-0@lo:400: 00000100:00100000:1.0:1784044021.857416:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397aa54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1870705580884352:12345-0@lo:400: Request processed in 90us (17245us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044021.857424:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1784044021.858270:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b38420abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1870705580884352:0@lo:400: 00000100:00100000:3.0:1784044021.860123:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b38436a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3641:1870705580885120:0@lo:400: 00000100:00100000:3.0:1784044021.860482:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044021.863793:0:9501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580885120 00000100:00100000:1.0:1784044021.863809:0:9501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580885120 00000100:00100000:1.0:1784044021.863929:0:9501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1784044021.863938:0:9501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38420a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1870705580885120:12345-0@lo:400: 00000100:00100000:1.0:1784044021.864041:0:9501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38420a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1870705580885120:12345-0@lo:400: Request processed in 104us (3559us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044021.864057:0:9501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:0.0:1784044021.867493:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b38436a0000 x1870705580885120/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044037 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784044021.867699:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b38436a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3641:1870705580885120:0@lo:400: 00000100:00080000:2.0:1784044021.868778:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1784044022.413331:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1784044022.671628:0:10078:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1784044022.671638:0:10078:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=c0185879 00000100:00100000:2.0:1784044023.243290:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044023.243431:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565106304 00000100:00100000:3.0:1784044023.243442:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565106304 00000100:00100000:3.0:1784044023.243491:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 183 00000100:00100000:3.0:1784044023.243499:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3970edf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2406:x1870705565106304:12345-192.168.202.40@tcp:250: 00010000:00080000:3.0:1784044023.243533:0:6504:0:(ldlm_lib.c:1445:target_handle_connect()) MGS: connection from c4a09ad9-a185-4679-99bb-b6a07b865440@192.168.202.40@tcp t0 exp 0000000000000000 cur 216 last 0 00000020:00000080:3.0:1784044023.243561:0:6504:0:(genops.c:1406:class_connect()) connect: client c4a09ad9-a185-4679-99bb-b6a07b865440, cookie 0x89871fc3aba17f2a 00000100:00080000:3.0:1784044023.243804:0:6504:0:(import.c:65:import_set_state_nolock()) ffff9b3843c30000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1784044023.243900:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3970edf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4a09ad9-a185-4679-99bb-b6a07b865440+5:2406:x1870705565106304:12345-192.168.202.40@tcp:250: Request processed in 399us (617us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044023.243908:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 183 00000100:00100000:2.0:1784044023.253899:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044023.253988:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565106432 00000100:00100000:0.0:1784044023.253996:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565106432 00000100:00100000:0.0:1784044023.254071:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 184 00000100:00100000:0.0:1784044023.254089:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3970ede050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4a09ad9-a185-4679-99bb-b6a07b865440+5:6166:x1870705565106432:12345-192.168.202.40@tcp:101: 00010000:00010000:0.0:1784044023.254105:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784044023.254123:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b3982054e00/0x89871fc3aba17f31 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd3dffad52ca64ef expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044023.254152:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b3982054e00/0x89871fc3aba17f31 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca64ef expref: 6 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044023.254162:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b3982054e00/0x89871fc3aba17f31 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca64ef expref: 6 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044023.254171:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3982054e00, rc 0) 00000100:00100000:0.0:1784044023.254261:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3970ede050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4a09ad9-a185-4679-99bb-b6a07b865440+6:6166:x1870705565106432:12345-192.168.202.40@tcp:101: Request processed in 174us (371us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044023.254282:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 184 00000100:00100000:2.0:1784044023.257732:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044023.267313:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565106560 00000100:00100000:0.0:1784044023.267328:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565106560 00000100:00100000:0.0:1784044023.267402:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 185 00000100:00100000:0.0:1784044023.267412:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3970edf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4a09ad9-a185-4679-99bb-b6a07b865440+6:6166:x1870705565106560:12345-192.168.202.40@tcp:501: 00000100:00100000:0.0:1784044023.267555:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3970edf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4a09ad9-a185-4679-99bb-b6a07b865440+6:6166:x1870705565106560:12345-192.168.202.40@tcp:501: Request processed in 144us (9833us total) trans 0 rc -2/-2 00000100:00100000:0.0:1784044023.267564:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 185 00000100:00100000:2.0:1784044023.274146:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044023.274299:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565106688 00000100:00100000:3.0:1784044023.274308:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565106688 00000100:00100000:3.0:1784044023.274360:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 186 00000100:00100000:3.0:1784044023.274369:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3970edd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4a09ad9-a185-4679-99bb-b6a07b865440+6:6166:x1870705565106688:12345-192.168.202.40@tcp:101: 00010000:00010000:3.0:1784044023.274385:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784044023.274403:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b39759f8600/0x89871fc3aba17f38 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd3dffad52ca64f6 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044023.274431:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b39759f8600/0x89871fc3aba17f38 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca64f6 expref: 7 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044023.274460:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b39759f8600/0x89871fc3aba17f38 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca64f6 expref: 7 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044023.274483:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b39759f8600, rc 0) 00000100:00100000:3.0:1784044023.274543:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3970edd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4a09ad9-a185-4679-99bb-b6a07b865440+7:6166:x1870705565106688:12345-192.168.202.40@tcp:101: Request processed in 173us (408us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044023.274550:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 186 00000100:00100000:1.0:1784044023.280151:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044023.280274:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565106816 00000100:00100000:3.0:1784044023.280285:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565106816 00000100:00100000:2.0:1784044023.280457:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 187 00000100:00100000:2.0:1784044023.280480:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3970edc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4a09ad9-a185-4679-99bb-b6a07b865440+7:6166:x1870705565106816:12345-192.168.202.40@tcp:501: 00000100:00100000:2.0:1784044023.280653:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3970edc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4a09ad9-a185-4679-99bb-b6a07b865440+8:6166:x1870705565106816:12345-192.168.202.40@tcp:501: Request processed in 176us (512us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044023.280661:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 187 00000100:00100000:2.0:1784044023.283626:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044023.285629:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565106944 00000100:00100000:0.0:1784044023.285642:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565106944 00000100:00100000:0.0:1784044023.285705:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 188 00000100:00100000:0.0:1784044023.285714:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3970ede450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4a09ad9-a185-4679-99bb-b6a07b865440+8:6166:x1870705565106944:12345-192.168.202.40@tcp:503: 00000100:00100000:0.0:1784044023.285856:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3970ede450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4a09ad9-a185-4679-99bb-b6a07b865440+8:6166:x1870705565106944:12345-192.168.202.40@tcp:503: Request processed in 143us (2238us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044023.285864:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 188 00000100:00100000:0.0:1784044023.297649:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044023.298440:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565107072 00000100:00100000:2.0:1784044023.298451:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565107072 00000100:00100000:2.0:1784044023.298527:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 189 00000100:00100000:2.0:1784044023.298538:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3970edfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4a09ad9-a185-4679-99bb-b6a07b865440+8:6184:x1870705565107072:12345-192.168.202.40@tcp:502: 00000100:00100000:2.0:1784044023.298702:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3970edfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4a09ad9-a185-4679-99bb-b6a07b865440+8:6184:x1870705565107072:12345-192.168.202.40@tcp:502: Request processed in 165us (1061us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044023.298709:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 189 00000100:00100000:1.0:1784044023.336517:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044023.336664:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565107200 00000100:00100000:2.0:1784044023.336683:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565107200 00000100:00100000:2.0:1784044023.336739:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 190 00000100:00100000:2.0:1784044023.336749:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3970eddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4a09ad9-a185-4679-99bb-b6a07b865440+8:6184:x1870705565107200:12345-192.168.202.40@tcp:502: 00000100:00100000:2.0:1784044023.337340:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3970eddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4a09ad9-a185-4679-99bb-b6a07b865440+8:6184:x1870705565107200:12345-192.168.202.40@tcp:502: Request processed in 591us (838us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044023.337349:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 190 00000100:00100000:3.0:1784044023.346519:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044023.346865:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565107328 00000100:00100000:0.0:1784044023.346875:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565107328 00000100:00100000:0.0:1784044023.346928:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 191 00000100:00100000:0.0:1784044023.346938:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3965efcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4a09ad9-a185-4679-99bb-b6a07b865440+8:6166:x1870705565107328:12345-192.168.202.40@tcp:101: 00010000:00010000:0.0:1784044023.346955:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784044023.346973:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b3982055c00/0x89871fc3aba17f3f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd3dffad52ca6527 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044023.347002:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b3982055c00/0x89871fc3aba17f3f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6527 expref: 9 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044023.347046:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b3982055c00/0x89871fc3aba17f3f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6527 expref: 9 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044023.347056:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3982055c00, rc 0) 00000100:00100000:0.0:1784044023.347117:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3965efcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4a09ad9-a185-4679-99bb-b6a07b865440+9:6166:x1870705565107328:12345-192.168.202.40@tcp:101: Request processed in 180us (608us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044023.347124:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 191 00000100:00100000:0.0:1784044023.351426:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044023.351609:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565107456 00000100:00100000:2.0:1784044023.351618:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565107456 00000100:00100000:2.0:1784044023.351691:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 192 00000100:00100000:2.0:1784044023.351701:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3970edec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4a09ad9-a185-4679-99bb-b6a07b865440+9:6166:x1870705565107456:12345-192.168.202.40@tcp:256: 20000000:01000000:2.0:1784044023.351727:0:6505:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1784044023.351750:0:6505:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1784044023.351754:0:6505:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1784044023.351758:0:6505:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1784044023.351761:0:6505:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:2.0:1784044023.351763:0:6505:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:2.0:1784044023.356619:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3970edec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4a09ad9-a185-4679-99bb-b6a07b865440+9:6166:x1870705565107456:12345-192.168.202.40@tcp:256: Request processed in 4908us (5192us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044023.356634:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 192 00000100:00100000:3.0:1784044023.375273:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044023.381393:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565107584 00000100:00100000:2.0:1784044023.381409:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565107584 00000100:00100000:2.0:1784044023.381632:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 193 00000100:00100000:2.0:1784044023.381645:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3965efd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4a09ad9-a185-4679-99bb-b6a07b865440+9:6166:x1870705565107584:12345-192.168.202.40@tcp:101: 00010000:00010000:2.0:1784044023.381661:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784044023.381689:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b3965d1da00/0x89871fc3aba17f46 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd3dffad52ca652e expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044023.381726:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b3965d1da00/0x89871fc3aba17f46 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca652e expref: 10 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044023.381738:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b3965d1da00/0x89871fc3aba17f46 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca652e expref: 10 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044023.381748:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3965d1da00, rc 0) 00000100:00100000:2.0:1784044023.381836:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3965efd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4a09ad9-a185-4679-99bb-b6a07b865440+10:6166:x1870705565107584:12345-192.168.202.40@tcp:101: Request processed in 194us (6573us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044023.384698:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044023.384945:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565107712 00000100:00100000:3.0:1784044023.384953:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565107712 00000100:00100000:2.0:1784044023.385517:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 193 00000100:00100000:3.0:1784044023.385948:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 194 00000100:00100000:3.0:1784044023.385960:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3965efc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4a09ad9-a185-4679-99bb-b6a07b865440+10:6166:x1870705565107712:12345-192.168.202.40@tcp:501: 00000100:00100000:3.0:1784044023.386318:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3965efc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4a09ad9-a185-4679-99bb-b6a07b865440+10:6166:x1870705565107712:12345-192.168.202.40@tcp:501: Request processed in 360us (1626us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044023.386326:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 194 00000100:00100000:3.0:1784044023.395676:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044023.395840:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565107840 00000100:00100000:2.0:1784044023.395852:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565107840 00000100:00100000:2.0:1784044023.395923:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 195 00000100:00100000:2.0:1784044023.395933:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3965efbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4a09ad9-a185-4679-99bb-b6a07b865440+10:6166:x1870705565107840:12345-192.168.202.40@tcp:503: 00000100:00100000:2.0:1784044023.396103:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3965efbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4a09ad9-a185-4679-99bb-b6a07b865440+10:6166:x1870705565107840:12345-192.168.202.40@tcp:503: Request processed in 171us (446us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044023.396111:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 195 00000100:00100000:2.0:1784044023.400765:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044023.402453:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565107968 00000100:00100000:3.0:1784044023.402476:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565107968 00000100:00100000:3.0:1784044023.402547:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 196 00000100:00100000:3.0:1784044023.402557:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3965efac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4a09ad9-a185-4679-99bb-b6a07b865440+10:6190:x1870705565107968:12345-192.168.202.40@tcp:502: 00000100:00100000:3.0:1784044023.403978:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3965efac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4a09ad9-a185-4679-99bb-b6a07b865440+10:6190:x1870705565107968:12345-192.168.202.40@tcp:502: Request processed in 1414us (3214us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044023.403990:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 196 00000100:00100000:0.0:1784044023.407769:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1784044023.408362:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565108096 00000100:00100000:1.0:1784044023.408373:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565108096 00000100:00100000:1.0:1784044023.408431:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 197 00000100:00100000:1.0:1784044023.408441:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3965ef8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4a09ad9-a185-4679-99bb-b6a07b865440+10:6190:x1870705565108096:12345-192.168.202.40@tcp:502: 00000100:00100000:1.0:1784044023.409105:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3965ef8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4a09ad9-a185-4679-99bb-b6a07b865440+10:6190:x1870705565108096:12345-192.168.202.40@tcp:502: Request processed in 662us (1342us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044023.409114:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 197 00000100:00100000:3.0:1784044023.414937:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044023.415122:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565108224 00000100:00100000:2.0:1784044023.415132:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565108224 00000100:00100000:2.0:1784044023.415226:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 7 00000100:00100000:2.0:1784044023.415235:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38420abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2406:x1870705565108224:12345-192.168.202.40@tcp:38: 00010000:00080000:2.0:1784044023.415267:0:6513:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from a93fdf3c-d42f-420a-95ea-b0cbfe954363@192.168.202.40@tcp t0 exp 0000000000000000 cur 216 last 0 00000020:00000080:2.0:1784044023.415318:0:6513:0:(genops.c:1406:class_connect()) connect: client a93fdf3c-d42f-420a-95ea-b0cbfe954363, cookie 0x89871fc3aba17f4d 00000004:00100000:2.0:1784044023.415343:0:6513:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return b7 00000100:00080000:2.0:1784044023.415564:0:6513:0:(import.c:65:import_set_state_nolock()) ffff9b3843442000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784044023.415658:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38420abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+6:2406:x1870705565108224:12345-192.168.202.40@tcp:38: Request processed in 423us (730us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044023.415667:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 7 00000100:00100000:2.0:1784044023.417740:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1784044023.417876:0:9501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565108480 00000100:00100000:1.0:1784044023.417896:0:9501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565108480 00000100:00100000:1.0:1784044023.418090:0:9501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 8 00000100:00100000:1.0:1784044023.418097:0:9501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38436a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2406:x1870705565108480:12345-192.168.202.40@tcp:38: 00010000:00080000:1.0:1784044023.418124:0:9501:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0001: connection from a93fdf3c-d42f-420a-95ea-b0cbfe954363@192.168.202.40@tcp t0 exp 0000000000000000 cur 216 last 0 00000020:00000080:1.0:1784044023.418167:0:9501:0:(genops.c:1406:class_connect()) connect: client a93fdf3c-d42f-420a-95ea-b0cbfe954363, cookie 0x89871fc3aba17f54 00000004:00100000:1.0:1784044023.418363:0:9501:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return b7 00000100:00080000:1.0:1784044023.418575:0:9501:0:(import.c:65:import_set_state_nolock()) ffff9b384345a000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1784044023.418639:0:9501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38436a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a93fdf3c-d42f-420a-95ea-b0cbfe954363+6:2406:x1870705565108480:12345-192.168.202.40@tcp:38: Request processed in 540us (903us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044023.418648:0:9501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 8 00010000:00010000:2.0:1784044023.437577:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784044024.181371:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044024.181407:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044024.181437:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044024.181699:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565108736 00000100:00100000:2.0:1784044024.181710:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565108736 00000100:00100000:2.0:1784044024.181787:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565108608 00000100:00100000:2.0:1784044024.181791:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565108608 00000100:00100000:2.0:1784044024.181810:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565108352 00000100:00100000:2.0:1784044024.181812:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565108352 00000100:00100000:2.0:1784044024.181829:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 9 00000100:00100000:2.0:1784044024.181839:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38420aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+7:6166:x1870705565108736:12345-192.168.202.40@tcp:41: 00000004:00000024:2.0:1784044024.181874:0:6513:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:2.0:1784044024.181934:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38420aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+7:6166:x1870705565108736:12345-192.168.202.40@tcp:41: Request processed in 97us (573us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044024.181942:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 9 00000100:00100000:2.0:1784044024.181960:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 10 00000100:00100000:2.0:1784044024.181966:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38420a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+6:0:x1870705565108608:12345-192.168.202.40@tcp:41: 00000004:00000024:2.0:1784044024.181981:0:6513:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1784044024.182020:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38420a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+6:0:x1870705565108608:12345-192.168.202.40@tcp:41: Request processed in 39us (597us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044024.182051:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 10 00000100:00100000:2.0:1784044024.182066:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 11 00000100:00100000:2.0:1784044024.182073:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38420a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+6:0:x1870705565108352:12345-192.168.202.40@tcp:41: 00000004:00000024:2.0:1784044024.182084:0:6513:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:2.0:1784044024.182106:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38420a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+6:0:x1870705565108352:12345-192.168.202.40@tcp:41: Request processed in 33us (669us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044024.182113:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 11 00000100:00080000:3.0:1784044024.182811:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1784044024.182816:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784044024.190077:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044024.190411:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565108864 00000100:00100000:2.0:1784044024.190421:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565108864 00000100:00100000:2.0:1784044024.190492:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 12 00000100:00100000:2.0:1784044024.190504:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38420a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+6:6166:x1870705565108864:12345-192.168.202.40@tcp:40: 00000100:00100000:2.0:1784044024.190600:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38420a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+6:6166:x1870705565108864:12345-192.168.202.40@tcp:40: Request processed in 98us (531us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044024.190608:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 12 00000100:00100000:2.0:1784044024.196470:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044024.196520:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044024.196558:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044024.196590:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1784044024.196666:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565108992 00000100:00100000:1.0:1784044024.196686:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565108992 00000100:00100000:1.0:1784044024.196730:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565109120 00000100:00100000:1.0:1784044024.196733:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565109120 00000100:00100000:1.0:1784044024.196757:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 18 00000100:00100000:1.0:1784044024.196777:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38436a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2406:x1870705565108992:12345-192.168.202.40@tcp:8: 00010000:00080000:1.0:1784044024.196834:0:8427:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from a93fdf3c-d42f-420a-95ea-b0cbfe954363@192.168.202.40@tcp t0 exp 0000000000000000 cur 217 last 0 00000020:00000080:1.0:1784044024.196866:0:8427:0:(genops.c:1406:class_connect()) connect: client a93fdf3c-d42f-420a-95ea-b0cbfe954363, cookie 0x89871fc3aba17f5b 00002000:00100000:1.0:1784044024.196878:0:8427:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli a93fdf3c-d42f-420a-95ea-b0cbfe954363/ffff9b384345f800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136a2 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1784044024.196895:0:8427:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return b7 00002000:00080000:1.0:1784044024.197082:0:8427:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1784044024.197119:0:8427:0:(import.c:65:import_set_state_nolock()) ffff9b384345f000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1784044024.197241:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38436a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+6:2406:x1870705565108992:12345-192.168.202.40@tcp:8: Request processed in 465us (681us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044024.197249:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 18 00000100:00100000:1.0:1784044024.197269:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 19 00000100:00100000:1.0:1784044024.197281:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38436a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2406:x1870705565109120:12345-192.168.202.40@tcp:8: 00010000:00080000:1.0:1784044024.197298:0:8427:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from a93fdf3c-d42f-420a-95ea-b0cbfe954363@192.168.202.40@tcp t0 exp 0000000000000000 cur 217 last 0 00000020:00000080:1.0:1784044024.197315:0:8427:0:(genops.c:1406:class_connect()) connect: client a93fdf3c-d42f-420a-95ea-b0cbfe954363, cookie 0x89871fc3aba17f62 00002000:00100000:1.0:1784044024.197321:0:8427:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli a93fdf3c-d42f-420a-95ea-b0cbfe954363/ffff9b384345d000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136a2 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1784044024.197331:0:8427:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return b7 00002000:00080000:1.0:1784044024.197435:0:8427:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1784044024.197451:0:8427:0:(import.c:65:import_set_state_nolock()) ffff9b3843458800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1784044024.197476:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38436a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+6:2406:x1870705565109120:12345-192.168.202.40@tcp:8: Request processed in 194us (885us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044024.197483:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 19 00000100:00100000:0.0:1784044024.197913:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565109376 00000100:00100000:0.0:1784044024.197919:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565109376 00000100:00100000:0.0:1784044024.197964:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 198 00000100:00100000:0.0:1784044024.197972:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3965ef9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4a09ad9-a185-4679-99bb-b6a07b865440+10:2407:x1870705565109376:12345-192.168.202.40@tcp:400: 00000100:00100000:0.0:1784044024.198005:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3965ef9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4a09ad9-a185-4679-99bb-b6a07b865440+10:2407:x1870705565109376:12345-192.168.202.40@tcp:400: Request processed in 33us (1484us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044024.198011:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 198 00000100:00100000:3.0:1784044024.198109:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565109248 00000100:00100000:3.0:1784044024.198114:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565109248 00000100:00100000:3.0:1784044024.198152:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4 00000100:00100000:3.0:1784044024.198160:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38436a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+6:6166:x1870705565109248:12345-192.168.202.40@tcp:900: 00000100:00100000:3.0:1784044024.198221:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38436a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+6:6166:x1870705565109248:12345-192.168.202.40@tcp:900: Request processed in 63us (1761us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044024.198228:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4 00000100:00100000:3.0:1784044024.211309:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044024.215289:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565109504 00000100:00100000:2.0:1784044024.215306:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565109504 00000100:00100000:2.0:1784044024.215380:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 0 00000100:00100000:2.0:1784044024.215390:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38420a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+6:6166:x1870705565109504:12345-192.168.202.40@tcp:33: 00000004:00080000:3.0:1784044024.250954:0:6514:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 35479us 00000004:00200000:3.0:1784044024.299040:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1784044024.299203:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38420a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+6:6166:x1870705565109504:12345-192.168.202.40@tcp:33: Request processed in 83781us (87870us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044024.299220:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 0 00010000:00010000:3.0:1784044024.461976:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784044024.564272:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1784044024.564586:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565109632 00000100:00100000:1.0:1784044024.564595:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565109632 00000100:00100000:1.0:1784044024.564658:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 13 00000100:00100000:1.0:1784044024.564670:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38420a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+6:6208:x1870705565109632:12345-192.168.202.40@tcp:101: 00010000:00010000:1.0:1784044024.564689:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784044024.564743:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3940031e00/0x89871fc3aba17f69 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcd3dffad52ca655f expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044024.564821:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3940031800/0x89871fc3aba17f70 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044024.564834:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3940031800/0x89871fc3aba17f70 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044024.564850:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3940031800/0x89871fc3aba17f70 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784044024.564896:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1784044024.564912:0:6511:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1784044024.564929:0:6511:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b3940031800/0x89871fc3aba17f70 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044024.564953:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3940031e00/0x89871fc3aba17f69 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca655f expref: 8 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044024.564970:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3940031800/0x89871fc3aba17f70 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca655f expref: 7 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044024.564977:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b384361bd00) 00010000:00010000:1.0:1784044024.564980:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1784044024.564983:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3940031800, rc 0) 00000100:00100000:1.0:1784044024.565052:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38420a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+7:6208:x1870705565109632:12345-192.168.202.40@tcp:101: Request processed in 384us (790us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044024.565059:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 13 00000100:00100000:3.0:1784044024.909624:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39759b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1870705580885248:0@lo:41: 00000100:00100000:3.0:1784044024.909697:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044024.910009:0:7768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580885248 00000100:00100000:0.0:1784044024.910027:0:7768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580885248 00000100:00100000:0.0:1784044024.910082:0:7768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1784044024.910092:0:7768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38427b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1870705580885248:12345-0@lo:41: 00000004:00000024:0.0:1784044024.910126:0:7768:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:3.0:1784044024.910359:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39759b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1870705580885248:0@lo:41: 00000100:00100000:0.0:1784044024.910498:0:7768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38427b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1870705580885248:12345-0@lo:41: Request processed in 406us (799us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044024.910506:0:7768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00010000:2.0:1784044025.485576:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784044025.936487:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1784044025.936516:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39459b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1870705580885376:0@lo:41: 00000100:00100000:3.0:1784044025.936609:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044025.936893:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580885376 00000100:00100000:2.0:1784044025.936901:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580885376 00000100:00100000:2.0:1784044025.936955:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1784044025.936963:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3975b53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1870705580885376:12345-0@lo:41: 00000004:00000024:2.0:1784044025.936995:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1784044025.937051:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3975b53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1870705580885376:12345-0@lo:41: Request processed in 88us (441us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044025.937058:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1784044025.937402:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784044025.937413:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397aa57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1870705580885504:0@lo:13: 00000100:00100000:2.0:1784044025.937445:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044025.938129:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39759b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1870705580885632:0@lo:13: 00000100:00100000:0.0:1784044025.938190:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044025.943736:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39459b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1870705580885376:0@lo:41: 00000100:00100000:1.0:1784044025.947815:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580885504 00000100:00100000:1.0:1784044025.947936:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580885504 00000100:00100000:1.0:1784044025.948063:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580885632 00000100:00100000:1.0:1784044025.948068:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580885632 00000100:00080000:0.0:1784044025.948149:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784044025.948207:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1784044025.948304:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38436a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1870705580885504:12345-0@lo:13: 00002000:00000024:1.0:1784044025.948350:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784044025.948421:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38436a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1870705580885504:12345-0@lo:13: Request processed in 206us (10974us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044025.948429:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1784044025.948449:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1784044025.948456:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39759b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1870705580885632:12345-0@lo:13: 00002000:00000024:1.0:1784044025.948465:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784044025.948520:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39759b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1870705580885632:12345-0@lo:13: Request processed in 65us (10348us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044025.948526:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:0.0:1784044025.948732:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b39759b6300 x1870705580885632/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784044041 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784044025.948763:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39759b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1870705580885632:0@lo:13: 00010000:00080000:2.0:1784044025.948806:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b397aa57480 x1870705580885504/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784044041 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784044025.948822:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397aa57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1870705580885504:0@lo:13: 00010000:00010000:3.0:1784044026.509339:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784044026.686319:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044026.693050:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565109760 00000100:00100000:2.0:1784044026.693071:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565109760 00000100:00100000:1.0:1784044026.693239:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 14 00000100:00100000:1.0:1784044026.693255:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39759b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+7:6261:x1870705565109760:12345-192.168.202.40@tcp:41: 00000004:00000024:1.0:1784044026.693298:0:6512:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:1.0:1784044026.693381:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39759b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+7:6261:x1870705565109760:12345-192.168.202.40@tcp:41: Request processed in 130us (7075us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044026.693389:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 14 00000100:00080000:0.0:1784044026.696557:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784044026.702109:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1784044026.703019:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565109888 00000100:00100000:1.0:1784044026.703034:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565109888 00000100:00100000:1.0:1784044026.703132:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 15 00000100:00080000:0.0:1784044026.703145:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1784044026.703150:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3975b53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+6:6261:x1870705565109888:12345-192.168.202.40@tcp:41: 00000004:00000024:1.0:1784044026.703234:0:6511:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1784044026.703310:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3975b53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+6:6261:x1870705565109888:12345-192.168.202.40@tcp:41: Request processed in 168us (1216us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044026.703318:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 15 00000100:00100000:2.0:1784044026.708388:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1784044026.708500:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565110016 00000100:00100000:1.0:1784044026.708510:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565110016 00000100:00080000:0.0:1784044026.708594:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784044026.708595:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 18 00000100:00100000:1.0:1784044026.708617:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38436a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:a93fdf3c-d42f-420a-95ea-b0cbfe954363+6:6261:x1870705565110016:12345-192.168.202.40@tcp:13: 00002000:00000024:1.0:1784044026.708653:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784044026.708839:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38436a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:a93fdf3c-d42f-420a-95ea-b0cbfe954363+6:6261:x1870705565110016:12345-192.168.202.40@tcp:13: Request processed in 226us (458us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044026.708847:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 18 00000100:00100000:0.0:1784044026.711800:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044026.711914:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565110144 00000100:00100000:3.0:1784044026.711924:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565110144 00000100:00080000:0.0:1784044026.712452:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784044026.712564:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 19 00000100:00100000:1.0:1784044026.712589:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39759b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:a93fdf3c-d42f-420a-95ea-b0cbfe954363+6:6261:x1870705565110144:12345-192.168.202.40@tcp:13: 00002000:00000024:1.0:1784044026.712621:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784044026.712758:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39759b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:a93fdf3c-d42f-420a-95ea-b0cbfe954363+6:6261:x1870705565110144:12345-192.168.202.40@tcp:13: Request processed in 172us (967us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044026.712767:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 19 00000100:00100000:3.0:1784044026.957462:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397aa54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1870705580885760:0@lo:13: 00000100:00100000:3.0:1784044026.957545:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044026.957806:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1784044026.957817:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397bbbd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1870705580885888:0@lo:13: 00000100:00100000:2.0:1784044026.957857:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044026.957891:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580885760 00000100:00100000:2.0:1784044026.957897:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580885760 00000100:00100000:2.0:1784044026.957941:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580885888 00000100:00100000:2.0:1784044026.957945:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580885888 00000100:00100000:2.0:1784044026.957961:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1784044026.957969:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3975b52680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1870705580885760:12345-0@lo:13: 00002000:00000024:2.0:1784044026.957991:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784044026.958050:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3975b52680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1870705580885760:12345-0@lo:13: Request processed in 81us (505us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044026.958058:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1784044026.958081:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1784044026.958086:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397bbbf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1870705580885888:12345-0@lo:13: 00002000:00000024:2.0:1784044026.958096:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784044026.958125:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397bbbf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1870705580885888:12345-0@lo:13: Request processed in 39us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044026.958130:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:2.0:1784044026.958159:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b397bbbd500 x1870705580885888/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784044042 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784044026.958197:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397bbbd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1870705580885888:0@lo:13: 00010000:00080000:2.0:1784044026.958230:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b397aa54e00 x1870705580885760/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784044042 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784044026.958254:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397aa54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1870705580885760:0@lo:13: 00000100:00100000:3.0:1784044026.958470:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3975b50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1870705580886400:0@lo:400: 00000100:00100000:3.0:1784044026.958500:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044026.958520:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3975b51c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1870705580886912:0@lo:400: 00000100:00100000:3.0:1784044026.958541:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044026.958557:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1784044026.958563:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3975b52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:3638:1870705580886016:0@lo:400: 00000100:00100000:3.0:1784044026.958590:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044026.958610:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3975b53100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1870705580886528:0@lo:400: 00000100:00100000:3.0:1784044026.958633:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044026.958648:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39459b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1870705580887040:0@lo:400: 00000100:00100000:3.0:1784044026.958671:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044026.958695:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580886400 00000100:00100000:3.0:1784044026.958699:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580886400 00000100:00100000:3.0:1784044026.958728:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580886912 00000100:00100000:3.0:1784044026.958731:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580886912 00000100:00100000:3.0:1784044026.958758:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580887040 00000100:00100000:3.0:1784044026.958762:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580887040 00000100:00100000:3.0:1784044026.958779:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1784044026.958784:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3975b7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1870705580886400:12345-0@lo:400: 00000100:00100000:3.0:1784044026.958828:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3975b7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1870705580886400:12345-0@lo:400: Request processed in 43us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044026.958835:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1784044026.958850:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1784044026.958855:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3975b7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1870705580886912:12345-0@lo:400: 00000100:00100000:3.0:1784044026.958880:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3975b7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1870705580886912:12345-0@lo:400: Request processed in 25us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044026.958886:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1784044026.958897:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1784044026.958902:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3975b7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1870705580887040:12345-0@lo:400: 00000100:00100000:3.0:1784044026.958926:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3975b7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1870705580887040:12345-0@lo:400: Request processed in 24us (254us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044026.958931:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:3.0:1784044026.958959:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b39459b4000 x1870705580887040/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044042 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784044026.958969:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39459b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1870705580887040:0@lo:400: 00000100:00100000:3.0:1784044026.958980:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3975b50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1870705580886400:0@lo:400: 00000100:00100000:3.0:1784044026.958988:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3975b51c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1870705580886912:0@lo:400: 00000100:00100000:3.0:1784044026.959100:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3975b51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1870705580886272:0@lo:400: 00000100:00100000:3.0:1784044026.959126:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044026.959143:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3975b50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1870705580886784:0@lo:400: 00000100:00100000:3.0:1784044026.959163:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044026.959212:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3975b7df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3641:1870705580887296:0@lo:400: 00000100:00100000:3.0:1784044026.959244:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044026.959262:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1784044026.959268:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3975b52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3641:1870705580886144:0@lo:400: 00000100:00100000:3.0:1784044026.959288:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044026.959301:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3975b50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1870705580886656:0@lo:400: 00000100:00100000:3.0:1784044026.959320:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044026.959333:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3975b7fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3641:1870705580887168:0@lo:400: 00000100:00100000:3.0:1784044026.959369:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044026.959389:0:9501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580887296 00000100:00100000:3.0:1784044026.959393:0:9501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580887296 00000100:00100000:3.0:1784044026.959414:0:9501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580886144 00000100:00100000:3.0:1784044026.959416:0:9501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580886144 00000100:00100000:3.0:1784044026.959425:0:9501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580887168 00000100:00100000:3.0:1784044026.959427:0:9501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580887168 00000100:00100000:3.0:1784044026.959440:0:9501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1784044026.959446:0:9501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3975b7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1870705580887296:12345-0@lo:400: 00000100:00100000:3.0:1784044026.959478:0:9501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3975b7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1870705580887296:12345-0@lo:400: Request processed in 32us (234us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044026.959484:0:9501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1784044026.959496:0:9501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1784044026.959501:0:9501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3975b7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1870705580886144:12345-0@lo:400: 00000100:00100000:3.0:1784044026.959527:0:9501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3975b7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1870705580886144:12345-0@lo:400: Request processed in 26us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044026.959532:0:9501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1784044026.959543:0:9501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1784044026.959548:0:9501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3975b7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1870705580887168:12345-0@lo:400: 00000100:00100000:3.0:1784044026.959571:0:9501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3975b7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1870705580887168:12345-0@lo:400: Request processed in 23us (201us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044026.959583:0:9501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1784044026.959614:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3975b52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3641:1870705580886144:0@lo:400: 00000100:00100000:3.0:1784044026.959624:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3975b7fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3641:1870705580887168:0@lo:400: 00010000:00080000:3.0:1784044026.959633:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b3975b7df80 x1870705580887296/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044042 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784044026.959642:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3975b7df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3641:1870705580887296:0@lo:400: 00000100:00100000:2.0:1784044026.959812:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580886528 00000100:00100000:2.0:1784044026.959816:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580886528 00000100:00100000:2.0:1784044026.959848:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580886272 00000100:00100000:2.0:1784044026.959851:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580886272 00000100:00100000:2.0:1784044026.959865:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1784044026.959871:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3975b7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1870705580886528:12345-0@lo:400: 00000100:00100000:2.0:1784044026.959912:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3975b7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1870705580886528:12345-0@lo:400: Request processed in 41us (1278us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044026.959919:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1784044026.959931:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1784044026.959937:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3975b7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1870705580886272:12345-0@lo:400: 00000100:00100000:2.0:1784044026.959983:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3975b7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1870705580886272:12345-0@lo:400: Request processed in 45us (855us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044026.959989:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1784044026.960139:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580886016 00000100:00100000:1.0:1784044026.960145:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580886016 00000100:00100000:1.0:1784044026.960206:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:1.0:1784044026.960214:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3965ef9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+24:3638:x1870705580886016:12345-0@lo:400: 00000100:00100000:1.0:1784044026.960260:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3965ef9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+24:3638:x1870705580886016:12345-0@lo:400: Request processed in 47us (1668us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044026.960266:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:1.0:1784044026.960295:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580886784 00000100:00100000:1.0:1784044026.960299:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580886784 00000100:00100000:1.0:1784044026.960323:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580886656 00000100:00100000:1.0:1784044026.960326:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580886656 00000100:00100000:1.0:1784044026.960343:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1784044026.960349:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3975b7d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1870705580886784:12345-0@lo:400: 00000100:00100000:1.0:1784044026.960379:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3975b7d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1870705580886784:12345-0@lo:400: Request processed in 30us (1216us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044026.960385:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1784044026.960395:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1784044026.960401:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3975b7f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1870705580886656:12345-0@lo:400: 00000100:00100000:1.0:1784044026.960425:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3975b7f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1870705580886656:12345-0@lo:400: Request processed in 25us (1105us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044026.960431:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1784044026.960501:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3975b52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:3638:1870705580886016:0@lo:400: 00000100:00100000:1.0:1784044026.960525:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3975b53100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1870705580886528:0@lo:400: 00010000:00080000:1.0:1784044026.960565:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b3975b50380 x1870705580886656/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784044042 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784044026.960575:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3975b50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1870705580886656:0@lo:400: 00000100:00100000:1.0:1784044026.960586:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3975b51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1870705580886272:0@lo:400: 00010000:00080000:1.0:1784044026.960596:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b3975b50e00 x1870705580886784/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784044042 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784044026.960603:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3975b50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1870705580886784:0@lo:400: 00000100:00080000:0.0:1784044026.960982:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1784044026.960989:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1784044026.960992:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1784044027.534222:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784044028.557508:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1784044029.008046:0:6490:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of a93fdf3c-d42f-420a-95ea-b0cbfe954363 00000001:00100000:2.0:1784044029.008307:0:7443:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of a93fdf3c-d42f-420a-95ea-b0cbfe954363 00000001:00100000:1.0:1784044029.011240:0:9505:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of a93fdf3c-d42f-420a-95ea-b0cbfe954363 00010000:00010000:1.0:1784044029.581312:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784044029.682554:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044029.682595:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044029.682620:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044029.682643:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044029.682670:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044029.682696:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565110784 00000100:00100000:0.0:1784044029.682721:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565110784 00000100:00100000:0.0:1784044029.682776:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565110656 00000100:00100000:0.0:1784044029.682780:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565110656 00000100:00100000:0.0:1784044029.682805:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 8 00000100:00100000:0.0:1784044029.682815:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39759b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+5:2410:x1870705565110784:12345-192.168.202.40@tcp:400: 00000100:00100000:0.0:1784044029.682880:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39759b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+5:2410:x1870705565110784:12345-192.168.202.40@tcp:400: Request processed in 66us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044029.682904:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 8 00000100:00100000:0.0:1784044029.682921:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 9 00000100:00100000:0.0:1784044029.682927:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39759b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+6:2410:x1870705565110656:12345-192.168.202.40@tcp:400: 00000100:00100000:0.0:1784044029.682953:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39759b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+6:2410:x1870705565110656:12345-192.168.202.40@tcp:400: Request processed in 26us (283us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044029.682958:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 9 00000100:00100000:0.0:1784044029.682985:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565110528 00000100:00100000:0.0:1784044029.682988:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565110528 00000100:00100000:0.0:1784044029.683013:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565110400 00000100:00100000:0.0:1784044029.683025:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565110400 00000100:00100000:0.0:1784044029.683046:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 48 00000100:00100000:0.0:1784044029.683052:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39759b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+5:2410:x1870705565110528:12345-192.168.202.40@tcp:400: 00000100:00100000:0.0:1784044029.683078:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39759b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+5:2410:x1870705565110528:12345-192.168.202.40@tcp:400: Request processed in 25us (483us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044029.683084:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 48 00000100:00100000:0.0:1784044029.683095:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 49 00000100:00100000:0.0:1784044029.683101:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39759b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+6:2410:x1870705565110400:12345-192.168.202.40@tcp:400: 00000100:00100000:0.0:1784044029.683123:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39759b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+6:2410:x1870705565110400:12345-192.168.202.40@tcp:400: Request processed in 22us (479us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044029.683130:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 49 00000100:00080000:0.0:1784044029.683150:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1784044029.683153:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1784044029.683156:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1784044029.683157:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784044029.684404:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565110272 00000100:00100000:1.0:1784044029.684414:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565110272 00000100:00100000:1.0:1784044029.684458:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 200 00000100:00100000:1.0:1784044029.684466:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3965ef8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4a09ad9-a185-4679-99bb-b6a07b865440+10:2410:x1870705565110272:12345-192.168.202.40@tcp:400: 00000100:00100000:1.0:1784044029.684505:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3965ef8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4a09ad9-a185-4679-99bb-b6a07b865440+10:2410:x1870705565110272:12345-192.168.202.40@tcp:400: Request processed in 40us (1962us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044029.684512:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 200 00000001:02000400:2.0:1784044029.734223:0:10176:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:2.0:1784044030.029539:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1784044030.029569:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b384316f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1870705580887424:0@lo:41: 00000100:00100000:2.0:1784044030.029642:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044030.029804:0:7768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580887424 00000100:00100000:0.0:1784044030.029823:0:7768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580887424 00000100:00100000:0.0:1784044030.029882:0:7768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1784044030.029891:0:7768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397bbbd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1870705580887424:12345-0@lo:41: 00000004:00000024:0.0:1784044030.029926:0:7768:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:0.0:1784044030.030023:0:7768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397bbbd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1870705580887424:12345-0@lo:41: Request processed in 132us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044030.030030:0:7768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1784044030.030124:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b384316f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1870705580887424:0@lo:41: 00000001:00100000:3.0:1784044030.035042:0:8421:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of a93fdf3c-d42f-420a-95ea-b0cbfe954363 00010000:00010000:3.0:1784044030.616518:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784044031.053520:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784044031.053547:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b384316fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1870705580887552:0@lo:13: 00000100:00100000:0.0:1784044031.053617:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044031.053681:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580887552 00000100:00100000:0.0:1784044031.053688:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580887552 00000100:00100000:0.0:1784044031.053760:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1784044031.053770:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b384316ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1870705580887552:12345-0@lo:13: 00002000:00000024:0.0:1784044031.053797:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784044031.053840:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b384316ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1870705580887552:12345-0@lo:13: Request processed in 72us (223us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044031.053846:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:0.0:1784044031.053865:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1784044031.053891:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b384316fb80 x1870705580887552/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784044047 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784044031.053907:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b384316fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1870705580887552:0@lo:13: 00000100:00100000:0.0:1784044031.056505:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397bbbc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1870705580887680:0@lo:13: 00000100:00100000:0.0:1784044031.056566:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044031.056657:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784044031.056664:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b384316e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1870705580887808:0@lo:41: 00000100:00100000:0.0:1784044031.056689:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044031.057049:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580887808 00000100:00100000:3.0:1784044031.057058:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580887808 00000100:00100000:3.0:1784044031.057276:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1784044031.057286:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b384316dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1870705580887808:12345-0@lo:41: 00000004:00000024:3.0:1784044031.057318:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1784044031.057365:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b384316dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1870705580887808:12345-0@lo:41: Request processed in 80us (675us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044031.057372:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1784044031.057417:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b384316e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1870705580887808:0@lo:41: 00000100:00100000:3.0:1784044031.057438:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580887680 00000100:00100000:3.0:1784044031.057442:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580887680 00000100:00100000:3.0:1784044031.057477:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1784044031.057484:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b384316fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1870705580887680:12345-0@lo:13: 00002000:00000024:3.0:1784044031.057505:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784044031.057538:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b384316fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1870705580887680:12345-0@lo:13: Request processed in 55us (971us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044031.057545:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:3.0:1784044031.057563:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1784044031.057582:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b397bbbc380 x1870705580887680/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784044047 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784044031.057594:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397bbbc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1870705580887680:0@lo:13: 00010000:00010000:0.0:1784044031.631842:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784044032.077427:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397bbbe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1870705580887936:0@lo:13: 00000100:00100000:2.0:1784044032.077527:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044032.077761:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580887936 00000100:00100000:2.0:1784044032.077770:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580887936 00000100:00100000:2.0:1784044032.077842:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1784044032.077853:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397bbbdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1870705580887936:12345-0@lo:13: 00002000:00000024:2.0:1784044032.077894:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784044032.077946:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397bbbdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1870705580887936:12345-0@lo:13: Request processed in 95us (419us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044032.077965:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:2.0:1784044032.077990:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1784044032.078027:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b397bbbe680 x1870705580887936/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784044048 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784044032.078047:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397bbbe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1870705580887936:0@lo:13: 00000100:00100000:2.0:1784044032.078926:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397aa57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1870705580888064:0@lo:13: 00000100:00100000:2.0:1784044032.078990:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044032.079470:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580888064 00000100:00100000:1.0:1784044032.079478:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580888064 00000100:00100000:1.0:1784044032.079533:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1784044032.079542:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397bbbe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1870705580888064:12345-0@lo:13: 00002000:00000024:1.0:1784044032.079563:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00080000:2.0:1784044032.079697:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784044032.079752:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397bbbe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1870705580888064:12345-0@lo:13: Request processed in 211us (761us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044032.079780:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:2.0:1784044032.079852:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b397aa57100 x1870705580888064/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784044048 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784044032.079872:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397aa57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1870705580888064:0@lo:13: 00000100:00100000:2.0:1784044032.080700:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397aa57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:3640:1870705580888192:0@lo:400: 00000100:00100000:2.0:1784044032.080760:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044032.083861:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784044032.083891:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397aa54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1870705580888320:0@lo:400: 00000100:00100000:2.0:1784044032.084000:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044032.084085:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580888192 00000100:00100000:2.0:1784044032.084094:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580888192 00000100:00100000:2.0:1784044032.084164:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:2.0:1784044032.084190:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3965efa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+24:3640:x1870705580888192:12345-0@lo:400: 00000100:00100000:2.0:1784044032.084341:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3965efa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+24:3640:x1870705580888192:12345-0@lo:400: Request processed in 167us (3578us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044032.084349:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:2.0:1784044032.084415:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397aa57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:3640:1870705580888192:0@lo:400: 00000100:00100000:3.0:1784044032.084523:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580888320 00000100:00100000:3.0:1784044032.084528:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580888320 00000100:00100000:3.0:1784044032.084562:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1784044032.084569:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397bbbea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1870705580888320:12345-0@lo:400: 00000100:00100000:3.0:1784044032.084609:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397bbbea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1870705580888320:12345-0@lo:400: Request processed in 40us (610us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044032.084616:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1784044032.084751:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3842705c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1870705580888832:0@lo:400: 00000100:00100000:1.0:1784044032.084787:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044032.084819:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843c54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3641:1870705580889344:0@lo:400: 00000100:00100000:1.0:1784044032.084842:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044032.084864:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1784044032.084871:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3842707100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1870705580888704:0@lo:400: 00000100:00100000:1.0:1784044032.084894:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044032.084911:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397a8a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3641:1870705580889216:0@lo:400: 00000100:00100000:1.0:1784044032.084932:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044032.084973:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580889344 00000100:00100000:1.0:1784044032.084977:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580889344 00000100:00100000:1.0:1784044032.085014:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580889216 00000100:00100000:1.0:1784044032.085017:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580889216 00000100:00100000:1.0:1784044032.085040:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1784044032.085048:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843c56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1870705580889344:12345-0@lo:400: 00000100:00100000:1.0:1784044032.085085:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843c56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1870705580889344:12345-0@lo:400: Request processed in 39us (242us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044032.085092:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1784044032.085107:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1784044032.085114:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843c57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1870705580889216:12345-0@lo:400: 00000100:00100000:1.0:1784044032.085140:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843c57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1870705580889216:12345-0@lo:400: Request processed in 27us (207us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044032.085146:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00080000:1.0:1784044032.085204:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b397a8a4a80 x1870705580889216/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044048 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784044032.085379:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580888832 00000100:00100000:3.0:1784044032.085384:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580888832 00000100:00100000:3.0:1784044032.085489:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1784044032.085497:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843c55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1870705580888832:12345-0@lo:400: 00000100:00100000:3.0:1784044032.085531:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843c55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1870705580888832:12345-0@lo:400: Request processed in 35us (744us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044032.085537:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1784044032.089879:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397a8a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3641:1870705580889216:0@lo:400: 00010000:00080000:1.0:1784044032.089932:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b3842705c00 x1870705580888832/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784044048 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784044032.089944:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3842705c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1870705580888832:0@lo:400: 00000100:00100000:1.0:1784044032.089970:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843c54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3641:1870705580889344:0@lo:400: 00000100:00100000:2.0:1784044032.090137:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580888704 00000100:00100000:2.0:1784044032.090146:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580888704 00000100:00100000:2.0:1784044032.090259:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1784044032.090271:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843c55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1870705580888704:12345-0@lo:400: 00000100:00100000:2.0:1784044032.090391:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843c55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1870705580888704:12345-0@lo:400: Request processed in 122us (5495us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044032.090399:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00080000:2.0:1784044032.090429:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1784044032.090435:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784044032.090455:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397aa57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3639:1870705580888576:0@lo:400: 00000100:00100000:2.0:1784044032.090503:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044032.090539:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397a8a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3639:1870705580889088:0@lo:400: 00000100:00100000:2.0:1784044032.090561:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044032.090586:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1784044032.090614:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397aa57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1870705580888448:0@lo:400: 00000100:00100000:2.0:1784044032.090643:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044032.090666:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397a8a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1870705580888960:0@lo:400: 00000100:00100000:2.0:1784044032.090690:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044032.090710:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843c57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3639:1870705580889472:0@lo:400: 00000100:00100000:2.0:1784044032.090737:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044032.090768:0:7768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580888448 00000100:00100000:2.0:1784044032.090772:0:7768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580888448 00000100:00100000:2.0:1784044032.090798:0:7768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1784044032.090805:0:7768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397bbbe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1870705580888448:12345-0@lo:400: 00000100:00100000:2.0:1784044032.090840:0:7768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397bbbe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1870705580888448:12345-0@lo:400: Request processed in 35us (195us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044032.090847:0:7768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1784044032.090867:0:9822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580888960 00000100:00100000:2.0:1784044032.090870:0:9822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580888960 00000100:00100000:2.0:1784044032.090898:0:9822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1784044032.090905:0:9822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397bbbfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3639:x1870705580888960:12345-0@lo:400: 00000100:00100000:2.0:1784044032.090934:0:9822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397bbbfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3639:x1870705580888960:12345-0@lo:400: Request processed in 30us (243us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044032.090940:0:9822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1784044032.090976:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580888576 00000100:00100000:2.0:1784044032.090980:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580888576 00000100:00100000:2.0:1784044032.091006:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580889088 00000100:00100000:2.0:1784044032.091009:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580889088 00000100:00100000:2.0:1784044032.091030:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580889472 00000100:00100000:2.0:1784044032.091033:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580889472 00000100:00100000:2.0:1784044032.091051:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1784044032.091057:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397bbbce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1870705580888576:12345-0@lo:400: 00000100:00100000:2.0:1784044032.091096:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397bbbce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1870705580888576:12345-0@lo:400: Request processed in 39us (593us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044032.091103:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1784044032.091117:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1784044032.091122:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397bbbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1870705580889088:12345-0@lo:400: 00000100:00100000:2.0:1784044032.091146:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397bbbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1870705580889088:12345-0@lo:400: Request processed in 24us (584us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044032.091152:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1784044032.091162:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1784044032.091168:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397bbbdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1870705580889472:12345-0@lo:400: 00000100:00100000:2.0:1784044032.091220:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397bbbdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1870705580889472:12345-0@lo:400: Request processed in 52us (482us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044032.091226:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00080000:2.0:1784044032.091244:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1784044032.091247:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784044032.091294:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397aa54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1870705580888320:0@lo:400: 00000100:00100000:2.0:1784044032.091325:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397aa57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1870705580888448:0@lo:400: 00010000:00080000:2.0:1784044032.091336:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b397a8a4700 x1870705580888960/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784044048 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784044032.091345:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397a8a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1870705580888960:0@lo:400: 00010000:00080000:2.0:1784044032.091354:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b3843c57800 x1870705580889472/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044048 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784044032.091361:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843c57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3639:1870705580889472:0@lo:400: 00000100:00100000:2.0:1784044032.091370:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397aa57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3639:1870705580888576:0@lo:400: 00000100:00100000:2.0:1784044032.091389:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397a8a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3639:1870705580889088:0@lo:400: 00000100:00100000:1.0:1784044032.091812:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3842707100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1870705580888704:0@lo:400: 00010000:00010000:3.0:1784044032.654099:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1784044033.488974:0:10324:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffcbcd92bc0 20000000:00000080:0.0:1784044033.488992:0:10324:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9b3843c44000 uarg=0000000000000000 20000000:01000000:0.0:1784044033.489033:0:10324:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:0.0:1784044033.489036:0:10324:0:(mgs_llog.c:6065:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:0.0:1784044033.489039:0:10324:0:(mgs_llog.c:6096:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:0.0:1784044033.489044:0:10324:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:0.0:1784044033.489048:0:10324:0:(mgs_llog.c:4177:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:0.0:1784044033.489107:0:10324:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1784044033.489109:0:10324:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1784044033.490252:0:10325:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000040:00080000:0.0:1784044033.490499:0:10324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 224 off15640 00000040:00080000:0.0:1784044033.490526:0:10324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 120 off15760 00000040:00080000:0.0:1784044033.490541:0:10324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15984 20000000:01000000:0.0:1784044033.490550:0:10324:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:0.0:1784044033.490553:0:10324:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1784044033.491071:0:10326:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 8 count 8 00000040:00080000:0.0:1784044033.491303:0:10324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9632 00000040:00080000:0.0:1784044033.491323:0:10324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 120 off9752 00000040:00080000:0.0:1784044033.491339:0:10324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off9976 20000000:01000000:0.0:1784044033.491348:0:10324:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1784044033.491350:0:10324:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1784044033.501572:0:10327:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000040:00080000:2.0:1784044033.501934:0:10324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10160 00000040:00080000:2.0:1784044033.501981:0:10324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 120 off10280 00000040:00080000:2.0:1784044033.501995:0:10324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 224 off10504 20000000:01000000:2.0:1784044033.502006:0:10324:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:2.0:1784044033.502009:0:10324:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1784044033.502550:0:10328:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000040:00080000:2.0:1784044033.502770:0:10324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].43, 224 off15672 00000040:00080000:2.0:1784044033.502793:0:10324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].44, 120 off15792 00000040:00080000:2.0:1784044033.502806:0:10324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].45, 224 off16016 20000000:01000000:2.0:1784044033.502813:0:10324:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1784044033.502815:0:10324:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1784044033.504753:0:10329:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000040:00080000:3.0:1784044033.505297:0:10324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].49, 224 off16608 00000040:00080000:3.0:1784044033.505338:0:10324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].50, 120 off16728 00000040:00080000:3.0:1784044033.505357:0:10324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].51, 224 off16952 10000000:01000000:3.0:1784044033.505372:0:10324:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1784044033.505393:0:10324:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b39759f9a00/0x89871fc3aba17f77 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044033.505411:0:10324:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b39759f9200/0x89871fc3aba17e12 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x89871fc3aba17e0b expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044033.505419:0:10324:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b394166ac00/0x89871fc3aba17e3c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x89871fc3aba17e35 expref: 23 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044033.505425:0:10324:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b39759f8a00/0x89871fc3aba17e7b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x89871fc3aba17e74 expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044033.505432:0:10324:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b39759f9c00/0x89871fc3aba17e89 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x89871fc3aba17e82 expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044033.505438:0:10324:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b394166b800/0x89871fc3aba17e97 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x89871fc3aba17e90 expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044033.505444:0:10324:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b3982054c00/0x89871fc3aba17eb3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x89871fc3aba17eac expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044033.505450:0:10324:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b3965d1c800/0x89871fc3aba17ed6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x89871fc3aba17ecf expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044033.505455:0:10324:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b394166be00/0x89871fc3aba17ef9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x89871fc3aba17ef2 expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044033.505461:0:10324:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b394166a400/0x89871fc3aba17f23 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x89871fc3aba17f1c expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044033.505489:0:10324:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b3982054e00/0x89871fc3aba17f31 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca64ef expref: 9 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044033.505495:0:10324:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b39759f8600/0x89871fc3aba17f38 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca64f6 expref: 9 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044033.505503:0:10324:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b39759f9a00/0x89871fc3aba17f77 lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044033.505543:0:10324:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b39759f8600/0x89871fc3aba17f38 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca64f6 expref: 9 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044033.505557:0:10324:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b39759f8600/0x89871fc3aba17f38 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca64f6 expref: 9 pid: 6504 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044033.505573:0:10324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3975b7df80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10324:1870705580889600:192.168.202.40@tcp:104: 00010000:00010000:3.0:1784044033.505677:0:10324:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b3982054e00/0x89871fc3aba17f31 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca64ef expref: 9 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044033.505686:0:10324:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b3982054e00/0x89871fc3aba17f31 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca64ef expref: 9 pid: 6505 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044033.505695:0:10324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3975b7fb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10324:1870705580889728:192.168.202.40@tcp:104: 00010000:00010000:3.0:1784044033.505726:0:10324:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b394166a400/0x89871fc3aba17f23 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x89871fc3aba17f1c expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044033.505735:0:10324:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b394166a400/0x89871fc3aba17f23 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x89871fc3aba17f1c expref: 23 pid: 6506 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044033.505754:0:10324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3975b7e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10324:1870705580889856:0@lo:104: 00000100:00100000:3.0:1784044033.505817:0:10324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1784044033.505845:0:10324:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b394166be00/0x89871fc3aba17ef9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x89871fc3aba17ef2 expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044033.505853:0:10324:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b394166be00/0x89871fc3aba17ef9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x89871fc3aba17ef2 expref: 23 pid: 6506 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044033.505861:0:10324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3975b7ea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10324:1870705580889984:0@lo:104: 00000100:00100000:3.0:1784044033.505882:0:10324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044033.505915:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580889856 00000100:00100000:3.0:1784044033.505922:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580889856 00000100:00100000:3.0:1784044033.505969:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580889984 00000100:00100000:3.0:1784044033.505973:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580889984 00000100:00100000:3.0:1784044033.505988:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1784044033.505996:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3975b7dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+4:10324:x1870705580889856:12345-0@lo:104: 00010000:00010000:3.0:1784044033.506009:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.140@tcp lock: ffff9b3965d1d600/0x89871fc3aba17f1c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x89871fc3aba17f23 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044033.506062:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1784044033.506068:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3975b7dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+4:10324:x1870705580889856:12345-0@lo:104: Request processed in 73us (252us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044033.506076:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1784044033.506094:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1784044033.506100:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3975b7ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+3:10324:x1870705580889984:12345-0@lo:104: 00010000:00010000:3.0:1784044033.506107:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.140@tcp lock: ffff9b3965d1d800/0x89871fc3aba17ef2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x89871fc3aba17ef9 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044033.506145:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1784044033.506150:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3975b7ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+3:10324:x1870705580889984:12345-0@lo:104: Request processed in 51us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044033.506156:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:3.0:1784044033.506192:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1784044033.506197:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: ffff9b3965d1d600/0x89871fc3aba17f1c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x89871fc3aba17f23 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044033.506204:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3965d1d600 already unused, calling callback (ffffffffc113cc20) 10000000:00010000:3.0:1784044033.506207:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: ffff9b3965d1d600/0x89871fc3aba17f1c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0x89871fc3aba17f23 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044033.506215:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9b3965d1d600/0x89871fc3aba17f1c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0x89871fc3aba17f23 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784044033.506221:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9b3965d1d600/0x89871fc3aba17f1c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0x89871fc3aba17f23 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784044033.506226:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1784044033.506251:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.140@tcp lock: ffff9b3965d1d600/0x89871fc3aba17f1c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x89871fc3aba17f23 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044033.506257:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784044033.506277:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: ffff9b3965d1d600/0x89871fc3aba17f1c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x89871fc3aba17f23 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044033.506285:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9b3965d1d600/0x89871fc3aba17f1c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x89871fc3aba17f23 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044033.506310:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784044033.506314:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: ffff9b3965d1d800/0x89871fc3aba17ef2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x89871fc3aba17ef9 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044033.506319:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3965d1d800 already unused, calling callback (ffffffffc113cc20) 10000000:00010000:3.0:1784044033.506321:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: ffff9b3965d1d800/0x89871fc3aba17ef2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0x89871fc3aba17ef9 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044033.506327:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9b3965d1d800/0x89871fc3aba17ef2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0x89871fc3aba17ef9 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784044033.506333:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9b3965d1d800/0x89871fc3aba17ef2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0x89871fc3aba17ef9 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784044033.506337:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1784044033.506350:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.140@tcp lock: ffff9b3965d1d800/0x89871fc3aba17ef2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x89871fc3aba17ef9 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044033.506355:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784044033.506368:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: ffff9b3965d1d800/0x89871fc3aba17ef2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x89871fc3aba17ef9 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044033.506375:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9b3965d1d800/0x89871fc3aba17ef2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x89871fc3aba17ef9 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044033.506383:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784044033.506384:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784044033.506386:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784044033.506397:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3975b7f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:3639:1870705580890112:0@lo:103: 00000100:00100000:3.0:1784044033.506431:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044033.506464:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3975b7e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:3640:1870705580890240:0@lo:103: 00000100:00100000:3.0:1784044033.506485:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044033.506508:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580890112 00000100:00100000:3.0:1784044033.506511:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580890112 00010000:00010000:3.0:1784044033.506527:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b394166a400/0x89871fc3aba17f23 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x89871fc3aba17f1c expref: 24 pid: 6506 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044033.506544:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580890240 00000100:00100000:3.0:1784044033.506546:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580890240 00010000:00010000:3.0:1784044033.506554:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b394166be00/0x89871fc3aba17ef9 lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x89871fc3aba17ef2 expref: 25 pid: 6506 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044033.506563:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1784044033.506568:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3944091050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+25:3639:x1870705580890112:12345-0@lo:103: 00010000:00010000:3.0:1784044033.506578:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784044033.506582:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b394166a400/0x89871fc3aba17f23 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x89871fc3aba17f1c expref: 25 pid: 6506 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044033.506590:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b394166a400/0x89871fc3aba17f23 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x89871fc3aba17f1c expref: 25 pid: 6506 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044033.506604:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784044033.506627:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3944091050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+25:3639:x1870705580890112:12345-0@lo:103: Request processed in 58us (195us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044033.506632:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1784044033.506661:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1784044033.506666:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3975b50e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+24:3640:x1870705580890240:12345-0@lo:103: 00010000:00010000:3.0:1784044033.506672:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784044033.506680:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b394166be00/0x89871fc3aba17ef9 lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x89871fc3aba17ef2 expref: 24 pid: 6506 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044033.506687:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b394166be00/0x89871fc3aba17ef9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x89871fc3aba17ef2 expref: 24 pid: 6506 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044033.506696:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784044033.506717:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3975b50e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+24:3640:x1870705580890240:12345-0@lo:103: Request processed in 51us (231us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044033.506723:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1784044033.506751:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3975b7e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:3640:1870705580890240:0@lo:103: 00000100:00100000:3.0:1784044033.506770:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3975b7f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:3639:1870705580890112:0@lo:103: 00010000:00010000:3.0:1784044033.506792:0:10324:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b3965d1c800/0x89871fc3aba17ed6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x89871fc3aba17ecf expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044033.506801:0:10324:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b3965d1c800/0x89871fc3aba17ed6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x89871fc3aba17ecf expref: 23 pid: 6505 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044033.506809:0:10324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3975b51500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10324:1870705580890368:0@lo:104: 00000100:00100000:3.0:1784044033.506830:0:10324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044033.506852:0:6495:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1784044033.506858:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580890368 00000100:00100000:3.0:1784044033.506861:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580890368 00000100:00100000:3.0:1784044033.506875:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1784044033.506880:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3975b97450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+3:10324:x1870705580890368:12345-0@lo:104: 00010000:00010000:3.0:1784044033.506887:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.140@tcp lock: ffff9b3965d1cc00/0x89871fc3aba17ecf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x89871fc3aba17ed6 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044033.506915:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1784044033.506925:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3975b97450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+3:10324:x1870705580890368:12345-0@lo:104: Request processed in 46us (95us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044033.506931:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:3.0:1784044033.506975:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784044033.506979:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: ffff9b3965d1cc00/0x89871fc3aba17ecf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x89871fc3aba17ed6 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044033.506986:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3965d1cc00 already unused, calling callback (ffffffffc113cc20) 10000000:00010000:3.0:1784044033.506988:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: ffff9b3965d1cc00/0x89871fc3aba17ecf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x89871fc3aba17ed6 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044033.506995:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9b3965d1cc00/0x89871fc3aba17ecf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x89871fc3aba17ed6 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784044033.507001:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9b3965d1cc00/0x89871fc3aba17ecf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x89871fc3aba17ed6 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784044033.507005:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1784044033.507018:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.140@tcp lock: ffff9b3965d1cc00/0x89871fc3aba17ecf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x89871fc3aba17ed6 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044033.507023:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784044033.507032:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: ffff9b3965d1cc00/0x89871fc3aba17ecf lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x89871fc3aba17ed6 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044033.507038:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9b3965d1cc00/0x89871fc3aba17ecf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x89871fc3aba17ed6 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044033.507048:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784044033.507049:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784044033.507051:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784044033.507064:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784044033.507071:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3975b50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:3640:1870705580890496:0@lo:103: 00000100:00100000:3.0:1784044033.507095:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044033.507114:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580890496 00000100:00100000:3.0:1784044033.507118:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580890496 00010000:00010000:3.0:1784044033.507129:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b3965d1c800/0x89871fc3aba17ed6 lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x89871fc3aba17ecf expref: 24 pid: 6505 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044033.507144:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1784044033.507149:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3975b53100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+24:3640:x1870705580890496:12345-0@lo:103: 00010000:00010000:3.0:1784044033.507207:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784044033.507213:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b3965d1c800/0x89871fc3aba17ed6 lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x89871fc3aba17ecf expref: 24 pid: 6505 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044033.507221:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b3965d1c800/0x89871fc3aba17ed6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x89871fc3aba17ecf expref: 24 pid: 6505 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044033.507229:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784044033.507252:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3975b53100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+24:3640:x1870705580890496:12345-0@lo:103: Request processed in 104us (157us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044033.507257:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1784044033.507280:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3975b50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:3640:1870705580890496:0@lo:103: 00010000:00010000:3.0:1784044033.507305:0:10324:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b3982054c00/0x89871fc3aba17eb3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x89871fc3aba17eac expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044033.507313:0:10324:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b3982054c00/0x89871fc3aba17eb3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x89871fc3aba17eac expref: 23 pid: 6506 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044033.507323:0:10324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3975b50380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10324:1870705580890624:0@lo:104: 00000100:00100000:3.0:1784044033.507350:0:10324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044033.507370:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580890624 00000100:00100000:3.0:1784044033.507373:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580890624 00000100:00100000:3.0:1784044033.507389:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1784044033.507395:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3975b52a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+3:10324:x1870705580890624:12345-0@lo:104: 00010000:00010000:3.0:1784044033.507402:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.140@tcp lock: ffff9b394166b600/0x89871fc3aba17eac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x89871fc3aba17eb3 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044033.507431:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1784044033.507436:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3975b52a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+3:10324:x1870705580890624:12345-0@lo:104: Request processed in 42us (86us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044033.507442:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00010000:3.0:1784044033.507454:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784044033.507457:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: ffff9b394166b600/0x89871fc3aba17eac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x89871fc3aba17eb3 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044033.507464:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b394166b600 already unused, calling callback (ffffffffc113cc20) 10000000:00010000:3.0:1784044033.507467:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: ffff9b394166b600/0x89871fc3aba17eac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x89871fc3aba17eb3 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044033.507474:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9b394166b600/0x89871fc3aba17eac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x89871fc3aba17eb3 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784044033.507480:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9b394166b600/0x89871fc3aba17eac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x89871fc3aba17eb3 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784044033.507485:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1784044033.507499:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.140@tcp lock: ffff9b394166b600/0x89871fc3aba17eac lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x89871fc3aba17eb3 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044033.507514:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784044033.507526:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: ffff9b394166b600/0x89871fc3aba17eac lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x89871fc3aba17eb3 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044033.507532:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9b394166b600/0x89871fc3aba17eac lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x89871fc3aba17eb3 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044033.507541:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784044033.507542:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784044033.507543:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784044033.507553:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3975b52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:3638:1870705580890752:0@lo:103: 00000100:00100000:3.0:1784044033.507577:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044033.507604:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580890752 00000100:00100000:3.0:1784044033.507608:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580890752 00010000:00010000:3.0:1784044033.507621:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b3982054c00/0x89871fc3aba17eb3 lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x89871fc3aba17eac expref: 24 pid: 6506 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044033.507637:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1784044033.507643:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3975b51c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+24:3638:x1870705580890752:12345-0@lo:103: 00010000:00010000:3.0:1784044033.507649:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784044033.507653:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b3982054c00/0x89871fc3aba17eb3 lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x89871fc3aba17eac expref: 24 pid: 6506 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044033.507660:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b3982054c00/0x89871fc3aba17eb3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x89871fc3aba17eac expref: 24 pid: 6506 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044033.507669:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784044033.507690:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3975b51c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+24:3638:x1870705580890752:12345-0@lo:103: Request processed in 48us (113us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044033.507700:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1784044033.507723:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3975b52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:3638:1870705580890752:0@lo:103: 00010000:00010000:3.0:1784044033.507743:0:10324:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b394166b800/0x89871fc3aba17e97 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x89871fc3aba17e90 expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044033.507751:0:10324:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b394166b800/0x89871fc3aba17e97 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x89871fc3aba17e90 expref: 23 pid: 6505 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044033.507758:0:10324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3975b52d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10324:1870705580890880:0@lo:104: 00000100:00100000:3.0:1784044033.507776:0:10324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044033.507791:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580890880 00000100:00100000:3.0:1784044033.507794:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580890880 00000100:00100000:3.0:1784044033.507807:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1784044033.507811:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3975b50000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+3:10324:x1870705580890880:12345-0@lo:104: 00010000:00010000:3.0:1784044033.507818:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.140@tcp lock: ffff9b394166ae00/0x89871fc3aba17e90 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x89871fc3aba17e97 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044033.507844:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1784044033.507848:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3975b50000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+3:10324:x1870705580890880:12345-0@lo:104: Request processed in 37us (72us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044033.507853:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00010000:3.0:1784044033.507864:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784044033.507867:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: ffff9b394166ae00/0x89871fc3aba17e90 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x89871fc3aba17e97 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044033.507873:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b394166ae00 already unused, calling callback (ffffffffc113cc20) 10000000:00010000:3.0:1784044033.507875:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: ffff9b394166ae00/0x89871fc3aba17e90 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x89871fc3aba17e97 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044033.507886:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9b394166ae00/0x89871fc3aba17e90 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x89871fc3aba17e97 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784044033.507893:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9b394166ae00/0x89871fc3aba17e90 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x89871fc3aba17e97 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784044033.507898:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1784044033.507913:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.140@tcp lock: ffff9b394166ae00/0x89871fc3aba17e90 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x89871fc3aba17e97 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044033.507918:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784044033.507928:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: ffff9b394166ae00/0x89871fc3aba17e90 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x89871fc3aba17e97 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044033.507935:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9b394166ae00/0x89871fc3aba17e90 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x89871fc3aba17e97 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044033.509035:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784044033.509329:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b38420ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:3639:1870705580891008:0@lo:103: 00000100:00100000:2.0:1784044033.509381:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1784044033.509477:0:10324:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b39759f9c00/0x89871fc3aba17e89 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x89871fc3aba17e82 expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044033.509488:0:10324:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b39759f9c00/0x89871fc3aba17e89 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x89871fc3aba17e82 expref: 23 pid: 6505 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044033.509499:0:10324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397bbbd180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10324:1870705580891136:0@lo:104: 00000100:00100000:2.0:1784044033.509522:0:10324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1784044033.509555:0:10324:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b39759f8a00/0x89871fc3aba17e7b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x89871fc3aba17e74 expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044033.509564:0:10324:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b39759f8a00/0x89871fc3aba17e7b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x89871fc3aba17e74 expref: 23 pid: 6505 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044033.509571:0:10324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397bbbc000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10324:1870705580891264:0@lo:104: 00000100:00100000:2.0:1784044033.509605:0:10324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044033.509629:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580891136 00000100:00100000:2.0:1784044033.509636:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580891136 00000100:00100000:2.0:1784044033.509666:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580891264 00000100:00100000:2.0:1784044033.509669:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580891264 00000100:00100000:2.0:1784044033.509681:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1784044033.509688:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397bbbca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+4:10324:x1870705580891136:12345-0@lo:104: 00010000:00010000:2.0:1784044033.509699:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.140@tcp lock: ffff9b39759f9400/0x89871fc3aba17e82 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x89871fc3aba17e89 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044033.509750:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1784044033.509756:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397bbbca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+4:10324:x1870705580891136:12345-0@lo:104: Request processed in 68us (233us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044033.509762:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1784044033.509776:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1784044033.509782:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397bbbf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+3:10324:x1870705580891264:12345-0@lo:104: 00010000:00010000:2.0:1784044033.509789:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.140@tcp lock: ffff9b3965d1d000/0x89871fc3aba17e74 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x89871fc3aba17e7b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044033.509812:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1784044033.509818:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397bbbf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+3:10324:x1870705580891264:12345-0@lo:104: Request processed in 36us (212us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044033.509823:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00010000:2.0:1784044033.509848:0:10324:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b394166ac00/0x89871fc3aba17e3c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x89871fc3aba17e35 expref: 23 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044033.509857:0:10324:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b394166ac00/0x89871fc3aba17e3c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x89871fc3aba17e35 expref: 23 pid: 6504 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044033.509876:0:10324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397bbbd880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10324:1870705580891392:0@lo:104: 00000100:00100000:2.0:1784044033.509897:0:10324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044033.509916:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580891392 00000100:00100000:2.0:1784044033.509920:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580891392 00000100:00100000:2.0:1784044033.509936:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1784044033.509954:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397bbbed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+3:10324:x1870705580891392:12345-0@lo:104: 00010000:00010000:2.0:1784044033.509962:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.140@tcp lock: ffff9b39759f8400/0x89871fc3aba17e35 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x89871fc3aba17e3c expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044033.509986:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1784044033.509991:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397bbbed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+3:10324:x1870705580891392:12345-0@lo:104: Request processed in 39us (93us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044033.509997:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00010000:2.0:1784044033.510022:0:10324:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b39759f9200/0x89871fc3aba17e12 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x89871fc3aba17e0b expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044033.510030:0:10324:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b39759f9200/0x89871fc3aba17e12 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x89871fc3aba17e0b expref: 23 pid: 6506 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044033.510038:0:10324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397bbbc380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10324:1870705580891520:0@lo:104: 00000100:00100000:2.0:1784044033.510058:0:10324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044033.510073:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580891520 00000100:00100000:2.0:1784044033.510075:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580891520 00000100:00100000:2.0:1784044033.510088:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1784044033.510093:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397aa57100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+3:10324:x1870705580891520:12345-0@lo:104: 00010000:00010000:2.0:1784044033.510100:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.140@tcp lock: ffff9b3982054600/0x89871fc3aba17e0b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x89871fc3aba17e12 expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044033.510131:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1784044033.510136:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397aa57100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+3:10324:x1870705580891520:12345-0@lo:104: Request processed in 43us (77us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044033.510142:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1784044033.510157:0:10324:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b397aa67240 going to sleep for 11 seconds 00010000:00010000:2.0:1784044033.510203:0:10324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b394166a400/0x89871fc3aba17f23 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x89871fc3aba17f1c expref: 23 pid: 6506 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044033.510215:0:10324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3975b7e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10324:1870705580889856:0@lo:104: 00010000:00010000:2.0:1784044033.510227:0:10324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b394166be00/0x89871fc3aba17ef9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x89871fc3aba17ef2 expref: 22 pid: 6506 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044033.510234:0:10324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3975b7ea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10324:1870705580889984:0@lo:104: 00010000:00010000:2.0:1784044033.510242:0:10324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b3965d1c800/0x89871fc3aba17ed6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x89871fc3aba17ecf expref: 21 pid: 6505 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044033.510249:0:10324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3975b51500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10324:1870705580890368:0@lo:104: 00010000:00010000:2.0:1784044033.510256:0:10324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b3982054c00/0x89871fc3aba17eb3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x89871fc3aba17eac expref: 20 pid: 6506 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044033.510264:0:10324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3975b50380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10324:1870705580890624:0@lo:104: 00000100:00100000:2.0:1784044033.510270:0:10324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3975b52d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10324:1870705580890880:0@lo:104: 00000100:00100000:2.0:1784044033.510275:0:10324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397bbbd180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10324:1870705580891136:0@lo:104: 00000100:00100000:2.0:1784044033.510281:0:10324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397bbbc000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10324:1870705580891264:0@lo:104: 00000100:00100000:2.0:1784044033.510286:0:10324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397bbbd880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10324:1870705580891392:0@lo:104: 00000100:00100000:2.0:1784044033.510292:0:10324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397bbbc380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10324:1870705580891520:0@lo:104: 00010000:00010000:1.0:1784044033.510357:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00000100:00100000:0.0:1784044033.510584:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580891008 00000100:00100000:0.0:1784044033.510589:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580891008 00010000:00010000:0.0:1784044033.510609:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b394166b800/0x89871fc3aba17e97 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x89871fc3aba17e90 expref: 20 pid: 6505 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044033.510635:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1784044033.510640:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397bbbc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+20:3639:x1870705580891008:12345-0@lo:103: 00010000:00010000:0.0:1784044033.510648:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784044033.510653:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b394166b800/0x89871fc3aba17e97 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x89871fc3aba17e90 expref: 20 pid: 6505 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044033.510661:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b394166b800/0x89871fc3aba17e97 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x89871fc3aba17e90 expref: 20 pid: 6505 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044033.510682:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b394166b800/0x89871fc3aba17e97 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x89871fc3aba17e90 expref: 20 pid: 6505 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044033.510694:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784044033.510731:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397bbbc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+19:3639:x1870705580891008:12345-0@lo:103: Request processed in 91us (1349us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044033.510737:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1784044033.510764:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b38420ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:3639:1870705580891008:0@lo:103: 00010000:00010000:3.0:1784044033.511512:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1784044033.511517:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: ffff9b3965d1d000/0x89871fc3aba17e74 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x89871fc3aba17e7b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044033.511524:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3965d1d000 already unused, calling callback (ffffffffc113cc20) 10000000:00010000:3.0:1784044033.511529:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: ffff9b3965d1d000/0x89871fc3aba17e74 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x89871fc3aba17e7b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044033.511539:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9b3965d1d000/0x89871fc3aba17e74 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x89871fc3aba17e7b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784044033.511547:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9b3965d1d000/0x89871fc3aba17e74 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x89871fc3aba17e7b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784044033.511561:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1784044033.511631:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.140@tcp lock: ffff9b3965d1d000/0x89871fc3aba17e74 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x89871fc3aba17e7b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044033.511638:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784044033.511664:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: ffff9b3965d1d000/0x89871fc3aba17e74 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x89871fc3aba17e7b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044033.511671:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9b3965d1d000/0x89871fc3aba17e74 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x89871fc3aba17e7b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044033.511686:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1784044033.511699:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b38420ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:3641:1870705580891648:0@lo:103: 00000100:00100000:3.0:1784044033.511748:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044033.511786:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580891648 00000100:00100000:3.0:1784044033.511790:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580891648 00010000:00010000:3.0:1784044033.511809:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b39759f8a00/0x89871fc3aba17e7b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x89871fc3aba17e74 expref: 19 pid: 6505 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044033.511828:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1784044033.511833:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38420ab480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+19:3641:x1870705580891648:12345-0@lo:103: 00010000:00010000:3.0:1784044033.511841:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784044033.511845:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b39759f8a00/0x89871fc3aba17e7b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x89871fc3aba17e74 expref: 19 pid: 6505 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044033.511853:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b39759f8a00/0x89871fc3aba17e7b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x89871fc3aba17e74 expref: 19 pid: 6505 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044033.511862:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b39759f8a00/0x89871fc3aba17e7b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x89871fc3aba17e74 expref: 19 pid: 6505 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044033.511878:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784044033.511902:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38420ab480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+18:3641:x1870705580891648:12345-0@lo:103: Request processed in 69us (154us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044033.511908:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1784044033.511931:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b38420ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:3641:1870705580891648:0@lo:103: 00010000:00010000:3.0:1784044033.511986:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1784044033.511991:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: ffff9b39759f8400/0x89871fc3aba17e35 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x89871fc3aba17e3c expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044033.511997:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b39759f8400 already unused, calling callback (ffffffffc113cc20) 10000000:00010000:3.0:1784044033.512000:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: ffff9b39759f8400/0x89871fc3aba17e35 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x89871fc3aba17e3c expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044033.512006:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9b39759f8400/0x89871fc3aba17e35 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x89871fc3aba17e3c expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784044033.512012:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9b39759f8400/0x89871fc3aba17e35 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x89871fc3aba17e3c expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784044033.512017:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1784044033.512563:0:10330:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784044033.512964:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: ffff9b39759f9400/0x89871fc3aba17e82 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x89871fc3aba17e89 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044033.512974:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b39759f9400 already unused, calling callback (ffffffffc113cc20) 10000000:00010000:2.0:1784044033.512978:0:6499:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: ffff9b39759f9400/0x89871fc3aba17e82 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x89871fc3aba17e89 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044033.512985:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9b39759f9400/0x89871fc3aba17e82 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x89871fc3aba17e89 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784044033.512993:0:6499:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9b39759f9400/0x89871fc3aba17e82 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x89871fc3aba17e89 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784044033.512998:0:6499:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1784044033.513199:0:10331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784044033.513202:0:10331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784044033.513204:0:10331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784044033.513245:0:10330:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: ffff9b3982054600/0x89871fc3aba17e0b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x89871fc3aba17e12 expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044033.513252:0:10330:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3982054600 already unused, calling callback (ffffffffc113cc20) 10000000:00010000:1.0:1784044033.513255:0:10330:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: ffff9b3982054600/0x89871fc3aba17e0b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x89871fc3aba17e12 expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044033.513262:0:10330:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9b3982054600/0x89871fc3aba17e0b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x89871fc3aba17e12 expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784044033.513268:0:10330:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9b3982054600/0x89871fc3aba17e0b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x89871fc3aba17e12 expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784044033.513272:0:10330:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1784044033.513308:0:10330:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.140@tcp lock: ffff9b3982054600/0x89871fc3aba17e0b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x89871fc3aba17e12 expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044033.513325:0:10330:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784044033.513348:0:10330:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: ffff9b3982054600/0x89871fc3aba17e0b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x89871fc3aba17e12 expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044033.513356:0:10330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9b3982054600/0x89871fc3aba17e0b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x89871fc3aba17e12 expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044033.513373:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784044033.513388:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843c54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:3640:1870705580891776:0@lo:103: 00000100:00100000:1.0:1784044033.513432:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044033.513473:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580891776 00000100:00100000:1.0:1784044033.513478:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580891776 00010000:00010000:1.0:1784044033.513496:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b39759f9200/0x89871fc3aba17e12 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x89871fc3aba17e0b expref: 18 pid: 6506 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044033.513520:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1784044033.513527:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843c54380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+18:3640:x1870705580891776:12345-0@lo:103: 00010000:00010000:1.0:1784044033.513538:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784044033.513543:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b39759f9200/0x89871fc3aba17e12 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x89871fc3aba17e0b expref: 18 pid: 6506 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044033.513552:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b39759f9200/0x89871fc3aba17e12 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x89871fc3aba17e0b expref: 18 pid: 6506 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044033.513564:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b39759f9200/0x89871fc3aba17e12 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x89871fc3aba17e0b expref: 18 pid: 6506 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044033.513575:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784044033.513603:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843c54380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+17:3640:x1870705580891776:12345-0@lo:103: Request processed in 77us (171us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044033.513615:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1784044033.513646:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843c54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:3640:1870705580891776:0@lo:103: 00010000:00010000:1.0:1784044033.513658:0:10330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784044033.513660:0:10330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784044033.513661:0:10330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784044033.514006:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044033.514070:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044033.514086:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565110912 00000100:00100000:3.0:1784044033.514090:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565110912 00010000:00010000:3.0:1784044033.514107:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b39759f8600/0x89871fc3aba17f38 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca64f6 expref: 10 pid: 6504 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044033.514118:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565111040 00000100:00100000:3.0:1784044033.514125:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565111040 00010000:00010000:3.0:1784044033.514135:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b3982054e00/0x89871fc3aba17f31 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca64ef expref: 11 pid: 6505 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044033.514145:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 31 00000100:00100000:3.0:1784044033.514150:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3944093050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c4a09ad9-a185-4679-99bb-b6a07b865440+11:2409:x1870705565110912:12345-192.168.202.40@tcp:103: 00010000:00010000:3.0:1784044033.514373:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784044033.514380:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b39759f8600/0x89871fc3aba17f38 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca64f6 expref: 11 pid: 6504 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044033.514389:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b39759f8600/0x89871fc3aba17f38 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca64f6 expref: 11 pid: 6504 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044033.514399:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784044033.514468:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3944093050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c4a09ad9-a185-4679-99bb-b6a07b865440+11:2409:x1870705565110912:12345-192.168.202.40@tcp:103: Request processed in 317us (463us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044033.514475:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 31 00000100:00100000:3.0:1784044033.514511:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 32 00000100:00100000:3.0:1784044033.514517:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38420ab100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c4a09ad9-a185-4679-99bb-b6a07b865440+10:2409:x1870705565111040:12345-192.168.202.40@tcp:103: 00010000:00010000:3.0:1784044033.514523:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784044033.514526:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b3982054e00/0x89871fc3aba17f31 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca64ef expref: 10 pid: 6505 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044033.514534:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b3982054e00/0x89871fc3aba17f31 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca64ef expref: 10 pid: 6505 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044033.514543:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784044033.514556:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38420ab100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c4a09ad9-a185-4679-99bb-b6a07b865440+10:2409:x1870705565111040:12345-192.168.202.40@tcp:103: Request processed in 40us (487us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044033.514569:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 32 00010000:00010000:3.0:1784044033.514600:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.140@tcp lock: ffff9b39759f8400/0x89871fc3aba17e35 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x89871fc3aba17e3c expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044033.514606:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784044033.514630:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: ffff9b39759f8400/0x89871fc3aba17e35 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x89871fc3aba17e3c expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044033.514636:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9b39759f8400/0x89871fc3aba17e35 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x89871fc3aba17e3c expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044033.514647:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784044033.514649:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784044033.514650:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784044033.514689:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b38420ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:3638:1870705580891904:0@lo:103: 00000100:00100000:1.0:1784044033.514733:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044033.515014:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580891904 00000100:00100000:3.0:1784044033.515019:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580891904 00010000:00010000:3.0:1784044033.515036:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b394166ac00/0x89871fc3aba17e3c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x89871fc3aba17e35 expref: 17 pid: 6504 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044033.515065:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1784044033.515070:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843c54000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+17:3638:x1870705580891904:12345-0@lo:103: 00010000:00010000:3.0:1784044033.515078:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784044033.515083:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b394166ac00/0x89871fc3aba17e3c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x89871fc3aba17e35 expref: 17 pid: 6504 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044033.515090:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b394166ac00/0x89871fc3aba17e3c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x89871fc3aba17e35 expref: 17 pid: 6504 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044033.515099:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b394166ac00/0x89871fc3aba17e3c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x89871fc3aba17e35 expref: 17 pid: 6504 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044033.515118:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784044033.515147:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843c54000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+16:3638:x1870705580891904:12345-0@lo:103: Request processed in 77us (414us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044033.515153:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1784044033.515207:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b38420ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:3638:1870705580891904:0@lo:103: 00010000:00010000:2.0:1784044033.515289:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.140@tcp lock: ffff9b39759f9400/0x89871fc3aba17e82 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x89871fc3aba17e89 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044033.515296:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784044033.515312:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: ffff9b39759f9400/0x89871fc3aba17e82 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x89871fc3aba17e89 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044033.515318:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9b39759f9400/0x89871fc3aba17e82 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x89871fc3aba17e89 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044033.515331:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784044033.515333:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784044033.515335:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784044033.515365:0:10324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b39759f8600/0x89871fc3aba17f38 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca64f6 expref: 9 pid: 6504 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044033.515374:0:10324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3975b7df80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10324:1870705580889600:192.168.202.40@tcp:104: 00010000:00010000:2.0:1784044033.515394:0:10324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b3982054e00/0x89871fc3aba17f31 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca64ef expref: 8 pid: 6505 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044033.515406:0:10324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3975b7fb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10324:1870705580889728:192.168.202.40@tcp:104: 00010000:00010000:2.0:1784044033.515444:0:10324:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b39759f9a00/0x89871fc3aba17f77 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044033.515489:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784044033.515499:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397aa57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:3638:1870705580892032:0@lo:103: 00000100:00100000:3.0:1784044033.515538:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044033.515590:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580892032 00000100:00100000:2.0:1784044033.515594:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580892032 00010000:00010000:2.0:1784044033.515611:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b39759f9c00/0x89871fc3aba17e89 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x89871fc3aba17e82 expref: 16 pid: 6505 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044033.515639:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1784044033.515646:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38420ab480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+16:3638:x1870705580892032:12345-0@lo:103: 00010000:00010000:2.0:1784044033.515654:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784044033.515657:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b39759f9c00/0x89871fc3aba17e89 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x89871fc3aba17e82 expref: 16 pid: 6505 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044033.515665:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b39759f9c00/0x89871fc3aba17e89 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x89871fc3aba17e82 expref: 16 pid: 6505 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044033.515676:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b39759f9c00/0x89871fc3aba17e89 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x89871fc3aba17e82 expref: 16 pid: 6505 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044033.515688:0:6496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b39759f9a00/0x89871fc3aba17f77 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044033.515696:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b39759f9a00/0x89871fc3aba17f77 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044033.515853:0:6496:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b39759f9a00/0x89871fc3aba17f77 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044033.515860:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b39759f9a00/0x89871fc3aba17f77 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044033.515868:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b39759f9a00/0x89871fc3aba17f77 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044033.515875:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b39759f9a00/0x89871fc3aba17f77 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044033.515882:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b39759f9a00 already unused, calling callback (ffffffffc0b56230) 00010000:00010000:2.0:1784044033.515886:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b39759f9a00/0x89871fc3aba17f77 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044033.515894:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b39759f9a00/0x89871fc3aba17f77 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044033.515916:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b39759f9a00/0x89871fc3aba17f77 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044033.515926:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784044033.515968:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38420ab480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+15:3638:x1870705580892032:12345-0@lo:103: Request processed in 322us (429us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044033.515974:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1784044033.516160:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397aa57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:3638:1870705580892032:0@lo:103: 00010000:00010000:3.0:1784044033.516208:0:10324:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b39759f9a00/0x89871fc3aba17f77 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044033.516215:0:10324:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b39759f9a00/0x89871fc3aba17f77 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044033.516220:0:10324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b39759f9a00/0x89871fc3aba17f77 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044033.688131:0:10331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784044034.701591:0:10330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784044034.790812:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1784044034.790906:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565111168 00000100:00100000:1.0:1784044034.790917:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565111168 00000100:00100000:1.0:1784044034.790989:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 202 00000100:00100000:1.0:1784044034.791000:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3965ef8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4a09ad9-a185-4679-99bb-b6a07b865440+8:2409:x1870705565111168:12345-192.168.202.40@tcp:400: 00000100:00100000:1.0:1784044034.791071:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3965ef8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4a09ad9-a185-4679-99bb-b6a07b865440+8:2409:x1870705565111168:12345-192.168.202.40@tcp:400: Request processed in 73us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044034.791079:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 202 00000100:00100000:3.0:1784044034.791506:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044034.791822:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565111296 00000100:00100000:2.0:1784044034.791828:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565111296 00000100:00100000:2.0:1784044034.791882:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 56 00000100:00100000:2.0:1784044034.791903:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3975b52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+6:2409:x1870705565111296:12345-192.168.202.40@tcp:400: 00000100:00100000:2.0:1784044034.791953:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3975b52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+6:2409:x1870705565111296:12345-192.168.202.40@tcp:400: Request processed in 51us (449us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044034.791959:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 56 00000100:00080000:3.0:1784044034.793963:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784044034.794066:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044034.794100:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044034.794126:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044034.794209:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565111424 00000100:00100000:2.0:1784044034.794217:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565111424 00000100:00100000:2.0:1784044034.794276:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 57 00000100:00100000:2.0:1784044034.794285:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b384316ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+5:2410:x1870705565111424:12345-192.168.202.40@tcp:400: 00000100:00100000:2.0:1784044034.794372:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b384316ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+5:2410:x1870705565111424:12345-192.168.202.40@tcp:400: Request processed in 88us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044034.794379:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 57 00000100:00080000:0.0:1784044034.794550:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1784044034.794599:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565111552 00000100:00100000:1.0:1784044034.794603:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565111552 00000100:00100000:1.0:1784044034.794644:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565111680 00000100:00100000:1.0:1784044034.794647:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565111680 00000100:00100000:1.0:1784044034.794677:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 12 00000100:00100000:1.0:1784044034.794685:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b384316f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+5:2410:x1870705565111552:12345-192.168.202.40@tcp:400: 00000100:00100000:1.0:1784044034.794712:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b384316f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+5:2410:x1870705565111552:12345-192.168.202.40@tcp:400: Request processed in 29us (651us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044034.794718:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 12 00000100:00100000:1.0:1784044034.794730:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 13 00000100:00100000:1.0:1784044034.794735:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b384316c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+5:2410:x1870705565111680:12345-192.168.202.40@tcp:400: 00000100:00100000:1.0:1784044034.794762:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b384316c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+5:2410:x1870705565111680:12345-192.168.202.40@tcp:400: Request processed in 27us (635us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044034.794768:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 13 00000100:00080000:0.0:1784044034.794878:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784044034.794881:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784044035.150763:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1784044035.154249:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b384316ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1870705580892160:0@lo:41: 00000100:00100000:3.0:1784044035.154326:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044035.154585:0:7768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580892160 00000100:00100000:2.0:1784044035.154594:0:7768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580892160 00000100:00100000:2.0:1784044035.154695:0:7768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1784044035.154705:0:7768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3975b50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1870705580892160:12345-0@lo:41: 00000004:00000024:2.0:1784044035.154739:0:7768:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1784044035.154832:0:7768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3975b50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1870705580892160:12345-0@lo:41: Request processed in 129us (505us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044035.154840:0:7768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1784044035.154935:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b384316ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1870705580892160:0@lo:41: 10000000:01000000:0.0:1784044035.277757:0:6508:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1784044035.277766:0:6508:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9b384244a000 from 48 10000000:01000000:0.0:1784044035.277772:0:6508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1784044035.277824:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b3982055200/0x89871fc3aba17f7e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044035.277836:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9b3982055200/0x89871fc3aba17f7e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044035.277848:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9b3982055200/0x89871fc3aba17f7e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044035.277891:0:6508:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b384316f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580892288:0@lo:101: 00000100:00100000:0.0:1784044035.277978:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044035.278164:0:6508:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b38436c7cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1784044035.278450:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580892288 00000100:00100000:2.0:1784044035.278458:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580892288 00000100:00100000:2.0:1784044035.278546:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:2.0:1784044035.278555:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3965efb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+15:6508:x1870705580892288:12345-0@lo:101: 00010000:00010000:2.0:1784044035.278568:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784044035.278580:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b39586ef600/0x89871fc3aba17f85 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x89871fc3aba17f7e expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044035.278629:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b39586ef600/0x89871fc3aba17f85 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x89871fc3aba17f7e expref: 16 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044035.278640:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b39586ef600/0x89871fc3aba17f85 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x89871fc3aba17f7e expref: 16 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044035.278648:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b39586ef600, rc 0) 00000100:00100000:2.0:1784044035.278696:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3965efb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+16:6508:x1870705580892288:12345-0@lo:101: Request processed in 142us (717us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044035.278703:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:0.0:1784044035.278782:0:6508:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b384316f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580892288:0@lo:101: 00010000:00010000:0.0:1784044035.278795:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9b3982055200/0x89871fc3aba17f7e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba17f85 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044035.278804:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9b3982055200/0x89871fc3aba17f7e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x89871fc3aba17f85 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044035.278868:0:6508:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b384316f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580892416:0@lo:501: 00000100:00100000:0.0:1784044035.278910:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044035.279111:0:6508:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b38436c7cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1784044035.279312:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580892416 00000100:00100000:1.0:1784044035.279317:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580892416 00000100:00100000:1.0:1784044035.279346:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:1.0:1784044035.279354:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3965ef9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+16:6508:x1870705580892416:12345-0@lo:501: 00000100:00100000:1.0:1784044035.279489:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3965ef9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+16:6508:x1870705580892416:12345-0@lo:501: Request processed in 135us (579us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044035.279496:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:0.0:1784044035.279582:0:6508:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b384316f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580892416:0@lo:501: 00000100:00100000:0.0:1784044035.279641:0:6508:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b384316f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580892544:0@lo:503: 00000100:00100000:0.0:1784044035.279679:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044035.279710:0:6508:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b38436c7cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1784044035.279799:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580892544 00000100:00100000:1.0:1784044035.279803:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580892544 00000100:00100000:1.0:1784044035.279820:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:1.0:1784044035.279825:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3965efa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+16:6508:x1870705580892544:12345-0@lo:503: 00000100:00100000:1.0:1784044035.279911:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3965efa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+16:6508:x1870705580892544:12345-0@lo:503: Request processed in 85us (231us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044035.279918:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:0.0:1784044035.280065:0:6508:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b384316f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580892544:0@lo:503: 00000100:00100000:0.0:1784044035.280867:0:10343:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b384316f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:10343:1870705580892672:0@lo:502: 00000100:00100000:0.0:1784044035.280933:0:10343:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044035.281003:0:10343:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b38436c7d80 going to sleep for 11 seconds 00000100:00100000:1.0:1784044035.281102:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580892672 00000100:00100000:1.0:1784044035.281107:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580892672 00000100:00100000:1.0:1784044035.281142:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:1.0:1784044035.281150:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3965efb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+16:10343:x1870705580892672:12345-0@lo:502: 00000100:00100000:1.0:1784044035.281355:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3965efb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+16:10343:x1870705580892672:12345-0@lo:502: Request processed in 205us (429us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044035.281362:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:0.0:1784044035.281480:0:10343:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b384316f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:10343:1870705580892672:0@lo:502: 00000100:00100000:0.0:1784044035.281521:0:10343:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b384316f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:10343:1870705580892800:0@lo:502: 00000100:00100000:0.0:1784044035.281561:0:10343:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044035.281706:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580892800 00000100:00100000:3.0:1784044035.281713:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580892800 00000100:00100000:0.0:1784044035.281722:0:10343:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b38436c7d80 going to sleep for 11 seconds 00000100:00100000:3.0:1784044035.283445:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:3.0:1784044035.283474:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3965ef9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+16:10343:x1870705580892800:12345-0@lo:502: 00000100:00100000:3.0:1784044035.283627:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3965ef9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+16:10343:x1870705580892800:12345-0@lo:502: Request processed in 171us (2065us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044035.283635:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:0.0:1784044035.283713:0:10343:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b384316f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:10343:1870705580892800:0@lo:502: 00000040:00080000:0.0:1784044035.283747:0:10343:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:1.0:1784044035.283919:0:6508:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:1.0:1784044035.283993:0:6508:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1784044035.284010:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b3982055200/0x89871fc3aba17f7e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba17f85 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044035.284021:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9b3982055200/0x89871fc3aba17f7e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba17f85 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784044035.284030:0:6508:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:1.0:1784044035.284033:0:6508:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:1.0:1784044035.284036:0:6508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1784044035.284064:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b3940030e00/0x89871fc3aba17f8c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044035.284072:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9b3940030e00/0x89871fc3aba17f8c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044035.284081:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9b3940030e00/0x89871fc3aba17f8c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044035.284100:0:6508:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843c56680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580892928:0@lo:101: 00000100:00100000:1.0:1784044035.284132:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044035.284167:0:6508:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b397b969cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1784044035.284311:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580892928 00000100:00100000:2.0:1784044035.284318:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580892928 00000100:00100000:2.0:1784044035.284358:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:2.0:1784044035.284367:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3965ef8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+16:6508:x1870705580892928:12345-0@lo:101: 00010000:00010000:2.0:1784044035.284377:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784044035.284389:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b39586efe00/0x89871fc3aba17f93 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x89871fc3aba17f8c expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044035.284412:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b39586efe00/0x89871fc3aba17f93 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x89871fc3aba17f8c expref: 17 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044035.284422:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b39586efe00/0x89871fc3aba17f93 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x89871fc3aba17f8c expref: 17 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044035.284431:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b39586efe00, rc 0) 00000100:00100000:2.0:1784044035.284467:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3965ef8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+17:6508:x1870705580892928:12345-0@lo:101: Request processed in 101us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044035.284474:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:1.0:1784044035.284500:0:6508:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843c56680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580892928:0@lo:101: 00010000:00010000:1.0:1784044035.284516:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9b3940030e00/0x89871fc3aba17f8c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba17f93 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044035.284526:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9b3940030e00/0x89871fc3aba17f8c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x89871fc3aba17f93 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044035.284576:0:6508:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843c56680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580893056:0@lo:501: 00000100:00100000:1.0:1784044035.284626:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044035.284648:0:6508:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b397b969cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1784044035.284733:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580893056 00000100:00100000:0.0:1784044035.284738:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580893056 00000100:00100000:0.0:1784044035.284771:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:0.0:1784044035.284778:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3965efb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+17:6508:x1870705580893056:12345-0@lo:501: 00000100:00100000:0.0:1784044035.285001:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3965efb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+17:6508:x1870705580893056:12345-0@lo:501: Request processed in 223us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044035.285008:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:1.0:1784044035.285057:0:6508:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843c56680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580893056:0@lo:501: 00000100:00100000:1.0:1784044035.285084:0:6508:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843c56680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580893184:0@lo:503: 00000100:00100000:1.0:1784044035.285120:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044035.285140:0:6508:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b397b969cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1784044035.286230:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580893184 00000100:00100000:3.0:1784044035.286245:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580893184 00000100:00100000:3.0:1784044035.286285:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:3.0:1784044035.286292:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3965efa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+17:6508:x1870705580893184:12345-0@lo:503: 00000100:00100000:3.0:1784044035.286395:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3965efa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+17:6508:x1870705580893184:12345-0@lo:503: Request processed in 103us (1274us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044035.286402:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:1.0:1784044035.286429:0:6508:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843c56680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580893184:0@lo:503: 00000100:00100000:1.0:1784044035.287340:0:10344:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843c56680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:10344:1870705580893312:0@lo:502: 00000100:00100000:1.0:1784044035.287387:0:10344:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044035.287420:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580893312 00000100:00100000:0.0:1784044035.287426:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580893312 00000100:00100000:1.0:1784044035.287427:0:10344:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b397b969240 going to sleep for 11 seconds 00000100:00100000:0.0:1784044035.287481:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:0.0:1784044035.287490:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3950377450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+17:10344:x1870705580893312:12345-0@lo:502: 00000100:00100000:0.0:1784044035.287577:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3950377450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+17:10344:x1870705580893312:12345-0@lo:502: Request processed in 89us (190us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044035.287584:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:3.0:1784044035.287611:0:10344:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843c56680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:10344:1870705580893312:0@lo:502: 00000020:01000000:3.0:1784044035.287639:0:10344:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784044035.287648:0:10344:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784044035.287650:0:10344:0:(obd_config.c:1561:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1784044035.287655:0:10344:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1784044035.287676:0:10344:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3975b51500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:10344:1870705580893440:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784044035.288218:0:10344:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044035.288474:0:10344:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3942ab0e40 going to sleep for 11 seconds 00000100:00100000:2.0:1784044035.288526:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580893440 00000100:00100000:2.0:1784044035.288532:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580893440 00000100:00100000:2.0:1784044035.288605:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:2.0:1784044035.288613:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3950374050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+17:10344:x1870705580893440:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784044035.288780:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3950374050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+17:10344:x1870705580893440:12345-0@lo:502:llog_process_th.0 Request processed in 167us (564us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044035.288788:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:1.0:1784044035.289361:0:10344:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3975b51500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:10344:1870705580893440:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1784044035.289390:0:10344:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784044035.289395:0:10344:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784044035.289398:0:10344:0:(obd_config.c:1561:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1784044035.289404:0:10344:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 11 count 11 00000020:01000000:0.0:1784044035.289557:0:6508:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:0.0:1784044035.289580:0:6508:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1784044035.289592:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b3940030e00/0x89871fc3aba17f8c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba17f93 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044035.289604:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9b3940030e00/0x89871fc3aba17f8c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba17f93 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784044035.289614:0:6508:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1784044035.289626:0:6508:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9b3975aa3000 from 48 10000000:01000000:0.0:1784044035.289629:0:6508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1784044035.289659:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b3982055600/0x89871fc3aba17f9a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044035.289668:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9b3982055600/0x89871fc3aba17f9a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044035.289677:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9b3982055600/0x89871fc3aba17f9a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044035.289695:0:6508:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b384316f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580893568:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1784044035.290033:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044035.290072:0:6508:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b38436c70c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784044035.290574:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580893568 00000100:00100000:3.0:1784044035.290580:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580893568 00000100:00100000:3.0:1784044035.290622:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:3.0:1784044035.290630:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3950375450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+17:6508:x1870705580893568:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784044035.290641:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784044035.290655:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b39759f9a00/0x89871fc3aba17fa1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x89871fc3aba17f9a expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044035.290691:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b39759f9a00/0x89871fc3aba17fa1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x89871fc3aba17f9a expref: 18 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044035.290701:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b39759f9a00/0x89871fc3aba17fa1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x89871fc3aba17f9a expref: 18 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044035.290710:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b39759f9a00, rc 0) 00000100:00100000:3.0:1784044035.290759:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3950375450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+18:6508:x1870705580893568:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 131us (727us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044035.290765:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:0.0:1784044035.290794:0:6508:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b384316f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580893568:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784044035.290811:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9b3982055600/0x89871fc3aba17f9a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba17fa1 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044035.290822:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9b3982055600/0x89871fc3aba17f9a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x89871fc3aba17fa1 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044035.290879:0:6508:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b384316f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580893696:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784044035.290996:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044035.291027:0:6508:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b38436c70c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784044035.291643:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580893696 00000100:00100000:1.0:1784044035.291650:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580893696 00000100:00100000:1.0:1784044035.291680:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:1.0:1784044035.291688:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3950376450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+18:6508:x1870705580893696:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784044035.291837:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3950376450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+18:6508:x1870705580893696:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 149us (839us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044035.291844:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:0.0:1784044035.291865:0:6508:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b384316f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580893696:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784044035.292014:0:6508:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b384316f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580893824:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784044035.292063:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044035.292099:0:6508:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b38436c70c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784044035.292405:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580893824 00000100:00100000:1.0:1784044035.292410:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580893824 00000100:00100000:1.0:1784044035.292444:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:1.0:1784044035.292451:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3950377c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+18:6508:x1870705580893824:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784044035.292537:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3950377c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+18:6508:x1870705580893824:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 86us (473us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044035.292544:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:0.0:1784044035.292562:0:6508:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b384316f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580893824:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784044035.294412:0:10345:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b384316f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:10345:1870705580893952:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784044035.294490:0:10345:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044035.294534:0:10345:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b38436c7cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1784044035.295050:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580893952 00000100:00100000:1.0:1784044035.295058:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580893952 00000100:00100000:1.0:1784044035.295100:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:1.0:1784044035.295109:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3950375c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+18:10345:x1870705580893952:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784044035.295261:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3950375c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+18:10345:x1870705580893952:12345-0@lo:502:llog_process_th.0 Request processed in 151us (770us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044035.295269:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:0.0:1784044035.295278:0:10345:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b384316f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:10345:1870705580893952:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784044035.295328:0:10345:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b384316f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:10345:1870705580894080:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784044035.295365:0:10345:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044035.295396:0:10345:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b38436c7cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1784044035.295899:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580894080 00000100:00100000:2.0:1784044035.295905:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580894080 00000100:00100000:2.0:1784044035.295954:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:2.0:1784044035.295962:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3950374c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+18:10345:x1870705580894080:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784044035.296064:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3950374c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+18:10345:x1870705580894080:12345-0@lo:502:llog_process_th.0 Request processed in 103us (699us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044035.296072:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:0.0:1784044035.296093:0:10345:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b384316f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:10345:1870705580894080:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1784044035.296120:0:10345:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:2.0:1784044035.296650:0:6508:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:2.0:1784044035.296670:0:6508:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1784044035.296679:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b3982055600/0x89871fc3aba17f9a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba17fa1 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044035.296691:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9b3982055600/0x89871fc3aba17f9a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba17fa1 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784044035.296700:0:6508:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1784044035.296703:0:6508:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:2.0:1784044035.296706:0:6508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1784044035.296744:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b39586ef800/0x89871fc3aba17fa8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044035.296752:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9b39586ef800/0x89871fc3aba17fa8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044035.296770:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9b39586ef800/0x89871fc3aba17fa8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044035.296787:0:6508:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397aa54e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580894208:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1784044035.296824:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044035.296855:0:6508:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3951e2bf00 going to sleep for 11 seconds 00000100:00100000:1.0:1784044035.297271:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580894208 00000100:00100000:1.0:1784044035.297277:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580894208 00000100:00100000:1.0:1784044035.297322:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:1.0:1784044035.297329:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3950376c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+18:6508:x1870705580894208:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784044035.297339:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784044035.297354:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b3940031200/0x89871fc3aba17faf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x89871fc3aba17fa8 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044035.297375:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b3940031200/0x89871fc3aba17faf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x89871fc3aba17fa8 expref: 19 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044035.297384:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b3940031200/0x89871fc3aba17faf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x89871fc3aba17fa8 expref: 19 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044035.297392:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3940031200, rc 0) 00000100:00100000:1.0:1784044035.297440:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3950376c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+19:6508:x1870705580894208:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 110us (614us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044035.297456:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:2.0:1784044035.297682:0:6508:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397aa54e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580894208:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784044035.297696:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9b39586ef800/0x89871fc3aba17fa8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba17faf expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044035.297715:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9b39586ef800/0x89871fc3aba17fa8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x89871fc3aba17faf expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044035.297775:0:6508:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397aa54e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580894336:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784044035.297811:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044035.297835:0:6508:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3951e2bf00 going to sleep for 11 seconds 00000100:00100000:1.0:1784044035.297981:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580894336 00000100:00100000:1.0:1784044035.297985:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580894336 00000100:00100000:1.0:1784044035.298016:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:1.0:1784044035.298023:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3950375850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+19:6508:x1870705580894336:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784044035.298145:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3950375850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+19:6508:x1870705580894336:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 122us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044035.298152:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:3.0:1784044035.298374:0:6508:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397aa54e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580894336:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784044035.298406:0:6508:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3975b50e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580894464:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784044035.298458:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044035.298487:0:6508:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3942ab0e40 going to sleep for 11 seconds 00000100:00100000:0.0:1784044035.298764:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580894464 00000100:00100000:0.0:1784044035.298769:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580894464 00000100:00100000:0.0:1784044035.298810:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:0.0:1784044035.298818:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3950374450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+19:6508:x1870705580894464:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784044035.298906:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3950374450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+19:6508:x1870705580894464:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 88us (446us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044035.298912:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:3.0:1784044035.299229:0:6508:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3975b50e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580894464:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784044035.299456:0:10346:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3975b50e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:10346:1870705580894592:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784044035.299489:0:10346:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044035.299505:0:10346:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3942ab0480 going to sleep for 11 seconds 00000100:00100000:0.0:1784044035.299683:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580894592 00000100:00100000:0.0:1784044035.299687:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580894592 00000100:00100000:0.0:1784044035.299715:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:0.0:1784044035.299721:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3950376850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+19:10346:x1870705580894592:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784044035.299943:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3950376850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+19:10346:x1870705580894592:12345-0@lo:502:llog_process_th.0 Request processed in 222us (453us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044035.299950:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:3.0:1784044035.300234:0:10346:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3975b50e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:10346:1870705580894592:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1784044035.300266:0:10346:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784044035.300275:0:10346:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784044035.300277:0:10346:0:(obd_config.c:1561:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1784044035.300281:0:10346:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1784044035.300300:0:10346:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3975b50e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:10346:1870705580894720:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784044035.300337:0:10346:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044035.300358:0:10346:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b397b969600 going to sleep for 11 seconds 00000100:00100000:0.0:1784044035.300566:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580894720 00000100:00100000:0.0:1784044035.300571:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580894720 00000100:00100000:0.0:1784044035.300600:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:0.0:1784044035.300606:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3950374850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+19:10346:x1870705580894720:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784044035.300681:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3950374850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+19:10346:x1870705580894720:12345-0@lo:502:llog_process_th.0 Request processed in 76us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044035.300687:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:3.0:1784044035.300995:0:10346:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3975b50e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:10346:1870705580894720:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1784044035.301012:0:10346:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784044035.301017:0:10346:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784044035.301019:0:10346:0:(obd_config.c:1561:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1784044035.301022:0:10346:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 14 count 14 00000020:01000000:0.0:1784044035.301535:0:6508:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:0.0:1784044035.301556:0:6508:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1784044035.301565:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b39586ef800/0x89871fc3aba17fa8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba17faf expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044035.301575:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9b39586ef800/0x89871fc3aba17fa8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba17faf expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784044035.301584:0:6508:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1784044035.301586:0:6508:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9b396f3cf800 from 48 10000000:01000000:0.0:1784044035.301589:0:6508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1784044035.301614:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b3982055a00/0x89871fc3aba17fb6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044035.301621:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9b3982055a00/0x89871fc3aba17fb6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044035.301630:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9b3982055a00/0x89871fc3aba17fb6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044035.301644:0:6508:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b384316f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580894848:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1784044035.301674:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044035.301878:0:6508:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b38436c73c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784044035.302570:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580894848 00000100:00100000:1.0:1784044035.302577:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580894848 00000100:00100000:1.0:1784044035.302625:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:1.0:1784044035.302633:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3950377850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+19:6508:x1870705580894848:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784044035.302645:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784044035.302660:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b3940031e00/0x89871fc3aba17fbd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x89871fc3aba17fb6 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044035.302686:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b3940031e00/0x89871fc3aba17fbd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x89871fc3aba17fb6 expref: 20 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044035.302901:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b3940031e00/0x89871fc3aba17fbd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x89871fc3aba17fb6 expref: 20 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044035.302910:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3940031e00, rc 0) 00000100:00100000:1.0:1784044035.303007:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3950377850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+20:6508:x1870705580894848:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 374us (1331us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044035.303013:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:0.0:1784044035.308337:0:6508:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b384316f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580894848:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784044035.308368:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9b3982055a00/0x89871fc3aba17fb6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba17fbd expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044035.308381:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9b3982055a00/0x89871fc3aba17fb6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x89871fc3aba17fbd expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044035.308571:0:6508:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b384316f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580894976:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784044035.308628:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044035.308714:0:6508:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b38436c73c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784044035.309670:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580894976 00000100:00100000:1.0:1784044035.309687:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580894976 00000100:00100000:1.0:1784044035.309747:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:1.0:1784044035.309755:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3950375050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+20:6508:x1870705580894976:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784044035.310078:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3950375050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+20:6508:x1870705580894976:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 322us (1447us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044035.310085:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:3.0:1784044035.310227:0:6508:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b384316f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580894976:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784044035.310288:0:6508:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3975b50e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580895104:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784044035.310333:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044035.310360:0:6508:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b397b969600 going to sleep for 11 seconds 00000100:00100000:1.0:1784044035.310576:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580895104 00000100:00100000:1.0:1784044035.310581:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580895104 00000100:00100000:1.0:1784044035.310616:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:1.0:1784044035.310623:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3950377050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+20:6508:x1870705580895104:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784044035.310808:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3950377050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+20:6508:x1870705580895104:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 184us (474us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044035.310815:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:2.0:1784044035.310973:0:6508:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3975b50e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580895104:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784044035.311610:0:10347:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397aa54e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:10347:1870705580895232:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784044035.311656:0:10347:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044035.311684:0:10347:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3951e2b540 going to sleep for 11 seconds 00000100:00100000:1.0:1784044035.312059:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580895232 00000100:00100000:1.0:1784044035.312064:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580895232 00000100:00100000:1.0:1784044035.312109:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:1.0:1784044035.312116:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3950376050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+20:10347:x1870705580895232:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784044035.312232:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3950376050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+20:10347:x1870705580895232:12345-0@lo:502:llog_process_th.0 Request processed in 116us (576us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044035.312254:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:2.0:1784044035.312584:0:10347:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397aa54e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:10347:1870705580895232:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784044035.312625:0:10347:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397aa54e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:10347:1870705580895360:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784044035.312655:0:10347:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044035.312690:0:10347:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3951e2b540 going to sleep for 11 seconds 00000100:00100000:1.0:1784044035.312782:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580895360 00000100:00100000:1.0:1784044035.312786:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580895360 00000100:00100000:1.0:1784044035.312885:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:1.0:1784044035.312893:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3950370c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+20:10347:x1870705580895360:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784044035.313017:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3950370c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+20:10347:x1870705580895360:12345-0@lo:502:llog_process_th.0 Request processed in 125us (361us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044035.313044:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:3.0:1784044035.316094:0:10347:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397aa54e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:10347:1870705580895360:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1784044035.316141:0:10347:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:2.0:1784044035.316613:0:6508:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:2.0:1784044035.316640:0:6508:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1784044035.316650:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b3982055a00/0x89871fc3aba17fb6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba17fbd expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044035.316660:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9b3982055a00/0x89871fc3aba17fb6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba17fbd expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784044035.316670:0:6508:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:2.0:1784044035.316673:0:6508:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 43 10000000:01000000:2.0:1784044035.316676:0:6508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1784044035.316783:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b39586eea00/0x89871fc3aba17fc4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044035.316855:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9b39586eea00/0x89871fc3aba17fc4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044035.316867:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9b39586eea00/0x89871fc3aba17fc4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044035.316891:0:6508:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397aa57480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580895488:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1784044035.316965:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044035.317009:0:6508:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3951e2b540 going to sleep for 11 seconds 00000100:00100000:3.0:1784044035.317123:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580895488 00000100:00100000:3.0:1784044035.317130:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580895488 00000100:00100000:3.0:1784044035.317455:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:3.0:1784044035.317467:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3950371850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+20:6508:x1870705580895488:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784044035.317482:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784044035.317495:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b39759f8400/0x89871fc3aba17fcb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x89871fc3aba17fc4 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044035.317518:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b39759f8400/0x89871fc3aba17fcb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x89871fc3aba17fc4 expref: 21 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044035.317529:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b39759f8400/0x89871fc3aba17fcb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x89871fc3aba17fc4 expref: 21 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044035.317553:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b39759f8400, rc 0) 00000100:00100000:3.0:1784044035.317601:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3950371850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+21:6508:x1870705580895488:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 137us (636us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044035.317608:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:2.0:1784044035.317683:0:6508:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397aa57480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580895488:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784044035.317708:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9b39586eea00/0x89871fc3aba17fc4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba17fcb expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044035.317719:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9b39586eea00/0x89871fc3aba17fc4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x89871fc3aba17fcb expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044035.317784:0:6508:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397aa57480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580895616:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784044035.317820:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044035.328775:0:6508:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3951e2b540 going to sleep for 11 seconds 00000100:00100000:1.0:1784044035.336530:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580895616 00000100:00100000:1.0:1784044035.336548:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580895616 00000100:00100000:3.0:1784044035.336634:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:3.0:1784044035.336650:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3950372850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+21:6508:x1870705580895616:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784044035.337041:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3950372850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+21:6508:x1870705580895616:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 396us (19218us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044035.337051:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:2.0:1784044035.337121:0:6508:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397aa57480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580895616:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784044035.337204:0:6508:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397aa57480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580895744:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784044035.337265:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044035.339884:0:6508:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3951e2b540 going to sleep for 11 seconds 00000100:00100000:0.0:1784044035.343026:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580895744 00000100:00100000:0.0:1784044035.343042:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580895744 00000100:00100000:0.0:1784044035.343121:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:0.0:1784044035.343133:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3950370450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+21:6508:x1870705580895744:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784044035.343647:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3950370450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+21:6508:x1870705580895744:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 515us (6380us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044035.343657:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:2.0:1784044035.344157:0:6508:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397aa57480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580895744:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784044035.345090:0:10348:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b384316e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:10348:1870705580895872:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784044035.345163:0:10348:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044035.345550:0:10348:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b38436c7600 going to sleep for 11 seconds 00000100:00100000:2.0:1784044035.345613:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580895872 00000100:00100000:2.0:1784044035.345622:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580895872 00000100:00100000:2.0:1784044035.345781:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:2.0:1784044035.345866:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3950370850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+21:10348:x1870705580895872:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784044035.346019:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3950370850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+21:10348:x1870705580895872:12345-0@lo:502:llog_process_th.0 Request processed in 229us (856us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044035.346027:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:0.0:1784044035.346103:0:10348:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b384316e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:10348:1870705580895872:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1784044035.346133:0:10348:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784044035.346145:0:10348:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784044035.346148:0:10348:0:(obd_config.c:1561:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1784044035.346155:0:10348:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1784044035.346203:0:10348:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b384316e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:10348:1870705580896000:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784044035.346256:0:10348:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044035.346449:0:10348:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b38436c7600 going to sleep for 11 seconds 00000100:00100000:1.0:1784044035.346545:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580896000 00000100:00100000:1.0:1784044035.346550:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580896000 00000100:00100000:1.0:1784044035.346579:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:1.0:1784044035.346586:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3950373850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+21:10348:x1870705580896000:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784044035.346671:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3950373850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+21:10348:x1870705580896000:12345-0@lo:502:llog_process_th.0 Request processed in 85us (414us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044035.346678:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:0.0:1784044035.346916:0:10348:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b384316e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:10348:1870705580896000:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1784044035.346952:0:10348:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784044035.346956:0:10348:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784044035.346958:0:10348:0:(obd_config.c:1561:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1784044035.346963:0:10348:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 46 count 46 00000020:01000000:3.0:1784044035.347156:0:6508:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 43-45 (rc=0) 10000000:01000000:3.0:1784044035.347216:0:6508:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:3.0:1784044035.347229:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b39586eea00/0x89871fc3aba17fc4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba17fcb expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044035.347331:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9b39586eea00/0x89871fc3aba17fc4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba17fcb expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784044035.347342:0:6508:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1784044035.347345:0:6508:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9b397418c800 from 48 10000000:01000000:3.0:1784044035.347348:0:6508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1784044035.347377:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b39759f8a00/0x89871fc3aba17fd2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044035.347387:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9b39759f8a00/0x89871fc3aba17fd2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044035.347399:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9b39759f8a00/0x89871fc3aba17fd2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044035.347497:0:6508:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3975b53100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580896128:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784044035.347535:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044035.347569:0:6508:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b397b969000 going to sleep for 11 seconds 00000100:00100000:1.0:1784044035.347624:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580896128 00000100:00100000:1.0:1784044035.347629:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580896128 00000100:00100000:1.0:1784044035.347668:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:1.0:1784044035.347676:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3950371050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+21:6508:x1870705580896128:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784044035.347686:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784044035.347769:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b3940030800/0x89871fc3aba17fd9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x89871fc3aba17fd2 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044035.347861:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b3940030800/0x89871fc3aba17fd9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x89871fc3aba17fd2 expref: 22 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044035.347872:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b3940030800/0x89871fc3aba17fd9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x89871fc3aba17fd2 expref: 22 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044035.347882:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3940030800, rc 0) 00000100:00100000:1.0:1784044035.347918:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3950371050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+22:6508:x1870705580896128:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 243us (383us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044035.347940:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:1.0:1784044035.347985:0:6508:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3975b53100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580896128:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784044035.347999:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9b39759f8a00/0x89871fc3aba17fd2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba17fd9 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044035.348008:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9b39759f8a00/0x89871fc3aba17fd2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x89871fc3aba17fd9 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044035.348059:0:6508:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843c55c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580896256:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784044035.348084:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044035.348097:0:6508:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b397b763240 going to sleep for 11 seconds 00000100:00100000:1.0:1784044035.348107:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580896256 00000100:00100000:1.0:1784044035.348111:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580896256 00000100:00100000:1.0:1784044035.348126:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:1.0:1784044035.348131:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3950373050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+22:6508:x1870705580896256:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784044035.348339:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3950373050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+22:6508:x1870705580896256:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 206us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044035.348346:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:1.0:1784044035.348375:0:6508:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843c55c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580896256:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784044035.348400:0:6508:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843c55c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580896384:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784044035.348567:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044035.348596:0:6508:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b397b763240 going to sleep for 11 seconds 00000100:00100000:3.0:1784044035.348774:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580896384 00000100:00100000:3.0:1784044035.348779:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580896384 00000100:00100000:3.0:1784044035.348978:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:3.0:1784044035.348987:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3950372050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+22:6508:x1870705580896384:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784044035.349071:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3950372050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+22:6508:x1870705580896384:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 86us (504us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044035.349078:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:1.0:1784044035.349208:0:6508:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843c55c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580896384:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784044035.353410:0:10349:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3975b51c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:10349:1870705580896512:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784044035.353612:0:10349:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044035.353662:0:10349:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b397b969cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1784044035.353901:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580896512 00000100:00100000:1.0:1784044035.353908:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580896512 00000100:00100000:1.0:1784044035.353968:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:1.0:1784044035.353978:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3950373450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+22:10349:x1870705580896512:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784044035.354125:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3950373450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+22:10349:x1870705580896512:12345-0@lo:502:llog_process_th.0 Request processed in 148us (513us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044035.354134:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1784044035.354541:0:10349:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3975b51c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:10349:1870705580896512:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784044035.354596:0:10349:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3975b51c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:10349:1870705580896640:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784044035.354633:0:10349:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044035.354663:0:10349:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b397b969cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1784044035.354735:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580896640 00000100:00100000:2.0:1784044035.354741:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580896640 00000100:00100000:2.0:1784044035.354770:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:2.0:1784044035.354778:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3950371450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+22:10349:x1870705580896640:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784044035.354997:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3950371450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+22:10349:x1870705580896640:12345-0@lo:502:llog_process_th.0 Request processed in 220us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044035.355005:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:3.0:1784044035.355128:0:10349:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3975b51c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:10349:1870705580896640:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1784044035.355149:0:10349:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:0.0:1784044035.355621:0:6508:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:0.0:1784044035.355646:0:6508:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1784044035.355659:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b39759f8a00/0x89871fc3aba17fd2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba17fd9 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044035.355672:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9b39759f8a00/0x89871fc3aba17fd2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba17fd9 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784044035.355684:0:6508:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1784044035.355687:0:6508:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 43 10000000:01000000:0.0:1784044035.355691:0:6508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1784044035.355789:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b3982054e00/0x89871fc3aba17fe0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044035.355870:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9b3982054e00/0x89871fc3aba17fe0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044035.355880:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9b3982054e00/0x89871fc3aba17fe0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044035.355898:0:6508:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b384316e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580896768:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1784044035.355947:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044035.355994:0:6508:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b38436c73c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784044035.356045:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580896768 00000100:00100000:3.0:1784044035.356052:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580896768 00000100:00100000:3.0:1784044035.356140:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:3.0:1784044035.356149:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3950370050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+22:6508:x1870705580896768:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784044035.356168:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784044035.356214:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b39759f8c00/0x89871fc3aba17fe7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x89871fc3aba17fe0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044035.356247:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b39759f8c00/0x89871fc3aba17fe7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x89871fc3aba17fe0 expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044035.356259:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b39759f8c00/0x89871fc3aba17fe7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x89871fc3aba17fe0 expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044035.356269:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b39759f8c00, rc 0) 00000100:00100000:3.0:1784044035.356306:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3950370050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+23:6508:x1870705580896768:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 159us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044035.356313:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:0.0:1784044035.356381:0:6508:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b384316e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580896768:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784044035.356394:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9b3982054e00/0x89871fc3aba17fe0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba17fe7 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044035.356402:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9b3982054e00/0x89871fc3aba17fe0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x89871fc3aba17fe7 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044035.356462:0:6508:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b384316e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580896896:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784044035.356484:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044035.358369:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580896896 00000100:00100000:2.0:1784044035.358392:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580896896 00000100:00100000:2.0:1784044035.358435:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:2.0:1784044035.358443:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3950372450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+23:6508:x1870705580896896:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784044035.358613:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3950372450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+23:6508:x1870705580896896:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 170us (2127us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044035.358621:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:0.0:1784044035.358931:0:6508:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b38436c73c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784044035.358955:0:6508:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b384316e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580896896:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784044035.359005:0:6508:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b384316e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580897024:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784044035.359053:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044035.363899:0:6508:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b38436c73c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784044035.367462:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580897024 00000100:00100000:1.0:1784044035.367479:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580897024 00000100:00100000:2.0:1784044035.367686:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:2.0:1784044035.367701:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3950373c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+23:6508:x1870705580897024:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784044035.367896:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3950373c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+23:6508:x1870705580897024:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 199us (8843us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044035.367904:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:1.0:1784044035.368040:0:6508:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b384316e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580897024:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784044035.368678:0:10350:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843c55c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:10350:1870705580897152:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784044035.368738:0:10350:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044035.368786:0:10350:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b397b763480 going to sleep for 11 seconds 00000100:00100000:2.0:1784044035.368839:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580897152 00000100:00100000:2.0:1784044035.368845:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580897152 00000100:00100000:2.0:1784044035.368887:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:2.0:1784044035.368894:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3950371c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+23:10350:x1870705580897152:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784044035.368999:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3950371c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+23:10350:x1870705580897152:12345-0@lo:502:llog_process_th.0 Request processed in 99us (255us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044035.369006:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:1.0:1784044035.369095:0:10350:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843c55c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:10350:1870705580897152:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1784044035.369124:0:10350:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1784044035.369133:0:10350:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784044035.369136:0:10350:0:(obd_config.c:1561:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1784044035.369144:0:10350:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1784044035.369166:0:10350:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843c55c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:10350:1870705580897280:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784044035.369231:0:10350:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044035.369395:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580897280 00000100:00100000:2.0:1784044035.369400:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580897280 00000100:00100000:2.0:1784044035.369431:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:2.0:1784044035.369438:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3950372c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+23:10350:x1870705580897280:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784044035.369629:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3950372c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+23:10350:x1870705580897280:12345-0@lo:502:llog_process_th.0 Request processed in 191us (397us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044035.369636:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:1.0:1784044035.369721:0:10350:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b397b763480 going to sleep for 11 seconds 00000100:00100000:1.0:1784044035.369734:0:10350:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843c55c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:10350:1870705580897280:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1784044035.369752:0:10350:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784044035.369756:0:10350:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784044035.369758:0:10350:0:(obd_config.c:1561:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1784044035.369762:0:10350:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:2.0:1784044035.369951:0:6508:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 43-45 (rc=0) 10000000:01000000:2.0:1784044035.369979:0:6508:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1784044035.369991:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b3982054e00/0x89871fc3aba17fe0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba17fe7 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044035.370005:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9b3982054e00/0x89871fc3aba17fe0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba17fe7 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784044035.370017:0:6508:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1784044035.370019:0:6508:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff9b394402b380 from 1 10000000:01000000:2.0:1784044035.370022:0:6508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1784044035.370047:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b39586ee000/0x89871fc3aba17fee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044035.370056:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9b39586ee000/0x89871fc3aba17fee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044035.370066:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9b39586ee000/0x89871fc3aba17fee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044035.370080:0:6508:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397aa57480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580897408:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1784044035.370109:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044035.370163:0:6508:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b397ab38000 going to sleep for 11 seconds 00000100:00100000:0.0:1784044035.370395:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580897408 00000100:00100000:0.0:1784044035.370401:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580897408 00000100:00100000:0.0:1784044035.370429:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:0.0:1784044035.370436:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3970ede850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+23:6508:x1870705580897408:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784044035.370446:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784044035.370459:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b3982054c00/0x89871fc3aba17ff5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x89871fc3aba17fee expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044035.370484:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b3982054c00/0x89871fc3aba17ff5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x89871fc3aba17fee expref: 24 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044035.370495:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b3982054c00/0x89871fc3aba17ff5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x89871fc3aba17fee expref: 24 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044035.370511:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3982054c00, rc 0) 00000100:00100000:0.0:1784044035.370613:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3970ede850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+24:6508:x1870705580897408:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 177us (502us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044035.370620:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:1.0:1784044035.370667:0:6508:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397aa57480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580897408:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784044035.370680:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9b39586ee000/0x89871fc3aba17fee lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba17ff5 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044035.370698:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9b39586ee000/0x89871fc3aba17fee lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x89871fc3aba17ff5 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044035.370745:0:6508:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843c55c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580897536:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784044035.370771:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044035.370830:0:6508:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b397b763480 going to sleep for 11 seconds 00000100:00100000:3.0:1784044035.370869:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580897536 00000100:00100000:3.0:1784044035.370873:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580897536 00000100:00100000:3.0:1784044035.370949:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:3.0:1784044035.370956:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3970edc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+24:6508:x1870705580897536:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784044035.371028:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3970edc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+24:6508:x1870705580897536:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 73us (256us total) trans 0 rc -2/-2 00000100:00100000:3.0:1784044035.371034:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:1.0:1784044035.371085:0:6508:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843c55c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580897536:0@lo:501:ll_cfg_requeue.0 10000000:01000000:1.0:1784044035.371104:0:6508:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1784044035.371109:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b39586ee000/0x89871fc3aba17fee lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba17ff5 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044035.371116:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9b39586ee000/0x89871fc3aba17fee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba17ff5 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044035.725517:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784044036.173437:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3975b51c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1870705580897792:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1784044036.173437:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b384316e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1870705580897664:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784044036.173724:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044036.173858:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580897664 00000100:00100000:0.0:1784044036.173876:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580897664 00000100:00100000:0.0:1784044036.173948:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1784044036.173960:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843c55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1870705580897664:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1784044036.174005:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784044036.174058:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843c55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1870705580897664:12345-0@lo:13:osp-pre-0-0.0 Request processed in 101us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044036.174065:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:1.0:1784044036.174126:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1784044036.174163:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b384316e680 x1870705580897664/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784044052 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784044036.174208:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b384316e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1870705580897664:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784044036.175067:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044036.175369:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580897792 00000100:00100000:0.0:1784044036.175376:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580897792 00000100:00100000:3.0:1784044036.175584:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397aa57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1870705580897920:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1784044036.175626:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044036.175712:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1784044036.175722:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3975b53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1870705580897792:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1784044036.175760:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1784044036.175808:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3975b53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1870705580897792:12345-0@lo:41:osp-pre-1-0.0 Request processed in 87us (742us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044036.175814:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1784044036.175906:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580897920 00000100:00100000:1.0:1784044036.175910:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580897920 00000100:00100000:1.0:1784044036.175971:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1784044036.175979:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3975b50e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1870705580897920:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1784044036.175992:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784044036.176049:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3975b50e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1870705580897920:12345-0@lo:13:osp-pre-0-1.0 Request processed in 71us (423us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044036.176056:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:3.0:1784044036.176133:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b397aa57480 x1870705580897920/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784044052 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784044036.176155:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397aa57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1870705580897920:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1784044036.176206:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3975b51c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1870705580897792:0@lo:41:osp-pre-1-0.0 00000100:00080000:0.0:1784044036.176259:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784044036.712044:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044036.712138:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565111808 00000100:00100000:3.0:1784044036.712148:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565111808 00000100:00100000:3.0:1784044036.712247:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 245 00000100:00100000:3.0:1784044036.712260:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3970edf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4a09ad9-a185-4679-99bb-b6a07b865440+8:6180:x1870705565111808:12345-192.168.202.40@tcp:101: 00010000:00010000:3.0:1784044036.712290:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784044036.712308:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b39759f9000/0x89871fc3aba17ffc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd3dffad52ca6566 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044036.712337:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b39759f9000/0x89871fc3aba17ffc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6566 expref: 9 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044036.712349:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b39759f9000/0x89871fc3aba17ffc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6566 expref: 9 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044036.712356:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b39759f9000, rc 0) 00000100:00100000:3.0:1784044036.712404:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3970edf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4a09ad9-a185-4679-99bb-b6a07b865440+9:6180:x1870705565111808:12345-192.168.202.40@tcp:101: Request processed in 149us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044036.712408:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 245 00000100:00100000:3.0:1784044036.720061:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1784044036.720312:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565111936 00000100:00100000:1.0:1784044036.720329:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565111936 00000100:00100000:1.0:1784044036.720401:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 246 00000100:00100000:1.0:1784044036.720412:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3970edd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4a09ad9-a185-4679-99bb-b6a07b865440+9:6180:x1870705565111936:12345-192.168.202.40@tcp:501: 00000100:00100000:1.0:1784044036.720583:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3970edd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4a09ad9-a185-4679-99bb-b6a07b865440+9:6180:x1870705565111936:12345-192.168.202.40@tcp:501: Request processed in 172us (536us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044036.720591:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 246 00000100:00100000:0.0:1784044036.722267:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044036.722509:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565112064 00000100:00100000:2.0:1784044036.722529:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565112064 00000100:00100000:2.0:1784044036.722607:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 247 00000100:00100000:2.0:1784044036.722616:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3970edf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4a09ad9-a185-4679-99bb-b6a07b865440+9:6180:x1870705565112064:12345-192.168.202.40@tcp:503: 00000100:00100000:2.0:1784044036.722738:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3970edf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4a09ad9-a185-4679-99bb-b6a07b865440+9:6180:x1870705565112064:12345-192.168.202.40@tcp:503: Request processed in 122us (573us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044036.722745:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 247 00000100:00100000:0.0:1784044036.726164:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1784044036.726320:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565112192 00000100:00100000:1.0:1784044036.726332:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565112192 00000100:00100000:1.0:1784044036.726400:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 248 00000100:00100000:1.0:1784044036.726411:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3970ede050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4a09ad9-a185-4679-99bb-b6a07b865440+9:6667:x1870705565112192:12345-192.168.202.40@tcp:502: 00000100:00100000:1.0:1784044036.726663:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3970ede050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4a09ad9-a185-4679-99bb-b6a07b865440+9:6667:x1870705565112192:12345-192.168.202.40@tcp:502: Request processed in 253us (510us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044036.726671:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 248 00000100:00100000:0.0:1784044036.731507:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044036.736564:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565112320 00000100:00100000:2.0:1784044036.736583:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565112320 00000100:00100000:2.0:1784044036.736781:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 249 00000100:00100000:2.0:1784044036.736792:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3970edf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4a09ad9-a185-4679-99bb-b6a07b865440+9:6667:x1870705565112320:12345-192.168.202.40@tcp:502:llog_process_th.0 00000100:00100000:2.0:1784044036.736969:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3970edf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4a09ad9-a185-4679-99bb-b6a07b865440+9:6667:x1870705565112320:12345-192.168.202.40@tcp:502:llog_process_th.0 Request processed in 178us (5472us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044036.736979:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 249 00000100:00100000:0.0:1784044036.743908:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044036.744200:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565112448 00000100:00100000:3.0:1784044036.744211:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565112448 00000100:00100000:3.0:1784044036.744272:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 250 00000100:00100000:3.0:1784044036.744281:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3970edd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4a09ad9-a185-4679-99bb-b6a07b865440+9:6180:x1870705565112448:12345-192.168.202.40@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784044036.744315:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784044036.744331:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b39759f9600/0x89871fc3aba18003 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd3dffad52ca656d expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044036.744355:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b39759f9600/0x89871fc3aba18003 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca656d expref: 10 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044036.744363:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b39759f9600/0x89871fc3aba18003 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca656d expref: 10 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044036.745253:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b39759f9600, rc 0) 00000100:00100000:3.0:1784044036.745330:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3970edd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4a09ad9-a185-4679-99bb-b6a07b865440+10:6180:x1870705565112448:12345-192.168.202.40@tcp:101:ll_cfg_requeue.0 Request processed in 1048us (1430us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044036.745338:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 250 00010000:00010000:1.0:1784044036.749473:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784044036.750469:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1784044036.750698:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565112576 00000100:00100000:1.0:1784044036.750708:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565112576 00000100:00100000:1.0:1784044036.750769:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 251 00000100:00100000:1.0:1784044036.750777:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3970edc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4a09ad9-a185-4679-99bb-b6a07b865440+10:6180:x1870705565112576:12345-192.168.202.40@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784044036.750876:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3970edc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4a09ad9-a185-4679-99bb-b6a07b865440+10:6180:x1870705565112576:12345-192.168.202.40@tcp:501:ll_cfg_requeue.0 Request processed in 100us (414us total) trans 0 rc -2/-2 00000100:00100000:1.0:1784044036.750882:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 251 00000100:00100000:0.0:1784044037.197669:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397aa54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1870705580898048:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784044037.197745:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044037.198168:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3975b51c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:3638:1870705580898304:0@lo:400:kworker.0 00000100:00100000:3.0:1784044037.198239:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044037.198263:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397bbbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1870705580898816:0@lo:400:kworker.0 00000100:00100000:3.0:1784044037.198286:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044037.198304:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3975b7df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1870705580899328:0@lo:400:kworker.0 00000100:00100000:3.0:1784044037.198326:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044037.198346:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1784044037.198353:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3975b51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1870705580898432:0@lo:400:kworker.0 00000100:00100000:3.0:1784044037.198390:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044037.198405:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397bbbd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1870705580898944:0@lo:400:kworker.0 00000100:00100000:3.0:1784044037.198429:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044037.198443:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3975b7ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3638:1870705580899456:0@lo:400:kworker.0 00000100:00100000:3.0:1784044037.198481:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044037.198514:0:7768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580898816 00000100:00100000:3.0:1784044037.198521:0:7768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580898816 00000100:00100000:3.0:1784044037.198570:0:7768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1784044037.198580:0:7768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3975b7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1870705580898816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044037.198637:0:7768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3975b7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1870705580898816:12345-0@lo:400:kworker.0 Request processed in 58us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044037.198645:0:7768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1784044037.198820:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580899328 00000100:00100000:3.0:1784044037.198824:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580899328 00000100:00100000:3.0:1784044037.198855:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580898432 00000100:00100000:3.0:1784044037.198858:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580898432 00000100:00100000:3.0:1784044037.198870:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580899456 00000100:00100000:3.0:1784044037.198872:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580899456 00000100:00100000:3.0:1784044037.198885:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1784044037.198891:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3975b7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1870705580899328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044037.198932:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3975b7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1870705580899328:12345-0@lo:400:kworker.0 Request processed in 41us (605us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044037.198938:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1784044037.198949:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1784044037.198954:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3975b7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1870705580898432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044037.198979:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3975b7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1870705580898432:12345-0@lo:400:kworker.0 Request processed in 24us (589us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044037.198984:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1784044037.198995:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1784044037.199000:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38427b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1870705580899456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044037.199024:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38427b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1870705580899456:12345-0@lo:400:kworker.0 Request processed in 24us (542us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044037.199036:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1784044037.199081:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3975b51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1870705580898432:0@lo:400:kworker.0 00000100:00100000:3.0:1784044037.199091:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3975b7ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3638:1870705580899456:0@lo:400:kworker.0 00000100:00100000:3.0:1784044037.199100:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397bbbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1870705580898816:0@lo:400:kworker.0 00010000:00080000:3.0:1784044037.199111:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b3975b7df80 x1870705580899328/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044053 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784044037.199122:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3975b7df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1870705580899328:0@lo:400:kworker.0 00000100:00080000:0.0:1784044037.199208:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1784044037.199212:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1784044037.199224:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843c56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1870705580898176:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1784044037.199257:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044037.199283:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397bbbd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3641:1870705580898688:0@lo:400:kworker.0 00000100:00100000:0.0:1784044037.199305:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044037.199322:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3975b7fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3641:1870705580899200:0@lo:400:kworker.0 00000100:00100000:0.0:1784044037.199340:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044037.199354:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3975b7dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1870705580899712:0@lo:400:kworker.0 00000100:00100000:0.0:1784044037.199388:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044037.199407:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1784044037.199413:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397bbbc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1870705580898560:0@lo:400:kworker.0 00000100:00100000:0.0:1784044037.199461:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044037.199482:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397bbbc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1870705580899072:0@lo:400:kworker.0 00000100:00100000:0.0:1784044037.199502:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044037.199519:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3975b7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3641:1870705580899584:0@lo:400:kworker.0 00000100:00100000:0.0:1784044037.199538:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044037.199564:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580898560 00000100:00100000:0.0:1784044037.199567:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580898560 00000100:00100000:0.0:1784044037.199594:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1784044037.199601:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843ce7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1870705580898560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784044037.199635:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843ce7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1870705580898560:12345-0@lo:400:kworker.0 Request processed in 34us (173us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044037.199642:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1784044037.199660:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580898944 00000100:00100000:0.0:1784044037.199663:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580898944 00000100:00100000:0.0:1784044037.199686:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580899712 00000100:00100000:0.0:1784044037.199688:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580899712 00000100:00100000:0.0:1784044037.199705:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580899072 00000100:00100000:0.0:1784044037.199714:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580899072 00000100:00100000:0.0:1784044037.199729:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1784044037.199736:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38436a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1870705580898944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784044037.199771:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38436a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1870705580898944:12345-0@lo:400:kworker.0 Request processed in 36us (1342us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044037.199777:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1784044037.199787:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1784044037.199792:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b384316e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1870705580899712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784044037.199815:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b384316e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1870705580899712:12345-0@lo:400:kworker.0 Request processed in 23us (427us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044037.199820:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1784044037.199829:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1784044037.199835:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843ce6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1870705580899072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784044037.199857:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843ce6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1870705580899072:12345-0@lo:400:kworker.0 Request processed in 22us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044037.199862:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1784044037.199878:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580898688 00000100:00100000:0.0:1784044037.199881:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580898688 00000100:00100000:0.0:1784044037.199894:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580899200 00000100:00100000:0.0:1784044037.199896:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580899200 00000100:00100000:0.0:1784044037.199924:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580899584 00000100:00100000:0.0:1784044037.199927:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580899584 00000100:00100000:0.0:1784044037.199942:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1784044037.199948:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b384316e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1870705580898688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784044037.199987:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b384316e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1870705580898688:12345-0@lo:400:kworker.0 Request processed in 39us (681us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044037.199993:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1784044037.200012:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1784044037.200017:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b384316f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1870705580899200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784044037.200044:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b384316f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1870705580899200:12345-0@lo:400:kworker.0 Request processed in 27us (702us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044037.200049:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1784044037.200060:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1784044037.200066:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843ce7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1870705580899584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784044037.200089:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843ce7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1870705580899584:12345-0@lo:400:kworker.0 Request processed in 24us (551us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044037.200095:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00080000:0.0:1784044037.200111:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1784044037.200114:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1784044037.200117:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784044037.200148:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397bbbc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1870705580898560:0@lo:400:kworker.0 00010000:00080000:0.0:1784044037.200159:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b397bbbc700 x1870705580899072/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784044053 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784044037.200168:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397bbbc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1870705580899072:0@lo:400:kworker.0 00010000:00080000:0.0:1784044037.200218:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b3975b7e680 x1870705580899584/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044053 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784044037.200227:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3975b7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3641:1870705580899584:0@lo:400:kworker.0 00000100:00100000:0.0:1784044037.200237:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397bbbd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3641:1870705580898688:0@lo:400:kworker.0 00000100:00100000:0.0:1784044037.200245:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3975b7fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3641:1870705580899200:0@lo:400:kworker.0 00010000:00080000:0.0:1784044037.200254:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b3975b7dc00 x1870705580899712/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784044053 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784044037.200273:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3975b7dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1870705580899712:0@lo:400:kworker.0 00010000:00080000:0.0:1784044037.200309:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b397bbbd180 x1870705580898944/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784044053 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784044037.200318:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397bbbd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1870705580898944:0@lo:400:kworker.0 00000100:00100000:3.0:1784044037.200634:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580898048 00000100:00100000:3.0:1784044037.200639:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580898048 00000100:00100000:3.0:1784044037.200667:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580898176 00000100:00100000:3.0:1784044037.200670:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580898176 00000100:00100000:3.0:1784044037.200682:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1784044037.200688:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b384316f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1870705580898048:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1784044037.200710:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784044037.200754:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b384316f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1870705580898048:12345-0@lo:13:osp-pre-1-0.0 Request processed in 65us (3009us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044037.200760:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1784044037.200772:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1784044037.200777:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b384316ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1870705580898176:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1784044037.200786:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784044037.200813:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b384316ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1870705580898176:12345-0@lo:13:osp-pre-1-1.0 Request processed in 36us (1555us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044037.200819:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:3.0:1784044037.200845:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b397aa54e00 x1870705580898048/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784044053 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784044037.200866:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397aa54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1870705580898048:0@lo:13:osp-pre-1-0.0 00010000:00080000:3.0:1784044037.200892:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b3843c56a00 x1870705580898176/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784044053 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784044037.200903:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843c56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1870705580898176:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1784044037.201031:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580898304 00000100:00100000:1.0:1784044037.201043:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580898304 00000100:00100000:1.0:1784044037.201083:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:1.0:1784044037.201089:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3970ede450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+24:3638:x1870705580898304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044037.201128:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3970ede450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+24:3638:x1870705580898304:12345-0@lo:400:kworker.0 Request processed in 40us (2890us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044037.201135:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:1.0:1784044037.201205:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3975b51c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:3638:1870705580898304:0@lo:400:kworker.0 00000100:00080000:0.0:1784044037.201462:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00000080:3.0:1784044037.717320:0:10387:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff89544c00 20000000:00000080:3.0:1784044037.717340:0:10387:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9b384315d400 uarg=0000000000000000 20000000:01000000:3.0:1784044037.717383:0:10387:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1784044037.717390:0:10387:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1784044037.717395:0:10387:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1784044037.717810:0:10388:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:3.0:1784044037.717980:0:10387:0:(mgs_llog.c:4116:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:3.0:1784044037.721712:0:10387:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:3.0:1784044037.721757:0:10387:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:3.0:1784044037.721775:0:10387:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:3.0:1784044037.721791:0:10387:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1784044037.721811:0:10387:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b39759f9800/0x89871fc3aba1800a lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044037.721830:0:10387:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b39759f8200/0x89871fc3aba17ca6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x89871fc3aba17c9f expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044037.721837:0:10387:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b3965d1c400/0x89871fc3aba17cb4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x89871fc3aba17cad expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044037.721843:0:10387:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b39759f8800/0x89871fc3aba17d78 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x89871fc3aba17d71 expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044037.721849:0:10387:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b3965d1c600/0x89871fc3aba17e2e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x89871fc3aba17e27 expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044037.721877:0:10387:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b3965d1da00/0x89871fc3aba17f46 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca652e expref: 9 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044037.721884:0:10387:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b39759f9800/0x89871fc3aba1800a lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044037.721933:0:10387:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b3965d1da00/0x89871fc3aba17f46 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca652e expref: 9 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044037.721949:0:10387:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b3965d1da00/0x89871fc3aba17f46 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca652e expref: 9 pid: 6504 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044037.721964:0:10387:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b38427b5500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10387:1870705580899840:192.168.202.40@tcp:104: 00010000:00010000:3.0:1784044037.722260:0:10387:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b3965d1c600/0x89871fc3aba17e2e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x89871fc3aba17e27 expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044037.722270:0:10387:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b3965d1c600/0x89871fc3aba17e2e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x89871fc3aba17e27 expref: 23 pid: 6505 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044037.722280:0:10387:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b38427b5180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10387:1870705580899968:0@lo:104: 00000100:00100000:3.0:1784044037.722326:0:10387:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1784044037.722367:0:10387:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b39759f8800/0x89871fc3aba17d78 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x89871fc3aba17d71 expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044037.722375:0:10387:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b39759f8800/0x89871fc3aba17d78 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x89871fc3aba17d71 expref: 23 pid: 6505 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044037.722384:0:10387:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b38427b7100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10387:1870705580900096:0@lo:104: 00010000:00010000:3.0:1784044037.722419:0:10387:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b3965d1c400/0x89871fc3aba17cb4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x89871fc3aba17cad expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044037.722427:0:10387:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b3965d1c400/0x89871fc3aba17cb4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x89871fc3aba17cad expref: 23 pid: 6506 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044037.722435:0:10387:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b38427b5880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10387:1870705580900224:0@lo:104: 00010000:00010000:3.0:1784044037.722458:0:10387:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b39759f8200/0x89871fc3aba17ca6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x89871fc3aba17c9f expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044037.722465:0:10387:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b39759f8200/0x89871fc3aba17ca6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x89871fc3aba17c9f expref: 23 pid: 6505 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044037.722474:0:10387:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397bbbd180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10387:1870705580900352:0@lo:104: 00000100:00100000:3.0:1784044037.722491:0:10387:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b397b969a80 going to sleep for 11 seconds 00000100:00100000:2.0:1784044037.723378:0:6494:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1784044037.723401:0:6494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044037.723464:0:6494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044037.723574:0:6494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044037.723596:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580899968 00000100:00100000:1.0:1784044037.723605:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580899968 00000100:00100000:1.0:1784044037.723656:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580900096 00000100:00100000:1.0:1784044037.723659:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580900096 00000100:00100000:1.0:1784044037.723670:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580900224 00000100:00100000:1.0:1784044037.723672:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580900224 00000100:00100000:1.0:1784044037.723684:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1784044037.723692:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397b817050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+5:10387:x1870705580899968:12345-0@lo:104: 00010000:00010000:1.0:1784044037.723706:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.140@tcp lock: ffff9b394166bc00/0x89871fc3aba17e27 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x89871fc3aba17e2e expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044037.723819:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1784044037.723825:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397b817050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+5:10387:x1870705580899968:12345-0@lo:104: Request processed in 134us (1499us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044037.723832:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1784044037.723871:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1784044037.723877:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397aa54e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+4:10387:x1870705580900096:12345-0@lo:104: 00010000:00010000:1.0:1784044037.723884:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.140@tcp lock: ffff9b394166aa00/0x89871fc3aba17d71 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x89871fc3aba17d78 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044037.723931:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1784044037.723944:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397aa54e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+4:10387:x1870705580900096:12345-0@lo:104: Request processed in 67us (542us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044037.723950:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1784044037.723963:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1784044037.723969:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397aa57480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+3:10387:x1870705580900224:12345-0@lo:104: 00010000:00010000:1.0:1784044037.723976:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.140@tcp lock: ffff9b3965d1d400/0x89871fc3aba17cad lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x89871fc3aba17cb4 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044037.724154:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1784044037.724159:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397aa57480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+3:10387:x1870705580900224:12345-0@lo:104: Request processed in 191us (695us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044037.724165:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1784044037.724341:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580900352 00000100:00100000:2.0:1784044037.724345:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580900352 00000100:00100000:2.0:1784044037.724367:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1784044037.724373:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d46680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+3:10387:x1870705580900352:12345-0@lo:104: 00010000:00010000:2.0:1784044037.724381:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.140@tcp lock: ffff9b3965d1ca00/0x89871fc3aba17c9f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x89871fc3aba17ca6 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044037.724477:0:10387:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b38427b5180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10387:1870705580899968:0@lo:104: 00000100:00100000:3.0:1784044037.724487:0:10387:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b38427b7100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10387:1870705580900096:0@lo:104: 00000100:00100000:3.0:1784044037.724493:0:10387:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b38427b5880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10387:1870705580900224:0@lo:104: 00000100:00100000:3.0:1784044037.724499:0:10387:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397bbbd180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10387:1870705580900352:0@lo:104: 00010000:00010000:0.0:1784044037.724555:0:10331:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1784044037.724563:0:10331:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: ffff9b394166bc00/0x89871fc3aba17e27 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x89871fc3aba17e2e expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044037.724570:0:10331:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b394166bc00 already unused, calling callback (ffffffffc113cc20) 10000000:00010000:0.0:1784044037.724574:0:10331:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: ffff9b394166bc00/0x89871fc3aba17e27 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x89871fc3aba17e2e expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044037.724581:0:10331:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9b394166bc00/0x89871fc3aba17e27 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x89871fc3aba17e2e expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784044037.724588:0:10331:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9b394166bc00/0x89871fc3aba17e27 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x89871fc3aba17e2e expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784044037.724594:0:10331:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1784044037.724636:0:10331:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.140@tcp lock: ffff9b394166bc00/0x89871fc3aba17e27 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x89871fc3aba17e2e expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044037.724652:0:10331:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784044037.724675:0:10331:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: ffff9b394166bc00/0x89871fc3aba17e27 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x89871fc3aba17e2e expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044037.724693:0:10331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9b394166bc00/0x89871fc3aba17e27 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x89871fc3aba17e2e expref: -99 pid: 9503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044037.724704:0:10331:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1784044037.724707:0:10331:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: ffff9b394166aa00/0x89871fc3aba17d71 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x89871fc3aba17d78 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044037.724712:0:10331:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b394166aa00 already unused, calling callback (ffffffffc113cc20) 10000000:00010000:0.0:1784044037.724714:0:10331:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: ffff9b394166aa00/0x89871fc3aba17d71 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x89871fc3aba17d78 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044037.724720:0:10331:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9b394166aa00/0x89871fc3aba17d71 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x89871fc3aba17d78 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784044037.724726:0:10331:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9b394166aa00/0x89871fc3aba17d71 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x89871fc3aba17d78 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784044037.724730:0:10331:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1784044037.724743:0:10331:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.140@tcp lock: ffff9b394166aa00/0x89871fc3aba17d71 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x89871fc3aba17d78 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044037.724749:0:10331:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784044037.724755:0:10331:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: ffff9b394166aa00/0x89871fc3aba17d71 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x89871fc3aba17d78 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044037.724760:0:10331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9b394166aa00/0x89871fc3aba17d71 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x89871fc3aba17d78 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044037.724769:0:10331:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1784044037.724777:0:10331:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: ffff9b3965d1d400/0x89871fc3aba17cad lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x89871fc3aba17cb4 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044037.724783:0:10331:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3965d1d400 already unused, calling callback (ffffffffc113cc20) 10000000:00010000:0.0:1784044037.724786:0:10331:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: ffff9b3965d1d400/0x89871fc3aba17cad lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x89871fc3aba17cb4 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044037.724792:0:10331:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9b3965d1d400/0x89871fc3aba17cad lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x89871fc3aba17cb4 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784044037.724798:0:10331:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9b3965d1d400/0x89871fc3aba17cad lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x89871fc3aba17cb4 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784044037.724803:0:10331:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1784044037.724816:0:10331:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.140@tcp lock: ffff9b3965d1d400/0x89871fc3aba17cad lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x89871fc3aba17cb4 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044037.724821:0:10331:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784044037.724836:0:10331:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: ffff9b3965d1d400/0x89871fc3aba17cad lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x89871fc3aba17cb4 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044037.724842:0:10331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9b3965d1d400/0x89871fc3aba17cad lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x89871fc3aba17cb4 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044037.724851:0:10331:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784044037.724854:0:10331:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: ffff9b3965d1ca00/0x89871fc3aba17c9f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x89871fc3aba17ca6 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044037.724860:0:10331:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3965d1ca00 already unused, calling callback (ffffffffc113cc20) 10000000:00010000:0.0:1784044037.724863:0:10331:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: ffff9b3965d1ca00/0x89871fc3aba17c9f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x89871fc3aba17ca6 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044037.724880:0:10331:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9b3965d1ca00/0x89871fc3aba17c9f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x89871fc3aba17ca6 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784044037.724886:0:10331:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9b3965d1ca00/0x89871fc3aba17c9f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x89871fc3aba17ca6 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784044037.724891:0:10331:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1784044037.724913:0:10331:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.140@tcp lock: ffff9b3965d1ca00/0x89871fc3aba17c9f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x89871fc3aba17ca6 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044037.724919:0:10331:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784044037.724925:0:10331:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: ffff9b3965d1ca00/0x89871fc3aba17c9f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x89871fc3aba17ca6 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044037.724932:0:10331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9b3965d1ca00/0x89871fc3aba17c9f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x89871fc3aba17ca6 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044037.724946:0:10331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784044037.724947:0:10331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784044037.724949:0:10331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784044037.724963:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843ce4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:3639:1870705580900608:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784044037.724999:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1784044037.725239:0:10330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784044037.725246:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784044037.725257:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843ce5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:3638:1870705580900480:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784044037.725383:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843ce5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:3640:1870705580900736:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784044037.725408:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1784044037.725776:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:2.0:1784044037.725785:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d46680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+3:10387:x1870705580900352:12345-0@lo:104: Request processed in 1412us (2210us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044037.725806:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00010000:1.0:1784044037.725884:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784044037.726019:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044037.726033:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580900608 00000100:00100000:3.0:1784044037.726039:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580900608 00010000:00010000:3.0:1784044037.726066:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b39759f8800/0x89871fc3aba17d78 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x89871fc3aba17d71 expref: 24 pid: 6505 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044037.726090:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580900736 00000100:00100000:3.0:1784044037.726093:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580900736 00010000:00010000:3.0:1784044037.726104:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b3965d1c400/0x89871fc3aba17cb4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x89871fc3aba17cad expref: 25 pid: 6506 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044037.726130:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1784044037.726137:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843ce4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+25:3639:x1870705580900608:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784044037.726150:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784044037.726156:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b39759f8800/0x89871fc3aba17d78 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x89871fc3aba17d71 expref: 25 pid: 6505 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044037.726166:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b39759f8800/0x89871fc3aba17d78 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x89871fc3aba17d71 expref: 25 pid: 6505 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044037.726204:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b39759f8800/0x89871fc3aba17d78 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x89871fc3aba17d71 expref: 25 pid: 6505 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044037.726217:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784044037.726255:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843ce4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+24:3639:x1870705580900608:12345-0@lo:103:ldlm_bl.0 Request processed in 119us (1256us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044037.726262:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1784044037.726274:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1784044037.726280:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843ce7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+23:3640:x1870705580900736:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784044037.726288:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784044037.726293:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b3965d1c400/0x89871fc3aba17cb4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x89871fc3aba17cad expref: 23 pid: 6506 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044037.726372:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b3965d1c400/0x89871fc3aba17cb4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x89871fc3aba17cad expref: 23 pid: 6506 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044037.726383:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b3965d1c400/0x89871fc3aba17cb4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x89871fc3aba17cad expref: 23 pid: 6506 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044037.726403:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784044037.726426:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843ce7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+22:3640:x1870705580900736:12345-0@lo:103:ldlm_bl.0 Request processed in 146us (1018us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044037.726432:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1784044037.726505:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843ce4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:3639:1870705580900608:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784044037.726545:0:10387:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b38427b5500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10387:1870705580899840:192.168.202.40@tcp:104: 00010000:00010000:3.0:1784044037.726573:0:10387:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b39759f9800/0x89871fc3aba1800a lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044037.726770:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843ce5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:3640:1870705580900736:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784044037.726782:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784044037.726790:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843ce4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:3640:1870705580900864:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784044037.726972:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044037.727267:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044037.727577:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580900480 00000100:00100000:3.0:1784044037.727583:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580900480 00010000:00010000:3.0:1784044037.727607:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b3965d1c600/0x89871fc3aba17e2e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x89871fc3aba17e27 expref: 22 pid: 6505 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044037.727625:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580900864 00000100:00100000:3.0:1784044037.727628:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580900864 00010000:00010000:3.0:1784044037.727636:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b39759f8200/0x89871fc3aba17ca6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x89871fc3aba17c9f expref: 23 pid: 6505 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044037.727711:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1784044037.727718:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843c54e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+23:3638:x1870705580900480:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784044037.727729:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784044037.727733:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b3965d1c600/0x89871fc3aba17e2e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x89871fc3aba17e27 expref: 23 pid: 6505 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044037.727742:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b3965d1c600/0x89871fc3aba17e2e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x89871fc3aba17e27 expref: 23 pid: 6505 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044037.727767:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b3965d1c600/0x89871fc3aba17e2e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x89871fc3aba17e27 expref: 23 pid: 6505 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044037.727780:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784044037.727861:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843c54e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+22:3638:x1870705580900480:12345-0@lo:103:ldlm_bl.0 Request processed in 142us (1841us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044037.727868:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1784044037.727883:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1784044037.727888:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3944092050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+21:3640:x1870705580900864:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784044037.727896:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784044037.727910:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b39759f8200/0x89871fc3aba17ca6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x89871fc3aba17c9f expref: 21 pid: 6505 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044037.727917:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b39759f8200/0x89871fc3aba17ca6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x89871fc3aba17c9f expref: 21 pid: 6505 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044037.727926:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b39759f8200/0x89871fc3aba17ca6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x89871fc3aba17c9f expref: 21 pid: 6505 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044037.727935:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784044037.727962:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3944092050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+20:3640:x1870705580900864:12345-0@lo:103:ldlm_bl.0 Request processed in 74us (990us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044037.727968:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1784044037.728093:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843ce5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:3638:1870705580900480:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784044037.728148:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843ce4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:3640:1870705580900864:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784044037.729418:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565112704 00000100:00100000:3.0:1784044037.729429:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565112704 00010000:00010000:3.0:1784044037.729465:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b3965d1da00/0x89871fc3aba17f46 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca652e expref: 10 pid: 6504 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044037.729504:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 39 00000100:00100000:3.0:1784044037.729511:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d45c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c4a09ad9-a185-4679-99bb-b6a07b865440+10:2410:x1870705565112704:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784044037.729523:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784044037.729528:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b3965d1da00/0x89871fc3aba17f46 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca652e expref: 10 pid: 6504 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044037.729540:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b3965d1da00/0x89871fc3aba17f46 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca652e expref: 10 pid: 6504 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044037.729555:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b3965d1da00/0x89871fc3aba17f46 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca652e expref: 10 pid: 6504 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044037.729569:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b39759f9800/0x89871fc3aba1800a lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044037.729577:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b39759f9800/0x89871fc3aba1800a lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044037.729595:0:6498:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b39759f9800/0x89871fc3aba1800a lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044037.729602:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b39759f9800/0x89871fc3aba1800a lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044037.729609:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b39759f9800/0x89871fc3aba1800a lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044037.729616:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b39759f9800/0x89871fc3aba1800a lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044037.729634:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b39759f9800 already unused, calling callback (ffffffffc0b56230) 00010000:00010000:3.0:1784044037.729710:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b39759f9800/0x89871fc3aba1800a lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044037.729721:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b39759f9800/0x89871fc3aba1800a lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044037.729741:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b39759f9800/0x89871fc3aba1800a lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044037.729751:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784044037.729800:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d45c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c4a09ad9-a185-4679-99bb-b6a07b865440+9:2410:x1870705565112704:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 288us (2534us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044037.729808:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 39 00010000:00010000:0.0:1784044037.730986:0:10387:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b39759f9800/0x89871fc3aba1800a lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044037.731002:0:10387:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b39759f9800/0x89871fc3aba1800a lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044037.731086:0:10387:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b39759f9800/0x89871fc3aba1800a lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044037.777403:0:10331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784044037.872056:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044037.872412:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565112832 00000100:00100000:3.0:1784044037.872431:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565112832 00000100:00100000:3.0:1784044037.872484:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 253 00000100:00100000:3.0:1784044037.872494:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3970edfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4a09ad9-a185-4679-99bb-b6a07b865440+9:6180:x1870705565112832:12345-192.168.202.40@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784044037.872511:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784044037.872529:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b39759f8800/0x89871fc3aba18011 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd3dffad52ca6574 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044037.872559:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b39759f8800/0x89871fc3aba18011 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6574 expref: 10 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044037.872571:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b39759f8800/0x89871fc3aba18011 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6574 expref: 10 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044037.872594:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b39759f8800, rc 0) 00000100:00100000:3.0:1784044037.872653:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3970edfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4a09ad9-a185-4679-99bb-b6a07b865440+10:6180:x1870705565112832:12345-192.168.202.40@tcp:101:ll_cfg_requeue.0 Request processed in 160us (606us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044037.872660:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 253 00000100:00100000:0.0:1784044037.886919:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044037.887072:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565112960 00000100:00100000:3.0:1784044037.887082:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565112960 00000100:00100000:3.0:1784044037.887169:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 254 00000100:00100000:3.0:1784044037.887214:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3970eddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4a09ad9-a185-4679-99bb-b6a07b865440+10:6180:x1870705565112960:12345-192.168.202.40@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784044037.887357:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3970eddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4a09ad9-a185-4679-99bb-b6a07b865440+10:6180:x1870705565112960:12345-192.168.202.40@tcp:501:ll_cfg_requeue.0 Request processed in 146us (457us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044037.887366:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 254 00000100:00100000:3.0:1784044037.889095:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1784044037.891067:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565113088 00000100:00100000:1.0:1784044037.891082:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565113088 00000100:00100000:1.0:1784044037.891257:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 255 00000100:00100000:1.0:1784044037.891270:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3965efcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4a09ad9-a185-4679-99bb-b6a07b865440+10:6180:x1870705565113088:12345-192.168.202.40@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784044037.891447:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3965efcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4a09ad9-a185-4679-99bb-b6a07b865440+10:6180:x1870705565113088:12345-192.168.202.40@tcp:503:ll_cfg_requeue.0 Request processed in 178us (2358us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044037.891455:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 255 00000100:00100000:0.0:1784044037.930245:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044037.933081:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565113216 00000100:00100000:3.0:1784044037.933099:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565113216 00000100:00100000:3.0:1784044037.933215:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 256 00000100:00100000:3.0:1784044037.933227:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3970edec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4a09ad9-a185-4679-99bb-b6a07b865440+10:6700:x1870705565113216:12345-192.168.202.40@tcp:502:llog_process_th.0 00000100:00100000:3.0:1784044037.933390:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3970edec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4a09ad9-a185-4679-99bb-b6a07b865440+10:6700:x1870705565113216:12345-192.168.202.40@tcp:502:llog_process_th.0 Request processed in 166us (3155us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044037.933398:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 256 00000100:00100000:0.0:1784044037.948766:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1784044037.948891:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565113344 00000100:00100000:1.0:1784044037.948923:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565113344 00000100:00100000:1.0:1784044037.948989:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 257 00000100:00100000:1.0:1784044037.949001:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3965efd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4a09ad9-a185-4679-99bb-b6a07b865440+10:6700:x1870705565113344:12345-192.168.202.40@tcp:502:llog_process_th.0 00000100:00100000:1.0:1784044037.949159:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3965efd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4a09ad9-a185-4679-99bb-b6a07b865440+10:6700:x1870705565113344:12345-192.168.202.40@tcp:502:llog_process_th.0 Request processed in 160us (403us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044037.949167:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 257 00010000:00010000:1.0:1784044038.799445:0:10330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1784044039.632706:0:6508:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1784044039.632715:0:6508:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9b384244a000 from 4 10000000:01000000:3.0:1784044039.632719:0:6508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1784044039.632766:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b39759f8e00/0x89871fc3aba18018 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044039.632812:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9b39759f8e00/0x89871fc3aba18018 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044039.632823:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9b39759f8e00/0x89871fc3aba18018 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044039.632849:0:6508:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397bbbd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580900992:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784044039.635976:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044039.636314:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580900992 00000100:00100000:2.0:1784044039.636332:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580900992 00000100:00100000:2.0:1784044039.636420:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:2.0:1784044039.636437:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3965efc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+20:6508:x1870705580900992:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784044039.636469:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784044039.636487:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b39586ef000/0x89871fc3aba1801f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x89871fc3aba18018 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044039.636515:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b39586ef000/0x89871fc3aba1801f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x89871fc3aba18018 expref: 21 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044039.636526:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b39586ef000/0x89871fc3aba1801f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x89871fc3aba18018 expref: 21 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044039.636535:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b39586ef000, rc 0) 00000100:00100000:2.0:1784044039.636576:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3965efc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+21:6508:x1870705580900992:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 142us (609us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044039.636584:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:3.0:1784044039.636687:0:6508:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3951e2bb40 going to sleep for 11 seconds 00000100:00100000:3.0:1784044039.636717:0:6508:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397bbbd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580900992:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784044039.636735:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9b39759f8e00/0x89871fc3aba18018 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba1801f expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044039.636745:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9b39759f8e00/0x89871fc3aba18018 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x89871fc3aba1801f expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044039.636831:0:6508:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397bbbd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580901120:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784044039.636876:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044039.636912:0:6508:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3951e2bb40 going to sleep for 11 seconds 00000100:00100000:0.0:1784044039.637154:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580901120 00000100:00100000:0.0:1784044039.637159:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580901120 00000100:00100000:0.0:1784044039.637434:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:0.0:1784044039.637450:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3965efbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+21:6508:x1870705580901120:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784044039.637601:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3965efbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+21:6508:x1870705580901120:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 159us (723us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044039.637608:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:0.0:1784044039.637662:0:6508:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397bbbd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580901120:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784044039.637701:0:6508:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843ce5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580901248:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784044039.637750:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044039.637766:0:6508:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b38436c79c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784044039.637777:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580901248 00000100:00100000:0.0:1784044039.637780:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580901248 00000100:00100000:0.0:1784044039.637805:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:0.0:1784044039.637824:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3965efac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+21:6508:x1870705580901248:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784044039.637935:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3965efac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+21:6508:x1870705580901248:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 122us (183us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044039.637942:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:0.0:1784044039.638002:0:6508:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843ce5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580901248:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784044039.646740:0:10449:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d46a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:10449:1870705580901376:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784044039.646841:0:10449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044039.647568:0:10449:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3975915000 going to sleep for 11 seconds 00000100:00100000:0.0:1784044039.647653:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580901376 00000100:00100000:0.0:1784044039.647667:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580901376 00000100:00100000:0.0:1784044039.647731:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:0.0:1784044039.647741:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3965ef8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+21:10449:x1870705580901376:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784044039.647913:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3965ef8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+21:10449:x1870705580901376:12345-0@lo:502:llog_process_th.0 Request processed in 172us (1071us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044039.647920:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:2.0:1784044039.648239:0:10449:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d46a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:10449:1870705580901376:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1784044039.648267:0:10449:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784044039.648276:0:10449:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784044039.648279:0:10449:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1784044039.648290:0:10449:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9b384244a000 00000020:00000080:2.0:1784044039.648292:0:10449:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1784044039.648403:0:10449:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d46a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:10449:1870705580901504:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784044039.648447:0:10449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044039.648474:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580901504 00000100:00100000:2.0:1784044039.648477:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580901504 00000100:00100000:2.0:1784044039.648507:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1784044039.648520:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3965ef9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+21:10449:x1870705580901504:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784044039.648612:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3965ef9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+21:10449:x1870705580901504:12345-0@lo:502:llog_process_th.0 Request processed in 97us (164us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044039.648619:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1784044039.648663:0:10449:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3975915000 going to sleep for 11 seconds 00000100:00100000:2.0:1784044039.648675:0:10449:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d46a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:10449:1870705580901504:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1784044039.648691:0:10449:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784044039.648695:0:10449:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784044039.648697:0:10449:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1784044039.648700:0:10449:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1784044039.651779:0:6508:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1784044039.651819:0:6508:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1784044039.651835:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b39759f8e00/0x89871fc3aba18018 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba1801f expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044039.651853:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9b39759f8e00/0x89871fc3aba18018 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba1801f expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784044039.651874:0:6508:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1784044039.651902:0:6508:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9b3975aa3000 from 4 10000000:01000000:3.0:1784044039.651905:0:6508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1784044039.651940:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b39759f8200/0x89871fc3aba18026 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044039.651949:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9b39759f8200/0x89871fc3aba18026 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044039.651960:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9b39759f8200/0x89871fc3aba18026 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044039.651985:0:6508:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397bbbd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580901632:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784044039.653167:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044039.653223:0:6508:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3951e2b6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784044039.653302:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580901632 00000100:00100000:3.0:1784044039.653309:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580901632 00000100:00100000:3.0:1784044039.653355:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1784044039.653364:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3965ef9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+21:6508:x1870705580901632:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784044039.653378:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784044039.653393:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b39759f9800/0x89871fc3aba1802d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x89871fc3aba18026 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044039.653421:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b39759f9800/0x89871fc3aba1802d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x89871fc3aba18026 expref: 22 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044039.653432:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b39759f9800/0x89871fc3aba1802d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x89871fc3aba18026 expref: 22 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044039.653452:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b39759f9800, rc 0) 00000100:00100000:3.0:1784044039.653496:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3965ef9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+22:6508:x1870705580901632:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 132us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044039.653502:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1784044039.653552:0:6508:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397bbbd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580901632:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784044039.653567:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9b39759f8200/0x89871fc3aba18026 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba1802d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044039.653576:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9b39759f8200/0x89871fc3aba18026 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x89871fc3aba1802d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044039.655197:0:6508:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397bbbd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580901760:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784044039.655273:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044039.655308:0:6508:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3951e2b6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784044039.655340:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580901760 00000100:00100000:3.0:1784044039.655345:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580901760 00000100:00100000:3.0:1784044039.655404:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1784044039.655413:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3965ef8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+22:6508:x1870705580901760:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784044039.656517:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3965ef8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+22:6508:x1870705580901760:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1092us (1239us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044039.656527:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1784044039.656595:0:6508:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397bbbd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580901760:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784044039.656670:0:6508:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397bbbd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580901888:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784044039.656721:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044039.656758:0:6508:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3951e2b6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784044039.656794:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580901888 00000100:00100000:3.0:1784044039.656807:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580901888 00000100:00100000:3.0:1784044039.656847:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:3.0:1784044039.656855:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3965efa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+22:6508:x1870705580901888:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784044039.656980:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3965efa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+22:6508:x1870705580901888:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 126us (259us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044039.656988:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:3.0:1784044039.658952:0:6508:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397bbbd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580901888:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784044039.659367:0:10453:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397bbbd880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:10453:1870705580902016:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784044039.659422:0:10453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044039.659459:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580902016 00000100:00100000:3.0:1784044039.659464:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580902016 00000100:00100000:3.0:1784044039.659506:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:3.0:1784044039.659513:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3965ef8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+22:10453:x1870705580902016:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784044039.660809:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3965ef8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+22:10453:x1870705580902016:12345-0@lo:502:llog_process_th.0 Request processed in 1291us (1382us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044039.660820:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:3.0:1784044039.660873:0:10453:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3951e2b6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784044039.660905:0:10453:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397bbbd880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:10453:1870705580902016:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1784044039.660931:0:10453:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784044039.660940:0:10453:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784044039.660942:0:10453:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1784044039.660949:0:10453:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9b3975aa3000 00000020:00000080:3.0:1784044039.660951:0:10453:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1784044039.661785:0:10453:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397bbbd880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:10453:1870705580902144:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784044039.661858:0:10453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044039.661909:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580902144 00000100:00100000:3.0:1784044039.661914:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580902144 00000100:00100000:2.0:1784044039.664391:0:10453:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3951e2b6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784044039.665012:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:3.0:1784044039.665029:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3965efb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+22:10453:x1870705580902144:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784044039.666317:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3965efb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+22:10453:x1870705580902144:12345-0@lo:502:llog_process_th.0 Request processed in 1286us (4449us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044039.666327:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:2.0:1784044039.666498:0:10453:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397bbbd880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:10453:1870705580902144:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1784044039.666538:0:10453:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784044039.666546:0:10453:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784044039.666555:0:10453:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1784044039.666560:0:10453:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1784044039.666702:0:6508:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1784044039.666721:0:6508:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1784044039.666732:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b39759f8200/0x89871fc3aba18026 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba1802d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044039.666742:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9b39759f8200/0x89871fc3aba18026 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba1802d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784044039.666752:0:6508:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1784044039.666754:0:6508:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9b396f3cf800 from 4 10000000:01000000:3.0:1784044039.666766:0:6508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1784044039.666804:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b39759f9c00/0x89871fc3aba18034 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044039.666812:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9b39759f9c00/0x89871fc3aba18034 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044039.666828:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9b39759f9c00/0x89871fc3aba18034 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044039.666854:0:6508:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397bbbc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580902272:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784044039.666923:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044039.667010:0:6508:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3951e2b900 going to sleep for 11 seconds 00000100:00100000:2.0:1784044039.672410:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580902272 00000100:00100000:2.0:1784044039.672425:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580902272 00000100:00100000:2.0:1784044039.672516:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:2.0:1784044039.672527:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3965ef9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+22:6508:x1870705580902272:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784044039.672546:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784044039.672569:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b39586ef400/0x89871fc3aba1803b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x89871fc3aba18034 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044039.672598:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b39586ef400/0x89871fc3aba1803b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x89871fc3aba18034 expref: 23 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044039.672609:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b39586ef400/0x89871fc3aba1803b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x89871fc3aba18034 expref: 23 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044039.672618:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b39586ef400, rc 0) 00000100:00100000:2.0:1784044039.672687:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3965ef9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+23:6508:x1870705580902272:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 162us (5763us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044039.672695:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1784044039.675112:0:6508:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397bbbc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580902272:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784044039.675142:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9b39759f9c00/0x89871fc3aba18034 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba1803b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044039.675156:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9b39759f9c00/0x89871fc3aba18034 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x89871fc3aba1803b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044039.675253:0:6508:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397bbbc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580902400:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784044039.675308:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044039.675472:0:6508:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3951e2b900 going to sleep for 11 seconds 00000100:00100000:0.0:1784044039.675691:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580902400 00000100:00100000:0.0:1784044039.675699:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580902400 00000100:00100000:0.0:1784044039.675738:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:0.0:1784044039.675745:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3965efa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+23:6508:x1870705580902400:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784044039.675866:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3965efa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+23:6508:x1870705580902400:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 121us (558us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044039.675874:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:3.0:1784044039.679075:0:6508:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397bbbc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580902400:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784044039.679134:0:6508:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397bbbc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580902528:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784044039.679232:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044039.679265:0:6508:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3951e2b900 going to sleep for 11 seconds 00000100:00100000:3.0:1784044039.679281:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580902528 00000100:00100000:3.0:1784044039.679287:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580902528 00000100:00100000:3.0:1784044039.679330:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:3.0:1784044039.679338:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3965efb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+23:6508:x1870705580902528:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784044039.679440:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3965efb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+23:6508:x1870705580902528:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 102us (208us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044039.679448:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:3.0:1784044039.679488:0:6508:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397bbbc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580902528:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784044039.679795:0:10457:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d46a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:10457:1870705580902656:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784044039.679833:0:10457:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044039.679853:0:10457:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3942b880c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784044039.681030:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580902656 00000100:00100000:3.0:1784044039.681204:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580902656 00000100:00100000:3.0:1784044039.681242:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:3.0:1784044039.681249:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3965ef9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+23:10457:x1870705580902656:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784044039.681352:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3965ef9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+23:10457:x1870705580902656:12345-0@lo:502:llog_process_th.0 Request processed in 102us (1518us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044039.681359:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:2.0:1784044039.683009:0:10457:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d46a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:10457:1870705580902656:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1784044039.683044:0:10457:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784044039.683054:0:10457:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784044039.683056:0:10457:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1784044039.683063:0:10457:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9b396f3cf800 00000020:00000080:2.0:1784044039.683066:0:10457:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1784044039.683219:0:10457:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397bbbc700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:10457:1870705580902784:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784044039.683276:0:10457:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044039.683305:0:10457:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b38420db240 going to sleep for 11 seconds 00000100:00100000:2.0:1784044039.683398:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580902784 00000100:00100000:2.0:1784044039.683404:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580902784 00000100:00100000:2.0:1784044039.683441:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:2.0:1784044039.683448:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3965ef8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+23:10457:x1870705580902784:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784044039.684210:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3965ef8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+23:10457:x1870705580902784:12345-0@lo:502:llog_process_th.0 Request processed in 761us (931us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044039.684227:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:3.0:1784044039.684736:0:10457:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397bbbc700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:10457:1870705580902784:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1784044039.684765:0:10457:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784044039.684772:0:10457:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784044039.684774:0:10457:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1784044039.684777:0:10457:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1784044039.687663:0:6508:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1784044039.687697:0:6508:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1784044039.687708:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b39759f9c00/0x89871fc3aba18034 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba1803b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044039.687721:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9b39759f9c00/0x89871fc3aba18034 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba1803b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784044039.687731:0:6508:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1784044039.687734:0:6508:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9b397418c800 from 4 10000000:01000000:2.0:1784044039.687736:0:6508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1784044039.687769:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b39586ee400/0x89871fc3aba18042 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044039.687777:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9b39586ee400/0x89871fc3aba18042 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044039.687787:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9b39586ee400/0x89871fc3aba18042 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044039.687811:0:6508:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d46a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580902912:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1784044039.687866:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044039.687922:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580902912 00000100:00100000:2.0:1784044039.687924:0:6508:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3842748900 going to sleep for 11 seconds 00000100:00100000:3.0:1784044039.687930:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580902912 00000100:00100000:3.0:1784044039.688104:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:3.0:1784044039.688114:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3965efb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+23:6508:x1870705580902912:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784044039.688125:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784044039.688137:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b39759f8600/0x89871fc3aba18049 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x89871fc3aba18042 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044039.688158:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b39759f8600/0x89871fc3aba18049 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x89871fc3aba18042 expref: 24 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044039.688167:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b39759f8600/0x89871fc3aba18049 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x89871fc3aba18042 expref: 24 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044039.688202:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b39759f8600, rc 0) 00000100:00100000:3.0:1784044039.688237:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3965efb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+24:6508:x1870705580902912:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 125us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044039.688244:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:3.0:1784044039.692783:0:6508:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d46a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580902912:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784044039.692815:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9b39586ee400/0x89871fc3aba18042 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba18049 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044039.692829:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9b39586ee400/0x89871fc3aba18042 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x89871fc3aba18049 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044039.692931:0:6508:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397bbbc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580903040:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784044039.693000:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044039.693398:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580903040 00000100:00100000:2.0:1784044039.693404:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580903040 00000100:00100000:2.0:1784044039.693448:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:2.0:1784044039.693456:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3965efa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+24:6508:x1870705580903040:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784044039.693569:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3965efa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+24:6508:x1870705580903040:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 112us (569us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044039.693584:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:3.0:1784044039.694372:0:6508:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3951e2b600 going to sleep for 11 seconds 00000100:00100000:3.0:1784044039.694393:0:6508:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397bbbc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580903040:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784044039.694432:0:6508:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397bbbc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580903168:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784044039.694474:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044039.694499:0:6508:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3951e2b600 going to sleep for 11 seconds 00000100:00100000:2.0:1784044039.694620:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580903168 00000100:00100000:2.0:1784044039.694625:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580903168 00000100:00100000:2.0:1784044039.694659:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:2.0:1784044039.694666:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3950377450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+24:6508:x1870705580903168:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784044039.694749:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3950377450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+24:6508:x1870705580903168:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 82us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044039.694756:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:2.0:1784044039.694794:0:6508:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397bbbc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580903168:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784044039.698062:0:10459:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d44e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:10459:1870705580903296:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784044039.698153:0:10459:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044039.698220:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580903296 00000100:00100000:2.0:1784044039.698227:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580903296 00000100:00100000:2.0:1784044039.698268:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:2.0:1784044039.698277:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3950374050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+24:10459:x1870705580903296:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784044039.698379:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3950374050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+24:10459:x1870705580903296:12345-0@lo:502:llog_process_th.0 Request processed in 103us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044039.698386:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:2.0:1784044039.698434:0:10459:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b38427489c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784044039.698454:0:10459:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d44e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:10459:1870705580903296:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1784044039.698478:0:10459:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784044039.698487:0:10459:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784044039.698489:0:10459:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1784044039.698496:0:10459:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9b397418c800 00000020:00000080:2.0:1784044039.698498:0:10459:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1784044039.698573:0:10459:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d44e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:10459:1870705580903424:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784044039.698606:0:10459:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044039.698637:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580903424 00000100:00100000:2.0:1784044039.698641:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580903424 00000100:00100000:2.0:1784044039.698666:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:2.0:1784044039.698672:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3950375450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+24:10459:x1870705580903424:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784044039.698731:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3950375450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+24:10459:x1870705580903424:12345-0@lo:502:llog_process_th.0 Request processed in 59us (125us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044039.698738:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:2.0:1784044039.698766:0:10459:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b38427489c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784044039.698778:0:10459:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d44e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:10459:1870705580903424:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1784044039.698795:0:10459:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784044039.698799:0:10459:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784044039.698800:0:10459:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1784044039.698803:0:10459:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1784044039.698848:0:6508:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1784044039.698865:0:6508:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1784044039.698874:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b39586ee400/0x89871fc3aba18042 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba18049 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044039.698918:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9b39586ee400/0x89871fc3aba18042 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba18049 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044039.821386:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784044039.921529:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044039.921587:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044039.921616:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044039.921781:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044039.921814:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044039.921985:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565113600 00000100:00100000:3.0:1784044039.921994:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565113600 00000100:00100000:3.0:1784044039.922051:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565113728 00000100:00100000:3.0:1784044039.922055:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565113728 00000100:00100000:3.0:1784044039.922078:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 64 00000100:00100000:3.0:1784044039.922088:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843ce5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+6:2408:x1870705565113600:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:3.0:1784044039.922161:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843ce5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+6:2408:x1870705565113600:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 74us (642us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044039.922195:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 64 00000100:00100000:3.0:1784044039.922214:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 65 00000100:00100000:3.0:1784044039.922221:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843ce5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+5:2407:x1870705565113728:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:3.0:1784044039.922248:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843ce5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+5:2407:x1870705565113728:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 27us (631us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044039.922254:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 65 00000100:00100000:1.0:1784044039.923010:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565113472 00000100:00100000:1.0:1784044039.923017:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565113472 00000100:00100000:1.0:1784044039.923055:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 278 00000100:00100000:1.0:1784044039.923062:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3950376450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4a09ad9-a185-4679-99bb-b6a07b865440+10:2407:x1870705565113472:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:1.0:1784044039.923111:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3950376450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4a09ad9-a185-4679-99bb-b6a07b865440+10:2407:x1870705565113472:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 48us (1523us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044039.923118:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 278 00000100:00100000:1.0:1784044039.923287:0:9822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565113984 00000100:00100000:1.0:1784044039.923292:0:9822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565113984 00000100:00100000:1.0:1784044039.923320:0:9822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565113856 00000100:00100000:1.0:1784044039.923322:0:9822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565113856 00000100:00100000:1.0:1784044039.923343:0:9822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 17 00000100:00100000:1.0:1784044039.923350:0:9822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843ce5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a93fdf3c-d42f-420a-95ea-b0cbfe954363+5:2407:x1870705565113984:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:1.0:1784044039.923390:0:9822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843ce5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a93fdf3c-d42f-420a-95ea-b0cbfe954363+5:2407:x1870705565113984:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 41us (1674us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044039.923397:0:9822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 17 00000100:00100000:1.0:1784044039.923410:0:9822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 18 00000100:00100000:1.0:1784044039.923416:0:9822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843ce6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a93fdf3c-d42f-420a-95ea-b0cbfe954363+5:2408:x1870705565113856:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:1.0:1784044039.923441:0:9822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843ce6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a93fdf3c-d42f-420a-95ea-b0cbfe954363+5:2408:x1870705565113856:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 25us (1627us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044039.923453:0:9822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 18 00000100:00080000:3.0:1784044039.924736:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1784044039.924741:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1784044039.924744:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1784044039.924746:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784044040.280547:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843c57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1870705580903552:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1784044040.280625:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044040.280719:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580903552 00000100:00100000:2.0:1784044040.280727:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580903552 00000100:00100000:2.0:1784044040.280779:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1784044040.280789:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843ce5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1870705580903552:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1784044040.280826:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1784044040.283864:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843ce5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1870705580903552:12345-0@lo:41:osp-pre-0-1.0 Request processed in 3068us (3229us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044040.283888:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1784044040.285272:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843c57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1870705580903552:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1784044040.845505:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784044041.293414:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397bbbc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1870705580903680:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1784044041.293504:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044041.293553:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397bbbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1870705580903808:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784044041.293586:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044041.293644:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784044041.293651:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1870705580903936:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1784044041.293673:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044041.293702:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580903808 00000100:00100000:0.0:1784044041.293709:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580903808 00000100:00100000:0.0:1784044041.293751:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580903936 00000100:00100000:0.0:1784044041.293754:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580903936 00000100:00100000:0.0:1784044041.293772:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1784044041.293780:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843ce7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1870705580903808:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1784044041.293807:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784044041.293853:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843ce7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1870705580903808:12345-0@lo:13:osp-pre-0-0.0 Request processed in 73us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044041.293861:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1784044041.293909:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1784044041.293917:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843ce4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1870705580903936:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1784044041.293926:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784044041.293950:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843ce4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1870705580903936:12345-0@lo:13:osp-pre-0-1.0 Request processed in 34us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044041.293955:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:0.0:1784044041.293986:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b3843d44e00 x1870705580903936/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784044057 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784044041.294024:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1870705580903936:0@lo:13:osp-pre-0-1.0 00010000:00080000:0.0:1784044041.294037:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b397bbbc000 x1870705580903808/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784044057 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784044041.294047:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397bbbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1870705580903808:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1784044041.294093:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784044041.298790:0:7768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580903680 00000100:00100000:0.0:1784044041.298803:0:7768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580903680 00000100:00100000:0.0:1784044041.298865:0:7768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1784044041.298885:0:7768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843c56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1870705580903680:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1784044041.298923:0:7768:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1784044041.298992:0:7768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843c56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1870705580903680:12345-0@lo:41:osp-pre-1-0.0 Request processed in 109us (5488us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044041.299000:0:7768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1784044041.299096:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397bbbc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1870705580903680:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1784044041.872411:0:10331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784044042.320549:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397bbbc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1870705580904064:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1784044042.320674:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843ce5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:3640:1870705580904320:0@lo:400:kworker.0 00000100:00100000:3.0:1784044042.320723:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044042.320769:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843ce4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1870705580904832:0@lo:400:kworker.0 00000100:00100000:3.0:1784044042.320793:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044042.320811:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b38435ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1870705580905344:0@lo:400:kworker.0 00000100:00100000:3.0:1784044042.320832:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044042.320845:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b38435ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1870705580905856:0@lo:400:kworker.0 00000100:00100000:3.0:1784044042.320880:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044042.320906:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1784044042.320912:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843ce6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1870705580904448:0@lo:400:kworker.0 00000100:00100000:3.0:1784044042.320932:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044042.320947:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843ce7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1870705580904960:0@lo:400:kworker.0 00000100:00100000:3.0:1784044042.320965:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044042.320981:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b38435efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3640:1870705580905472:0@lo:400:kworker.0 00000100:00100000:3.0:1784044042.321010:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044042.321043:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580904320 00000100:00100000:3.0:1784044042.321051:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580904320 00000100:00100000:3.0:1784044042.321097:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:3.0:1784044042.321106:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3950377c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+24:3640:x1870705580904320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044042.321155:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3950377c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+24:3640:x1870705580904320:12345-0@lo:400:kworker.0 Request processed in 50us (432us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044042.321162:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:3.0:1784044042.321260:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580904832 00000100:00100000:3.0:1784044042.321264:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580904832 00000100:00100000:3.0:1784044042.321288:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1784044042.321295:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397bbbc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1870705580904832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044042.321343:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397bbbc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1870705580904832:12345-0@lo:400:kworker.0 Request processed in 48us (549us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044042.321349:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1784044042.321368:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580905344 00000100:00100000:3.0:1784044042.321371:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580905344 00000100:00100000:3.0:1784044042.321402:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580904448 00000100:00100000:3.0:1784044042.321406:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580904448 00000100:00100000:3.0:1784044042.321418:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580905472 00000100:00100000:3.0:1784044042.321421:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580905472 00000100:00100000:3.0:1784044042.321435:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1784044042.321441:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397bbbc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1870705580905344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044042.321470:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397bbbc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1870705580905344:12345-0@lo:400:kworker.0 Request processed in 30us (638us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044042.321476:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1784044042.321488:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1784044042.321493:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397bbbd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1870705580904448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044042.321528:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397bbbd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1870705580904448:12345-0@lo:400:kworker.0 Request processed in 34us (594us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044042.321535:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1784044042.321548:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1784044042.321554:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397bbbf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1870705580905472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044042.321591:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397bbbf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1870705580905472:12345-0@lo:400:kworker.0 Request processed in 38us (580us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044042.321609:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1784044042.321646:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843ce6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1870705580904448:0@lo:400:kworker.0 00000100:00100000:3.0:1784044042.321657:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b38435efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3640:1870705580905472:0@lo:400:kworker.0 00000100:00100000:3.0:1784044042.321665:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843ce5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:3640:1870705580904320:0@lo:400:kworker.0 00000100:00100000:3.0:1784044042.321673:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843ce4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1870705580904832:0@lo:400:kworker.0 00010000:00080000:3.0:1784044042.321684:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b38435ee300 x1870705580905344/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044058 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784044042.321694:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b38435ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1870705580905344:0@lo:400:kworker.0 00000100:00100000:0.0:1784044042.321945:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044042.321982:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843ce4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1870705580904576:0@lo:400:kworker.0 00000100:00100000:0.0:1784044042.322008:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044042.322028:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843ce4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1870705580905088:0@lo:400:kworker.0 00000100:00100000:0.0:1784044042.322050:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044042.322068:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b38435edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3638:1870705580905600:0@lo:400:kworker.0 00000100:00100000:0.0:1784044042.322089:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044042.322107:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:0.0:1784044042.322114:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843ce6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1870705580904192:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784044042.322143:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044042.322157:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843ce4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1870705580904704:0@lo:400:kworker.0 00000100:00100000:0.0:1784044042.322200:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044042.322214:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b38435ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1870705580905216:0@lo:400:kworker.0 00000100:00100000:0.0:1784044042.322233:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044042.322240:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b38435ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1870705580905728:0@lo:400:kworker.0 00000100:00100000:0.0:1784044042.322258:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044042.322286:0:7768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580904576 00000100:00100000:0.0:1784044042.322290:0:7768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580904576 00000100:00100000:3.0:1784044042.322695:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580904064 00000100:00100000:3.0:1784044042.322700:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580904064 00000100:00100000:3.0:1784044042.322723:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580904192 00000100:00100000:3.0:1784044042.322725:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580904192 00000100:00100000:3.0:1784044042.322739:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1784044042.322745:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38435eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1870705580904064:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1784044042.322769:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784044042.322809:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38435eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1870705580904064:12345-0@lo:13:osp-pre-1-1.0 Request processed in 63us (864us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044042.322830:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1784044042.322844:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1784044042.322849:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38435eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1870705580904192:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1784044042.322868:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784044042.322893:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38435eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1870705580904192:12345-0@lo:13:osp-pre-1-0.0 Request processed in 44us (750us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044042.322899:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1784044042.322967:0:7768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1784044042.322974:0:7768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38435ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1870705580904576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784044042.323006:0:7768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38435ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1870705580904576:12345-0@lo:400:kworker.0 Request processed in 33us (997us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044042.323012:0:7768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00080000:0.0:1784044042.323029:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784044042.323033:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1784044042.323036:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1784044042.323050:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580905600 00000100:00100000:0.0:1784044042.323054:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580905600 00000100:00100000:0.0:1784044042.323081:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580904704 00000100:00100000:0.0:1784044042.323084:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580904704 00000100:00100000:0.0:1784044042.323093:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580905216 00000100:00100000:0.0:1784044042.323095:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580905216 00000100:00100000:0.0:1784044042.323110:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1784044042.323115:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38435ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1870705580905600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784044042.323144:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38435ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1870705580905600:12345-0@lo:400:kworker.0 Request processed in 29us (1054us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044042.323159:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1784044042.323189:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1784044042.323196:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38435ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1870705580904704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784044042.323222:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38435ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1870705580904704:12345-0@lo:400:kworker.0 Request processed in 27us (1022us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044042.323228:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1784044042.323238:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1784044042.323242:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38435ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1870705580905216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784044042.323262:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38435ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1870705580905216:12345-0@lo:400:kworker.0 Request processed in 20us (1028us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044042.323266:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00010000:00080000:0.0:1784044042.323296:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b3843ce6680 x1870705580904192/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784044058 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784044042.323314:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843ce6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1870705580904192:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784044042.323400:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843ce4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1870705580904704:0@lo:400:kworker.0 00000100:00100000:0.0:1784044042.323411:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b38435ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1870705580905216:0@lo:400:kworker.0 00010000:00080000:0.0:1784044042.323423:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b397bbbc380 x1870705580904064/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784044058 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1784044042.323705:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1784044042.323708:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1784044042.323749:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397bbbc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1870705580904064:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1784044042.323765:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843ce4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1870705580904576:0@lo:400:kworker.0 00010000:00080000:0.0:1784044042.323777:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b38435edf80 x1870705580905600/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044058 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784044042.323797:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b38435edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3638:1870705580905600:0@lo:400:kworker.0 00000100:00100000:0.0:1784044042.323873:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580905856 00000100:00100000:0.0:1784044042.323878:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580905856 00000100:00100000:0.0:1784044042.323902:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580904960 00000100:00100000:0.0:1784044042.323905:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580904960 00000100:00100000:0.0:1784044042.323916:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580905088 00000100:00100000:0.0:1784044042.323919:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580905088 00000100:00100000:0.0:1784044042.323929:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580905728 00000100:00100000:0.0:1784044042.323931:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580905728 00000100:00100000:0.0:1784044042.323940:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1784044042.323945:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397bbbd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1870705580905856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784044042.323993:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397bbbd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1870705580905856:12345-0@lo:400:kworker.0 Request processed in 48us (3113us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044042.323999:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1784044042.324010:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1784044042.324016:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397bbbca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1870705580904960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784044042.324043:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397bbbca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1870705580904960:12345-0@lo:400:kworker.0 Request processed in 27us (3076us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044042.324048:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1784044042.324058:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1784044042.324063:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38435ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1870705580905088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784044042.324091:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38435ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1870705580905088:12345-0@lo:400:kworker.0 Request processed in 29us (2041us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044042.324096:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1784044042.324106:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1784044042.324111:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38435ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1870705580905728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784044042.324143:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38435ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1870705580905728:12345-0@lo:400:kworker.0 Request processed in 32us (1884us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044042.324148:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:0.0:1784044042.324206:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b38435ec700 x1870705580905728/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784044058 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784044042.324215:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b38435ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1870705580905728:0@lo:400:kworker.0 00010000:00080000:0.0:1784044042.324226:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b3843ce4700 x1870705580905088/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784044058 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784044042.324234:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843ce4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1870705580905088:0@lo:400:kworker.0 00010000:00080000:3.0:1784044042.324930:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b3843ce7800 x1870705580904960/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784044058 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784044042.324942:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843ce7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1870705580904960:0@lo:400:kworker.0 00010000:00080000:3.0:1784044042.324953:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b38435ed180 x1870705580905856/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784044058 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784044042.324961:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b38435ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1870705580905856:0@lo:400:kworker.0 00010000:00010000:1.0:1784044042.894465:0:10330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784044043.925457:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784044044.944658:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1784044044.985762:0:10687:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg240-server.virtnet: executing check_logdir /tmp/testlogs/ 00000100:00100000:0.0:1784044045.039989:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044045.040037:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044045.040066:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044045.040107:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044045.040129:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044045.040159:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565114624 00000100:00100000:0.0:1784044045.040171:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565114624 00000100:00100000:0.0:1784044045.040267:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565114496 00000100:00100000:0.0:1784044045.040271:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565114496 00000100:00100000:0.0:1784044045.040295:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 23 00000100:00100000:0.0:1784044045.040306:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38435edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+5:2409:x1870705565114624:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:0.0:1784044045.040383:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38435edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+5:2409:x1870705565114624:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 79us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044045.040392:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 23 00000100:00100000:0.0:1784044045.040410:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 24 00000100:00100000:0.0:1784044045.040430:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38435ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+5:2409:x1870705565114496:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:0.0:1784044045.040457:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38435ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+5:2409:x1870705565114496:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 28us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044045.040463:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 24 00000100:00100000:0.0:1784044045.040481:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565114368 00000100:00100000:0.0:1784044045.040484:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565114368 00000100:00100000:0.0:1784044045.040509:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565114240 00000100:00100000:0.0:1784044045.040511:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565114240 00000100:00100000:0.0:1784044045.040531:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 72 00000100:00100000:0.0:1784044045.040537:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38435ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+5:2409:x1870705565114368:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:0.0:1784044045.040592:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38435ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+5:2409:x1870705565114368:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 54us (554us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044045.040600:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 72 00000100:00100000:0.0:1784044045.040613:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 73 00000100:00100000:0.0:1784044045.040620:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38435ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+6:2409:x1870705565114240:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:0.0:1784044045.040644:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38435ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+6:2409:x1870705565114240:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 25us (536us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044045.040650:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 73 00000100:00100000:1.0:1784044045.040963:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565114112 00000100:00100000:1.0:1784044045.040968:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565114112 00000100:00100000:1.0:1784044045.041003:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 280 00000100:00100000:1.0:1784044045.041010:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3950375c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4a09ad9-a185-4679-99bb-b6a07b865440+10:2409:x1870705565114112:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:1.0:1784044045.041035:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3950375c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4a09ad9-a185-4679-99bb-b6a07b865440+10:2409:x1870705565114112:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 26us (1058us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044045.041041:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 280 00000100:00080000:3.0:1784044045.041643:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1784044045.041649:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1784044045.041651:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1784044045.041653:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784044045.390947:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784044045.390971:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843c57b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1870705580905984:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1784044045.391038:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044045.393065:0:7768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580905984 00000100:00100000:0.0:1784044045.393090:0:7768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580905984 00000100:00100000:0.0:1784044045.393324:0:7768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1784044045.393335:0:7768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843c55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1870705580905984:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1784044045.393384:0:7768:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1784044045.393466:0:7768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843c55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1870705580905984:12345-0@lo:41:osp-pre-0-1.0 Request processed in 133us (2427us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044045.393483:0:7768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1784044045.402280:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843c57b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1870705580905984:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1784044045.965439:0:10331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784044046.415517:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784044046.415551:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397bbbed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1870705580906112:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1784044046.415656:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044046.415741:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580906112 00000100:00100000:0.0:1784044046.415750:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580906112 00000100:00100000:0.0:1784044046.415806:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1784044046.415815:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38435edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1870705580906112:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1784044046.415871:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1784044046.415918:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38435edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1870705580906112:12345-0@lo:41:osp-pre-1-0.0 Request processed in 104us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044046.415926:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1784044046.415977:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397bbbed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1870705580906112:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1784044046.416397:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784044046.416412:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397bbbed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1870705580906240:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784044046.416453:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044046.416495:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580906240 00000100:00100000:1.0:1784044046.416500:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580906240 00000100:00100000:1.0:1784044046.416545:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1784044046.416555:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843c54700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1870705580906240:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784044046.416778:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1870705580906368:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1784044046.416818:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1784044046.416915:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784044046.417038:0:8430:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:0.0:1784044046.417048:0:8430:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00002000:00000024:1.0:1784044046.418668:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784044046.418790:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843c54700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1870705580906240:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2232us (2330us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044046.418802:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1784044046.418853:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580906368 00000100:00100000:1.0:1784044046.418861:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580906368 00000100:00100000:1.0:1784044046.418909:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1784044046.418917:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397bbbc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1870705580906368:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1784044046.418938:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784044046.418971:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397bbbc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1870705580906368:12345-0@lo:13:osp-pre-0-1.0 Request processed in 54us (2152us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044046.418978:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:1.0:1784044046.419023:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b3843d47480 x1870705580906368/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784044062 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784044046.419048:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1870705580906368:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1784044046.419075:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1784044046.419841:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b397bbbed80 x1870705580906240/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784044062 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784044046.419861:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397bbbed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1870705580906240:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1784044046.989388:0:10330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784044047.437643:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b38435eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1870705580906496:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784044047.437710:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044047.438211:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:3638:1870705580906624:0@lo:400:kworker.0 00000100:00100000:2.0:1784044047.438269:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044047.438295:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1870705580907136:0@lo:400:kworker.0 00000100:00100000:2.0:1784044047.438315:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044047.438331:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1870705580907648:0@lo:400:kworker.0 00000100:00100000:2.0:1784044047.438351:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044047.438366:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1784044047.438372:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d47b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1870705580906752:0@lo:400:kworker.0 00000100:00100000:2.0:1784044047.438387:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044047.438400:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1870705580907264:0@lo:400:kworker.0 00000100:00100000:2.0:1784044047.438418:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044047.438430:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d46d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3638:1870705580907776:0@lo:400:kworker.0 00000100:00100000:2.0:1784044047.438464:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044047.438491:0:7768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580907136 00000100:00100000:2.0:1784044047.438498:0:7768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580907136 00000100:00100000:2.0:1784044047.438536:0:7768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1784044047.438544:0:7768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1870705580907136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784044047.438588:0:7768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1870705580907136:12345-0@lo:400:kworker.0 Request processed in 44us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044047.438595:0:7768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1784044047.438612:0:9501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580907648 00000100:00100000:2.0:1784044047.438616:0:9501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580907648 00000100:00100000:2.0:1784044047.438648:0:9501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580906752 00000100:00100000:2.0:1784044047.438650:0:9501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580906752 00000100:00100000:2.0:1784044047.438659:0:9501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580907776 00000100:00100000:2.0:1784044047.438661:0:9501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580907776 00000100:00100000:2.0:1784044047.438672:0:9501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1784044047.438677:0:9501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1870705580907648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784044047.438703:0:9501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1870705580907648:12345-0@lo:400:kworker.0 Request processed in 26us (351us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044047.438709:0:9501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1784044047.438718:0:9501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1784044047.438723:0:9501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1870705580906752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784044047.438742:0:9501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1870705580906752:12345-0@lo:400:kworker.0 Request processed in 19us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044047.438748:0:9501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1784044047.438758:0:9501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1784044047.438763:0:9501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3975b89500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1870705580907776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784044047.438989:0:9501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3975b89500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1870705580907776:12345-0@lo:400:kworker.0 Request processed in 225us (523us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044047.438995:0:9501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:2.0:1784044047.439014:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1784044047.439018:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1784044047.439027:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1870705580906880:0@lo:400:kworker.0 00000100:00100000:2.0:1784044047.439048:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044047.439065:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1870705580907392:0@lo:400:kworker.0 00000100:00100000:2.0:1784044047.439081:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044047.439093:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d45500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3640:1870705580907904:0@lo:400:kworker.0 00000100:00100000:2.0:1784044047.439119:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044047.439134:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1784044047.439139:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1870705580907008:0@lo:400:kworker.0 00000100:00100000:2.0:1784044047.439157:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044047.439168:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3640:1870705580907520:0@lo:400:kworker.0 00000100:00100000:2.0:1784044047.439208:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044047.439218:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1870705580908032:0@lo:400:kworker.0 00000100:00100000:1.0:1784044047.439326:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580906880 00000100:00100000:1.0:1784044047.439330:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580906880 00000100:00100000:1.0:1784044047.439355:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1784044047.439361:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3975b8b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1870705580906880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044047.439606:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580907904 00000100:00100000:3.0:1784044047.439609:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580907904 00000100:00100000:3.0:1784044047.439632:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580907008 00000100:00100000:3.0:1784044047.439634:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580907008 00000100:00100000:3.0:1784044047.439642:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580907520 00000100:00100000:3.0:1784044047.439644:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580907520 00000100:00100000:3.0:1784044047.439655:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1784044047.439661:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3975b8a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1870705580907904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784044047.439728:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580906496 00000100:00100000:0.0:1784044047.439731:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580906496 00000100:00100000:0.0:1784044047.439760:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1784044047.439768:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843c55180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1870705580906496:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1784044047.439802:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784044047.441846:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3975b8b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1870705580906880:12345-0@lo:400:kworker.0 Request processed in 2476us (2787us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044047.441859:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1784044047.441933:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397bbbed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1870705580908160:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1784044047.441972:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044047.442017:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d47b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1870705580906752:0@lo:400:kworker.0 00000100:00100000:1.0:1784044047.442028:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d46d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3638:1870705580907776:0@lo:400:kworker.0 00000100:00100000:1.0:1784044047.442038:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1870705580907136:0@lo:400:kworker.0 00010000:00080000:1.0:1784044047.442051:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b3843d45880 x1870705580907648/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044063 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784044047.442073:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1870705580907648:0@lo:400:kworker.0 00000100:00100000:1.0:1784044047.442144:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580907264 00000100:00100000:1.0:1784044047.442149:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580907264 00000100:00100000:1.0:1784044047.442196:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580907392 00000100:00100000:1.0:1784044047.442199:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580907392 00000100:00100000:1.0:1784044047.442217:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1784044047.442224:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d46a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1870705580907264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044047.442277:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d46a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1870705580907264:12345-0@lo:400:kworker.0 Request processed in 53us (3857us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044047.442283:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1784044047.442293:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1784044047.442298:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3975b88380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1870705580907392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044047.442321:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3975b88380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1870705580907392:12345-0@lo:400:kworker.0 Request processed in 23us (3239us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044047.442327:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1784044047.442344:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1784044047.442351:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3975b89c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1870705580907008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044047.442386:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3975b89c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1870705580907008:12345-0@lo:400:kworker.0 Request processed in 36us (3228us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044047.442392:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1784044047.442404:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1784044047.442410:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3975b8aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1870705580907520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044047.442432:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3975b8aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1870705580907520:12345-0@lo:400:kworker.0 Request processed in 23us (3224us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044047.442437:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1784044047.442453:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580906624 00000100:00100000:1.0:1784044047.442456:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580906624 00000100:00100000:1.0:1784044047.442476:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:1.0:1784044047.442482:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3950374c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+24:3638:x1870705580906624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044047.442508:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3950374c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+24:3638:x1870705580906624:12345-0@lo:400:kworker.0 Request processed in 27us (4239us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044047.442513:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00010000:00080000:1.0:1784044047.442548:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b3843d44a80 x1870705580907264/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784044063 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784044047.447217:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1870705580907264:0@lo:400:kworker.0 00000100:00100000:1.0:1784044047.447294:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:3638:1870705580906624:0@lo:400:kworker.0 00000100:00100000:1.0:1784044047.447371:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580908160 00000100:00100000:1.0:1784044047.447377:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580908160 00000100:00100000:1.0:1784044047.447425:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1784044047.447432:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843c54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1870705580908160:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1784044047.447454:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784044047.447524:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843c54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1870705580908160:12345-0@lo:13:osp-pre-1-1.0 Request processed in 92us (5552us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044047.447545:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:1.0:1784044047.450861:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b397bbbed80 x1870705580908160/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784044063 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784044047.450889:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397bbbed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1870705580908160:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1784044047.459727:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1784044047.459801:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1784044047.459807:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1784044047.459810:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1784044047.459872:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1870705580906880:0@lo:400:kworker.0 00010000:00080000:2.0:1784044047.459889:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b3843d44000 x1870705580907392/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784044063 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784044047.459900:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1870705580907392:0@lo:400:kworker.0 00000100:00100000:2.0:1784044047.459927:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1870705580907008:0@lo:400:kworker.0 00000100:00100000:2.0:1784044047.459937:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3640:1870705580907520:0@lo:400:kworker.0 00000100:00100000:1.0:1784044047.460034:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580908032 00000100:00100000:1.0:1784044047.460040:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580908032 00000100:00100000:1.0:1784044047.460103:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1784044047.460112:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3975b88e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1870705580908032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044047.460170:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3975b88e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1870705580908032:12345-0@lo:400:kworker.0 Request processed in 59us (451us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044047.460203:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:2.0:1784044047.460512:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b3843d47100 x1870705580908032/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784044063 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784044047.460524:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1870705580908032:0@lo:400:kworker.0 00000100:00100000:3.0:1784044047.460621:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3975b8a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1870705580907904:12345-0@lo:400:kworker.0 Request processed in 20958us (21498us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044047.460630:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00010000:00080000:2.0:1784044047.460795:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b3843d45500 x1870705580907904/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044063 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784044047.460805:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d45500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3640:1870705580907904:0@lo:400:kworker.0 00000100:00100000:0.0:1784044047.465318:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843c55180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1870705580906496:12345-0@lo:13:osp-pre-1-0.0 Request processed in 25544us (27600us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044047.465333:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:0.0:1784044047.465385:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b38435eea00 x1870705580906496/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784044063 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784044047.465420:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b38435eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1870705580906496:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1784044048.013935:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784044049.037968:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784044050.065565:0:10331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784044050.151068:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1784044050.151123:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1784044050.151154:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1784044050.151215:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565115008 00000100:00100000:3.0:1784044050.151724:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565114752 00000100:00100000:3.0:1784044050.151735:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565114752 00000100:00100000:3.0:1784044050.151805:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 282 00000100:00100000:3.0:1784044050.151817:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3950376c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4a09ad9-a185-4679-99bb-b6a07b865440+10:2408:x1870705565114752:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:3.0:1784044050.151892:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3950376c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4a09ad9-a185-4679-99bb-b6a07b865440+10:2408:x1870705565114752:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 78us (835us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044050.151900:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 282 00000100:00100000:1.0:1784044050.154111:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565115008 00000100:00080000:3.0:1784044050.154214:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1784044050.154239:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565114880 00000100:00100000:1.0:1784044050.154244:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565114880 00000100:00100000:1.0:1784044050.154293:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 80 00000100:00100000:1.0:1784044050.154309:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843c57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+5:2408:x1870705565115008:12345-192.168.202.40@tcp:400:kworker.0 00000100:00080000:3.0:1784044050.154313:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784044050.154405:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843c57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+5:2408:x1870705565115008:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 102us (3280us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044050.154412:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 80 00000100:00100000:1.0:1784044050.154428:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 81 00000100:00100000:1.0:1784044050.154435:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843c57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+6:2408:x1870705565114880:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:1.0:1784044050.154475:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843c57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+6:2408:x1870705565114880:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 42us (3320us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044050.154482:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 81 00000100:00100000:1.0:1784044050.156742:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1784044050.156805:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1784044050.156835:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565115136 00000100:00100000:1.0:1784044050.156844:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565115136 00000100:00100000:1.0:1784044050.156898:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565115264 00000100:00100000:1.0:1784044050.156901:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565115264 00000100:00100000:1.0:1784044050.156925:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 20 00000100:00100000:1.0:1784044050.156935:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843c54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+5:2406:x1870705565115136:12345-192.168.202.40@tcp:9:kworker.0 00000020:00000080:1.0:1784044050.156969:0:8426:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x89871fc3aba17f5b 00000100:00080000:1.0:1784044050.156979:0:8426:0:(import.c:65:import_set_state_nolock()) ffff9b384345f000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1784044050.157022:0:8426:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:1.0:1784044050.157219:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843c54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+2:2406:x1870705565115136:12345-192.168.202.40@tcp:9:kworker.0 Request processed in 284us (487us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044050.157226:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 20 00000100:00100000:1.0:1784044050.157255:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 21 00000100:00100000:1.0:1784044050.157262:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397bbaac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+5:2406:x1870705565115264:12345-192.168.202.40@tcp:9:kworker.0 00000020:00000080:1.0:1784044050.157276:0:8426:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x89871fc3aba17f62 00000100:00080000:1.0:1784044050.157282:0:8426:0:(import.c:65:import_set_state_nolock()) ffff9b3843458800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1784044050.157308:0:8426:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:1.0:1784044050.157377:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397bbaac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+2:2406:x1870705565115264:12345-192.168.202.40@tcp:9:kworker.0 Request processed in 115us (572us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044050.157384:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 21 00000100:00080000:1.0:1784044050.157547:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784044050.157560:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1784044050.157632:0:10330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784044050.157638:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784044050.513578:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3975b8b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1870705580908288:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1784044050.513675:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044050.514126:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580908288 00000100:00100000:2.0:1784044050.514137:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580908288 00000100:00100000:2.0:1784044050.514221:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1784044050.514232:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843c55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1870705580908288:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1784044050.514281:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1784044050.514334:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843c55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1870705580908288:12345-0@lo:41:osp-pre-0-1.0 Request processed in 105us (660us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044050.514342:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1784044050.514579:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3975b8b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1870705580908288:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1784044051.085492:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1784044051.354912:0:10932:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg240-server.virtnet: executing yml_node 00000100:00100000:1.0:1784044051.534228:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1784044051.534253:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397bbbfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1870705580908416:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784044051.534325:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044051.534470:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580908416 00000100:00100000:1.0:1784044051.534478:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580908416 00000100:00100000:1.0:1784044051.534547:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1784044051.534559:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843c54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1870705580908416:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1784044051.534588:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784044051.534633:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843c54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1870705580908416:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044051.534640:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:1.0:1784044051.534661:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1784044051.534690:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b397bbbfb80 x1870705580908416/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784044067 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784044051.534709:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397bbbfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1870705580908416:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784044051.535055:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784044051.535065:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397bbbd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1870705580908544:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1784044051.535097:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044051.535132:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580908544 00000100:00100000:2.0:1784044051.535136:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580908544 00000100:00100000:2.0:1784044051.535161:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1784044051.535166:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3975b8a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1870705580908544:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1784044051.535195:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784044051.535224:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3975b8a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1870705580908544:12345-0@lo:13:osp-pre-0-1.0 Request processed in 57us (126us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044051.535231:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:2.0:1784044051.535254:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b397bbbd880 x1870705580908544/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784044067 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784044051.535267:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397bbbd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1870705580908544:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1784044051.535429:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784044051.536630:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397bbbca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1870705580908672:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1784044051.536674:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044051.536754:0:7768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580908672 00000100:00100000:3.0:1784044051.536760:0:7768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580908672 00000100:00100000:3.0:1784044051.536813:0:7768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1784044051.536821:0:7768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843c54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1870705580908672:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1784044051.536855:0:7768:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1784044051.536898:0:7768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843c54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1870705580908672:12345-0@lo:41:osp-pre-1-0.0 Request processed in 77us (222us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044051.536911:0:7768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1784044051.537090:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397bbbca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1870705580908672:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1784044052.111342:0:10331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784044052.558052:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397bbbed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1870705580908800:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1784044052.558133:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044052.558293:0:10713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580908800 00000100:00100000:3.0:1784044052.558302:0:10713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580908800 00000100:00100000:3.0:1784044052.558368:0:10713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1784044052.558379:0:10713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843c56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1870705580908800:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1784044052.558407:0:10713:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784044052.558448:0:10713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843c56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1870705580908800:12345-0@lo:13:osp-pre-1-1.0 Request processed in 71us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044052.558456:0:10713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:1.0:1784044052.558659:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784044052.558788:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39503be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3639:1870705580909312:0@lo:400:kworker.0 00000100:00100000:1.0:1784044052.558839:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044052.558857:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39759b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3639:1870705580909824:0@lo:400:kworker.0 00000100:00100000:1.0:1784044052.558891:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044052.558907:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39759b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1870705580910336:0@lo:400:kworker.0 00000100:00100000:1.0:1784044052.558941:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1784044052.558975:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b397bbbed80 x1870705580908800/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784044068 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784044052.558992:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397bbbed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1870705580908800:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1784044052.559009:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1784044052.559014:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843c57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1870705580909184:0@lo:400:kworker.0 00000100:00100000:1.0:1784044052.559037:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044052.559056:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39759b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1870705580909696:0@lo:400:kworker.0 00000100:00100000:1.0:1784044052.559075:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044052.559090:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39759b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3639:1870705580910208:0@lo:400:kworker.0 00000100:00100000:1.0:1784044052.559107:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044052.559129:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843c54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3641:1870705580909056:0@lo:400:kworker.0 00000100:00100000:1.0:1784044052.559150:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044052.559165:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39759b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1870705580909568:0@lo:400:kworker.0 00000100:00100000:1.0:1784044052.559207:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044052.559228:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39759b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3641:1870705580910080:0@lo:400:kworker.0 00000100:00100000:1.0:1784044052.559246:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044052.559257:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1784044052.559262:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843c56680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:3641:1870705580908928:0@lo:400:kworker.0 00000100:00100000:1.0:1784044052.559284:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044052.559304:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39503bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1870705580909440:0@lo:400:kworker.0 00000100:00100000:1.0:1784044052.559323:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044052.559339:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39759b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3641:1870705580909952:0@lo:400:kworker.0 00000100:00100000:1.0:1784044052.559358:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044052.559527:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1784044052.559654:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b38435eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1870705580910464:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784044052.560136:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044052.560410:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580909312 00000100:00100000:1.0:1784044052.560416:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580909312 00000100:00100000:1.0:1784044052.560448:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580909824 00000100:00100000:1.0:1784044052.560451:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580909824 00000100:00100000:1.0:1784044052.560475:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580910208 00000100:00100000:1.0:1784044052.560478:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580910208 00000100:00100000:1.0:1784044052.560488:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580909056 00000100:00100000:1.0:1784044052.560490:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580909056 00000100:00100000:1.0:1784044052.560499:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580910080 00000100:00100000:1.0:1784044052.560501:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580910080 00000100:00100000:1.0:1784044052.560513:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580909952 00000100:00100000:1.0:1784044052.560515:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580909952 00000100:00100000:1.0:1784044052.560531:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1784044052.560538:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38436a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1870705580909312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044052.560588:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38436a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1870705580909312:12345-0@lo:400:kworker.0 Request processed in 50us (1748us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044052.560594:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1784044052.560621:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1784044052.560627:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38436a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1870705580909824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044052.560655:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38436a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1870705580909824:12345-0@lo:400:kworker.0 Request processed in 28us (1763us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044052.560661:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1784044052.560672:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1784044052.560677:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38436a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1870705580910208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044052.560701:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38436a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1870705580910208:12345-0@lo:400:kworker.0 Request processed in 24us (1593us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044052.560707:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1784044052.560717:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1784044052.560722:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b384316f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1870705580909056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044052.560748:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b384316f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1870705580909056:12345-0@lo:400:kworker.0 Request processed in 26us (1597us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044052.560754:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1784044052.560763:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1784044052.560785:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b384316e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1870705580910080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044052.560811:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b384316e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1870705580910080:12345-0@lo:400:kworker.0 Request processed in 27us (1564us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044052.560817:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1784044052.560828:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1784044052.560834:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1870705580909952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044052.560858:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1870705580909952:12345-0@lo:400:kworker.0 Request processed in 24us (1499us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044052.560864:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1784044052.560896:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580910336 00000100:00100000:1.0:1784044052.560899:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580910336 00000100:00100000:1.0:1784044052.560923:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580909696 00000100:00100000:1.0:1784044052.560926:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580909696 00000100:00100000:1.0:1784044052.560937:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580909568 00000100:00100000:1.0:1784044052.560939:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580909568 00000100:00100000:1.0:1784044052.560950:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1784044052.560955:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38436a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1870705580910336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044052.560982:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38436a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1870705580910336:12345-0@lo:400:kworker.0 Request processed in 27us (2041us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044052.560987:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1784044052.560995:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1784044052.561000:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38436a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1870705580909696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044052.561019:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38436a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1870705580909696:12345-0@lo:400:kworker.0 Request processed in 20us (1945us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044052.561024:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1784044052.561032:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1784044052.561036:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b384316c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1870705580909568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044052.561053:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b384316c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1870705580909568:12345-0@lo:400:kworker.0 Request processed in 18us (1846us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044052.561058:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1784044052.561074:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580909184 00000100:00100000:1.0:1784044052.561076:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580909184 00000100:00100000:1.0:1784044052.561095:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580909440 00000100:00100000:1.0:1784044052.561097:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580909440 00000100:00100000:1.0:1784044052.561107:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1784044052.561112:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38436a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1870705580909184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044052.561137:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38436a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1870705580909184:12345-0@lo:400:kworker.0 Request processed in 25us (2099us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044052.561148:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1784044052.561158:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1784044052.561162:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1870705580909440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044052.561204:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1870705580909440:12345-0@lo:400:kworker.0 Request processed in 42us (1880us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044052.561210:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1784044052.561251:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580908928 00000100:00100000:1.0:1784044052.561254:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580908928 00000100:00100000:1.0:1784044052.561280:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:1.0:1784044052.561286:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3950375850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+24:3641:x1870705580908928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044052.561315:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3950375850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+24:3641:x1870705580908928:12345-0@lo:400:kworker.0 Request processed in 28us (2029us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044052.561320:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00080000:1.0:1784044052.561348:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784044052.561352:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1784044052.561353:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784044052.561383:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843c57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1870705580909184:0@lo:400:kworker.0 00010000:00080000:1.0:1784044052.561395:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b39759b4000 x1870705580909696/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784044068 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784044052.561404:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39759b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1870705580909696:0@lo:400:kworker.0 00000100:00100000:0.0:1784044052.561410:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580910464 00000100:00100000:0.0:1784044052.561413:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580910464 00010000:00080000:1.0:1784044052.561414:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b39759b6d80 x1870705580910208/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044068 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784044052.561422:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39759b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3639:1870705580910208:0@lo:400:kworker.0 00000100:00100000:1.0:1784044052.561432:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39503be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3639:1870705580909312:0@lo:400:kworker.0 00000100:00100000:0.0:1784044052.561436:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1784044052.561442:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d47100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1870705580910464:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784044052.561448:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39759b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3639:1870705580909824:0@lo:400:kworker.0 00002000:00000024:0.0:1784044052.561455:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00010000:00080000:1.0:1784044052.561456:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b39759b5c00 x1870705580910336/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784044068 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784044052.561463:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39759b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1870705580910336:0@lo:400:kworker.0 00000100:00100000:0.0:1784044052.561487:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d47100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1870705580910464:12345-0@lo:13:osp-pre-1-0.0 Request processed in 45us (1447us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044052.561493:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:1.0:1784044052.561496:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b38435eea00 x1870705580910464/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784044068 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784044052.561508:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b38435eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1870705580910464:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784044052.561516:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843c56680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:3641:1870705580908928:0@lo:400:kworker.0 00000100:00100000:1.0:1784044052.561524:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39503bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1870705580909440:0@lo:400:kworker.0 00010000:00080000:1.0:1784044052.561538:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b39759b6680 x1870705580909952/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044068 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784044052.561546:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39759b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3641:1870705580909952:0@lo:400:kworker.0 00000100:00100000:1.0:1784044052.561555:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843c54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3641:1870705580909056:0@lo:400:kworker.0 00010000:00080000:1.0:1784044052.561564:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b39759b4700 x1870705580909568/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784044068 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784044052.561571:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39759b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1870705580909568:0@lo:400:kworker.0 00000100:00100000:1.0:1784044052.561580:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39759b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3641:1870705580910080:0@lo:400:kworker.0 00010000:00010000:0.0:1784044053.133722:0:10330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784044054.157564:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784044055.182527:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784044055.274766:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1784044055.274825:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1784044055.274874:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044055.275498:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565115392 00000100:00100000:3.0:1784044055.275510:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565115392 00000100:00100000:3.0:1784044055.275574:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 284 00000100:00100000:3.0:1784044055.275585:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3950374450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4a09ad9-a185-4679-99bb-b6a07b865440+10:2408:x1870705565115392:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:0.0:1784044055.275651:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565115520 00000100:00100000:3.0:1784044055.275656:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3950374450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4a09ad9-a185-4679-99bb-b6a07b865440+10:2408:x1870705565115392:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 71us (828us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044055.275658:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565115520 00000100:00100000:3.0:1784044055.275667:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 284 00000100:00100000:0.0:1784044055.275706:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565115648 00000100:00100000:0.0:1784044055.275711:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565115648 00000100:00100000:0.0:1784044055.275753:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 88 00000100:00100000:0.0:1784044055.275762:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+6:2408:x1870705565115520:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:0.0:1784044055.275803:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+6:2408:x1870705565115520:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 42us (1046us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044055.275811:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 88 00000100:00100000:0.0:1784044055.275828:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 89 00000100:00100000:0.0:1784044055.275834:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+5:2408:x1870705565115648:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:0.0:1784044055.275861:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+5:2408:x1870705565115648:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 26us (986us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044055.275869:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 89 00000100:00080000:0.0:1784044055.275917:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1784044055.275922:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784044055.629477:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784044055.629501:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3975b8bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1870705580910592:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1784044055.629580:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044055.629623:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580910592 00000100:00100000:1.0:1784044055.629632:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580910592 00000100:00100000:1.0:1784044055.629685:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1784044055.629696:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3975b89f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1870705580910592:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1784044055.629730:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1784044055.629800:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3975b89f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1870705580910592:12345-0@lo:41:osp-pre-0-1.0 Request processed in 106us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044055.629807:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1784044055.629997:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3975b8bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1870705580910592:0@lo:41:osp-pre-0-1.0 00000001:00100000:3.0:1784044055.632631:0:8421:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of a93fdf3c-d42f-420a-95ea-b0cbfe954363 00000020:00000080:3.0:1784044055.632641:0:8421:0:(genops.c:906:class_export_put()) final put ffff9b384345f800/a93fdf3c-d42f-420a-95ea-b0cbfe954363 00000020:00000080:0.0:1784044055.632951:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9b384345f800/a93fdf3c-d42f-420a-95ea-b0cbfe954363 for lustre-OST0000 00000001:00100000:1.0:1784044055.633127:0:9505:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of a93fdf3c-d42f-420a-95ea-b0cbfe954363 00000020:00000080:1.0:1784044055.633132:0:9505:0:(genops.c:906:class_export_put()) final put ffff9b384345d000/a93fdf3c-d42f-420a-95ea-b0cbfe954363 00000020:00000080:0.0:1784044055.633246:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9b384345f000 for lustre-OST0000 00000020:00000080:0.0:1784044055.643328:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9b384345d000/a93fdf3c-d42f-420a-95ea-b0cbfe954363 for lustre-OST0001 00000020:00000080:0.0:1784044055.643383:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9b3843458800 for lustre-OST0001 00010000:00010000:1.0:1784044056.208610:0:10331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1784044056.610210:0:11116:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.54.162 00000100:00100000:1.0:1784044056.653340:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1870705580910720:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1784044056.653442:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044056.653544:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580910720 00000100:00100000:1.0:1784044056.653552:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580910720 00000100:00100000:1.0:1784044056.653596:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1784044056.653605:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1870705580910720:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1784044056.653640:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1784044056.653699:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1870705580910720:12345-0@lo:41:osp-pre-1-0.0 Request processed in 94us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044056.653707:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1784044056.653766:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1870705580910720:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1784044056.656009:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b38435ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1870705580910848:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784044056.656130:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044056.656224:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1784044056.656232:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b38435eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1870705580910976:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1784044056.656267:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044056.656811:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580910848 00000100:00100000:0.0:1784044056.656820:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580910848 00000100:00100000:0.0:1784044056.656896:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580910976 00000100:00100000:0.0:1784044056.656900:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580910976 00000100:00100000:0.0:1784044056.656919:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1784044056.656927:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1870705580910848:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1784044056.656955:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784044056.657006:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1870705580910848:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (876us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044056.657013:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1784044056.657027:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1784044056.657033:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1870705580910976:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1784044056.657042:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784044056.657068:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1870705580910976:12345-0@lo:13:osp-pre-0-1.0 Request processed in 35us (800us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044056.657074:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:0.0:1784044056.657102:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b38435ece00 x1870705580910848/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784044072 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784044056.657118:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b38435ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1870705580910848:0@lo:13:osp-pre-0-0.0 00010000:00080000:0.0:1784044056.657142:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b38435eea00 x1870705580910976/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784044072 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784044056.657168:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b38435eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1870705580910976:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1784044056.657454:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1784044057.244900:0:10330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784044057.677727:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1870705580911104:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784044057.677802:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044057.677851:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d47b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3641:1870705580911616:0@lo:400:kworker.0 00000100:00100000:1.0:1784044057.677874:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044057.677890:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39759b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3641:1870705580912128:0@lo:400:kworker.0 00000100:00100000:1.0:1784044057.677908:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044057.677925:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39759b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1870705580912640:0@lo:400:kworker.0 00000100:00100000:1.0:1784044057.677947:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044057.677970:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1784044057.677976:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d46d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1870705580911488:0@lo:400:kworker.0 00000100:00100000:1.0:1784044057.678043:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044057.678059:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39759b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1870705580912000:0@lo:400:kworker.0 00000100:00100000:1.0:1784044057.678077:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044057.678091:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39759b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3641:1870705580912512:0@lo:400:kworker.0 00000100:00100000:1.0:1784044057.678109:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044057.678133:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:3638:1870705580911232:0@lo:400:kworker.0 00000100:00100000:1.0:1784044057.678159:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044057.678218:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39503bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1870705580911744:0@lo:400:kworker.0 00000100:00100000:1.0:1784044057.678241:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044057.678258:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39759b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1870705580912256:0@lo:400:kworker.0 00000100:00100000:1.0:1784044057.678277:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044057.678290:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39759b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1870705580912768:0@lo:400:kworker.0 00000100:00100000:1.0:1784044057.678801:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044057.678825:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1784044057.678832:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1870705580911360:0@lo:400:kworker.0 00000100:00100000:1.0:1784044057.678852:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044057.678863:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39503be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1870705580911872:0@lo:400:kworker.0 00000100:00100000:1.0:1784044057.678881:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044057.678896:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39759b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3638:1870705580912384:0@lo:400:kworker.0 00000100:00100000:1.0:1784044057.678914:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044057.678942:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580911104 00000100:00100000:1.0:1784044057.678950:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580911104 00000100:00100000:1.0:1784044057.679003:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1784044057.679012:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843c54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1870705580911104:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1784044057.679044:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784044057.679088:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843c54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1870705580911104:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (1287us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044057.679095:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1784044057.679120:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580911616 00000100:00100000:1.0:1784044057.679124:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580911616 00000100:00100000:1.0:1784044057.679142:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580912128 00000100:00100000:1.0:1784044057.679145:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580912128 00000100:00100000:1.0:1784044057.679158:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580912512 00000100:00100000:1.0:1784044057.679160:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580912512 00000100:00100000:1.0:1784044057.679171:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580912256 00000100:00100000:3.0:1784044057.679391:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580911232 00000100:00100000:3.0:1784044057.679394:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580911232 00000100:00100000:3.0:1784044057.679419:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:3.0:1784044057.679425:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3950376850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+24:3638:x1870705580911232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044057.679469:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3950376850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+24:3638:x1870705580911232:12345-0@lo:400:kworker.0 Request processed in 44us (1310us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044057.679483:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:3.0:1784044057.679788:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580911360 00000100:00100000:3.0:1784044057.679792:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580911360 00000100:00100000:3.0:1784044057.679808:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580912384 00000100:00100000:3.0:1784044057.679810:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580912384 00000100:00100000:3.0:1784044057.679827:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1784044057.679833:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843c56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1870705580911616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044057.679867:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843c56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1870705580911616:12345-0@lo:400:kworker.0 Request processed in 34us (1992us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044057.679873:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1784044057.679888:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1784044057.679894:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843c57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1870705580912128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044057.679933:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843c57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1870705580912128:12345-0@lo:400:kworker.0 Request processed in 27us (2011us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044057.679940:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1784044057.679953:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1784044057.679959:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397aa57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1870705580912512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044057.679986:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397aa57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1870705580912512:12345-0@lo:400:kworker.0 Request processed in 28us (1876us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044057.679992:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1784044057.680003:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1784044057.680008:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3842706d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1870705580911360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044057.680034:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3842706d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1870705580911360:12345-0@lo:400:kworker.0 Request processed in 26us (1181us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044057.680039:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1784044057.680058:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1784044057.680064:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3842704000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1870705580912384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044057.680090:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3842704000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1870705580912384:12345-0@lo:400:kworker.0 Request processed in 26us (1175us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044057.680096:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1784044057.680117:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397bbbed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1870705580912896:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1784044057.680144:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044057.680206:0:10713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580912896 00000100:00100000:3.0:1784044057.680623:0:10713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580912896 00000100:00100000:3.0:1784044057.680729:0:10713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1784044057.680737:0:10713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397bbbca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1870705580912896:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1784044057.680750:0:10713:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784044057.680785:0:10713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397bbbca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1870705580912896:12345-0@lo:13:osp-pre-1-1.0 Request processed in 49us (640us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044057.680791:0:10713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:3.0:1784044057.680824:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b397bbbed80 x1870705580912896/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784044073 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784044057.680842:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397bbbed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1870705580912896:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1784044057.681008:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1870705580911360:0@lo:400:kworker.0 00000100:00100000:3.0:1784044057.681020:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39759b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3638:1870705580912384:0@lo:400:kworker.0 00000100:00100000:3.0:1784044057.681030:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:3638:1870705580911232:0@lo:400:kworker.0 00000100:00100000:1.0:1784044057.681711:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580912256 00000100:00100000:1.0:1784044057.681760:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1784044057.681767:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3842704e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1870705580912256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044057.681814:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3842704e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1870705580912256:12345-0@lo:400:kworker.0 Request processed in 47us (3536us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044057.681830:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1784044057.681859:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580912640 00000100:00100000:1.0:1784044057.681863:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580912640 00000100:00100000:1.0:1784044057.681879:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580912000 00000100:00100000:1.0:1784044057.681882:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580912000 00000100:00100000:1.0:1784044057.681893:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580912768 00000100:00100000:1.0:1784044057.681895:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580912768 00000100:00100000:1.0:1784044057.681906:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580911872 00000100:00100000:1.0:1784044057.681908:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580911872 00000100:00100000:1.0:1784044057.681920:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1784044057.681925:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397aa55f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1870705580912640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044057.681957:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397aa55f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1870705580912640:12345-0@lo:400:kworker.0 Request processed in 32us (4010us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044057.681963:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1784044057.681974:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1784044057.681979:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397aa54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1870705580912000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044057.682005:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397aa54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1870705580912000:12345-0@lo:400:kworker.0 Request processed in 26us (3927us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044057.682011:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1784044057.682021:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1784044057.682027:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3842705f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1870705580912768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044057.682052:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3842705f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1870705580912768:12345-0@lo:400:kworker.0 Request processed in 26us (3252us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044057.682058:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1784044057.682068:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1784044057.682073:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3842706a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1870705580911872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044057.682108:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3842706a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1870705580911872:12345-0@lo:400:kworker.0 Request processed in 35us (3226us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044057.682114:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1784044057.682133:0:7768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580911488 00000100:00100000:1.0:1784044057.682137:0:7768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580911488 00000100:00100000:1.0:1784044057.682161:0:7768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580911744 00000100:00100000:1.0:1784044057.682199:0:7768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580911744 00010000:00080000:3.0:1784044057.682395:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b39503be300 x1870705580911872/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784044073 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784044057.682407:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39503be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1870705580911872:0@lo:400:kworker.0 00010000:00080000:3.0:1784044057.682428:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b39759b6680 x1870705580912256/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044073 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784044057.682437:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39759b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1870705580912256:0@lo:400:kworker.0 00010000:00080000:3.0:1784044057.682447:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b39759b4000 x1870705580912768/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784044073 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784044057.682454:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39759b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1870705580912768:0@lo:400:kworker.0 00000100:00100000:1.0:1784044057.683815:0:7768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1784044057.683827:0:7768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397aa55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1870705580911488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044057.683886:0:7768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397aa55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1870705580911488:12345-0@lo:400:kworker.0 Request processed in 62us (5843us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044057.683892:0:7768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1784044057.683905:0:7768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1784044057.683912:0:7768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3842704380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1870705580911744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044057.683944:0:7768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3842704380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1870705580911744:12345-0@lo:400:kworker.0 Request processed in 34us (5704us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044057.683950:0:7768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00080000:1.0:1784044057.683989:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1784044057.683993:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1784044057.683996:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784044057.684030:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d46d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1870705580911488:0@lo:400:kworker.0 00010000:00080000:1.0:1784044057.684047:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b39759b6a00 x1870705580912000/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784044073 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784044057.684056:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39759b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1870705580912000:0@lo:400:kworker.0 00010000:00080000:1.0:1784044057.684067:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b39759b5500 x1870705580912512/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044073 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784044057.684086:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39759b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3641:1870705580912512:0@lo:400:kworker.0 00010000:00080000:1.0:1784044057.684098:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b3843d44a80 x1870705580911104/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784044073 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784044057.684111:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1870705580911104:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784044057.684122:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d47b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3641:1870705580911616:0@lo:400:kworker.0 00000100:00100000:1.0:1784044057.684132:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39759b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3641:1870705580912128:0@lo:400:kworker.0 00010000:00080000:1.0:1784044057.684142:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b39759b6d80 x1870705580912640/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784044073 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784044057.684149:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39759b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1870705580912640:0@lo:400:kworker.0 00000100:00100000:3.0:1784044057.685531:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39503bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1870705580911744:0@lo:400:kworker.0 00010000:00010000:1.0:1784044058.257755:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784044059.282625:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1784044060.140625:0:11213:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.54.162 00010000:00010000:2.0:1784044060.311928:0:10331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784044060.413935:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044060.413968:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044060.413991:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1784044060.416972:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565115776 00000100:00100000:1.0:1784044060.416986:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565115776 00000100:00100000:1.0:1784044060.417053:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 286 00000100:00100000:1.0:1784044060.417063:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3950374850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4a09ad9-a185-4679-99bb-b6a07b865440+10:2408:x1870705565115776:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:1.0:1784044060.417141:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3950374850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4a09ad9-a185-4679-99bb-b6a07b865440+10:2408:x1870705565115776:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 79us (3213us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044060.417149:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 286 00000100:00100000:1.0:1784044060.417206:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565116032 00000100:00100000:1.0:1784044060.417210:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565116032 00000100:00100000:1.0:1784044060.417246:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565115904 00000100:00100000:1.0:1784044060.417250:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565115904 00000100:00100000:1.0:1784044060.417724:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 96 00000100:00100000:1.0:1784044060.417733:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38435eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+5:2408:x1870705565116032:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:1.0:1784044060.417795:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38435eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+5:2408:x1870705565116032:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 63us (3825us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044060.417802:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 96 00000100:00100000:1.0:1784044060.417818:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 97 00000100:00100000:1.0:1784044060.417824:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38435ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+6:2408:x1870705565115904:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:1.0:1784044060.417847:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38435ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+6:2408:x1870705565115904:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 24us (3856us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044060.417852:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 97 00000100:00080000:1.0:1784044060.421527:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1784044060.421537:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1784044060.751570:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1784044060.751596:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3975b88700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1870705580913024:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1784044060.751670:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044060.751840:0:7768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580913024 00000100:00100000:2.0:1784044060.751848:0:7768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580913024 00000100:00100000:2.0:1784044060.753192:0:7768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1784044060.753207:0:7768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3842707100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1870705580913024:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1784044060.753242:0:7768:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1784044060.753322:0:7768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3842707100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1870705580913024:12345-0@lo:41:osp-pre-0-1.0 Request processed in 119us (1652us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044060.753330:0:7768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1784044060.753419:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3975b88700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1870705580913024:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1784044061.327802:0:10330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784044061.773357:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1784044061.773392:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3842705c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1870705580913152:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1784044061.773493:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044061.773565:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b38435ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1870705580913280:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1784044061.773585:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580913152 00000100:00100000:1.0:1784044061.773595:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580913152 00000100:00100000:0.0:1784044061.773607:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044061.773649:0:10713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580913280 00000100:00100000:1.0:1784044061.773652:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1784044061.773652:0:10713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580913280 00000100:00100000:1.0:1784044061.773661:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38435ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1870705580913152:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1784044061.773705:0:10713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1784044061.773712:0:10713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38435edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1870705580913280:12345-0@lo:13:osp-pre-0-1.0 00000004:00000024:1.0:1784044061.773714:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00002000:00000024:0.0:1784044061.773735:0:10713:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784044061.773766:0:10713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38435edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1870705580913280:12345-0@lo:13:osp-pre-0-1.0 Request processed in 54us (157us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044061.773774:0:10713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1784044061.774458:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38435ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1870705580913152:12345-0@lo:41:osp-pre-1-0.0 Request processed in 795us (962us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044061.774468:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00080000:1.0:1784044061.774499:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784044061.775157:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1784044061.775190:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397bbbed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1870705580913408:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784044061.775262:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044061.775436:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580913408 00000100:00100000:1.0:1784044061.775445:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580913408 00000100:00100000:1.0:1784044061.775514:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1784044061.775524:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397bbbd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1870705580913408:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1784044061.775535:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:1.0:1784044061.775568:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784044061.775621:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397bbbd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1870705580913408:12345-0@lo:13:osp-pre-0-0.0 Request processed in 100us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044061.775629:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:3.0:1784044061.775713:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b397bbbed80 x1870705580913408/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784044077 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784044061.775736:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397bbbed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1870705580913408:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784044061.775793:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3842705c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1870705580913152:0@lo:41:osp-pre-1-0.0 00010000:00080000:0.0:1784044061.775808:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b38435ef800 x1870705580913280/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784044077 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784044061.775821:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b38435ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1870705580913280:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1784044062.351370:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784044062.799169:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3842705c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1870705580913536:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1784044062.799291:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044062.799398:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580913536 00000100:00100000:1.0:1784044062.799408:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580913536 00000100:00100000:1.0:1784044062.799485:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1784044062.799496:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397a8a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1870705580913536:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1784044062.799541:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784044062.799591:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397a8a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1870705580913536:12345-0@lo:13:osp-pre-1-1.0 Request processed in 97us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044062.799599:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:1.0:1784044062.799626:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1784044062.799665:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b3842705c00 x1870705580913536/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784044078 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784044062.799696:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3842705c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1870705580913536:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1784044062.800860:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3975b88a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3641:1870705580913792:0@lo:400:kworker.0 00000100:00100000:3.0:1784044062.800934:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044062.800972:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3975b8ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1870705580914304:0@lo:400:kworker.0 00000100:00100000:3.0:1784044062.801000:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044062.801015:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3975b88380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3641:1870705580914816:0@lo:400:kworker.0 00000100:00100000:3.0:1784044062.801036:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044062.801069:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1784044062.801075:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3975b89180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:3641:1870705580913664:0@lo:400:kworker.0 00000100:00100000:3.0:1784044062.801104:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044062.801133:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3975b89880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1870705580914176:0@lo:400:kworker.0 00000100:00100000:3.0:1784044062.801157:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044062.801196:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3975b8b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3641:1870705580914688:0@lo:400:kworker.0 00000100:00100000:3.0:1784044062.801221:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044062.801252:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580913664 00000100:00100000:3.0:1784044062.801259:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580913664 00000100:00100000:3.0:1784044062.801304:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:3.0:1784044062.801313:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3950377850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+24:3641:x1870705580913664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044062.801379:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3950377850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+24:3641:x1870705580913664:12345-0@lo:400:kworker.0 Request processed in 66us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044062.801387:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:3.0:1784044062.801435:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3975b89180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:3641:1870705580913664:0@lo:400:kworker.0 00000100:00100000:2.0:1784044062.801781:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580913792 00000100:00100000:2.0:1784044062.801786:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580913792 00000100:00100000:2.0:1784044062.801831:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580914816 00000100:00100000:2.0:1784044062.801834:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580914816 00000100:00100000:2.0:1784044062.801869:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580914688 00000100:00100000:2.0:1784044062.801872:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580914688 00000100:00100000:2.0:1784044062.801888:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1784044062.801895:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397bbbed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1870705580913792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784044062.801959:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397bbbed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1870705580913792:12345-0@lo:400:kworker.0 Request processed in 64us (1024us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044062.801966:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1784044062.801981:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1784044062.801986:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39503bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1870705580914816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784044062.802013:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39503bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1870705580914816:12345-0@lo:400:kworker.0 Request processed in 27us (976us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044062.802033:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1784044062.802046:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1784044062.802052:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39759b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1870705580914688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784044062.802083:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39759b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1870705580914688:12345-0@lo:400:kworker.0 Request processed in 31us (860us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044062.802088:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1784044062.802109:0:7768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580914176 00000100:00100000:2.0:1784044062.802112:0:7768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580914176 00000100:00100000:2.0:1784044062.802135:0:7768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1784044062.802140:0:7768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39503be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1870705580914176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784044062.802205:0:7768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39503be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1870705580914176:12345-0@lo:400:kworker.0 Request processed in 64us (1046us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044062.802211:0:7768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1784044062.802245:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3975b89880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1870705580914176:0@lo:400:kworker.0 00010000:00080000:2.0:1784044062.802260:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b3975b8b480 x1870705580914688/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044078 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784044062.802270:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3975b8b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3641:1870705580914688:0@lo:400:kworker.0 00000100:00100000:2.0:1784044062.802282:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3975b88a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3641:1870705580913792:0@lo:400:kworker.0 00000100:00100000:2.0:1784044062.802292:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3975b88380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3641:1870705580914816:0@lo:400:kworker.0 00000100:00100000:1.0:1784044062.804024:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b38435ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1870705580915200:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784044062.804109:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044062.804239:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580914304 00000100:00100000:1.0:1784044062.804248:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580914304 00000100:00100000:1.0:1784044062.804308:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1784044062.804318:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397bbbfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1870705580914304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784044062.804620:0:10713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580915200 00000100:00100000:0.0:1784044062.804626:0:10713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580915200 00000100:00100000:0.0:1784044062.804668:0:10713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1784044062.804697:0:10713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397a8a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1870705580915200:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1784044062.804727:0:10713:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784044062.804788:0:10713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397a8a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1870705580915200:12345-0@lo:13:osp-pre-1-0.0 Request processed in 92us (679us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044062.804796:0:10713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1784044062.804903:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397bbbfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1870705580914304:12345-0@lo:400:kworker.0 Request processed in 587us (3902us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044062.805020:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1784044062.805076:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3975b88000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1870705580913920:0@lo:400:kworker.0 00000100:00100000:1.0:1784044062.805112:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044062.805224:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3975b88700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1870705580914432:0@lo:400:kworker.0 00000100:00100000:1.0:1784044062.805253:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044062.805273:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3975b88e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3638:1870705580914944:0@lo:400:kworker.0 00000100:00100000:1.0:1784044062.805296:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044062.805322:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1784044062.805329:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3975b8b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1870705580914048:0@lo:400:kworker.0 00010000:00080000:2.0:1784044062.805876:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b3975b8ad80 x1870705580914304/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784044078 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784044062.805894:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3975b8ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1870705580914304:0@lo:400:kworker.0 00000100:00100000:1.0:1784044062.806010:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044062.806099:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3975b8bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1870705580914560:0@lo:400:kworker.0 00000100:00100000:1.0:1784044062.806139:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044062.810653:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843c88000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1870705580915072:0@lo:400:kworker.0 00000100:00100000:1.0:1784044062.810793:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044062.810871:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580914432 00000100:00100000:1.0:1784044062.810881:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580914432 00000100:00100000:1.0:1784044062.811059:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580915072 00000100:00100000:1.0:1784044062.811064:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580915072 00000100:00100000:1.0:1784044062.811090:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1784044062.811099:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397a8a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1870705580914432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044062.811166:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397a8a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1870705580914432:12345-0@lo:400:kworker.0 Request processed in 67us (5913us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044062.811194:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1784044062.811233:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1784044062.811239:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843cafb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1870705580915072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044062.811270:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843cafb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1870705580915072:12345-0@lo:400:kworker.0 Request processed in 31us (478us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044062.811275:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1784044062.811476:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580914944 00000100:00100000:2.0:1784044062.811487:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580914944 00000100:00100000:2.0:1784044062.811522:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580914048 00000100:00100000:2.0:1784044062.811525:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580914048 00000100:00100000:2.0:1784044062.811536:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580914560 00000100:00100000:2.0:1784044062.811539:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580914560 00000100:00100000:2.0:1784044062.811551:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1784044062.811557:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397a8a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1870705580914944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784044062.811595:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397a8a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1870705580914944:12345-0@lo:400:kworker.0 Request processed in 39us (6298us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044062.811602:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1784044062.811617:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1784044062.811622:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397a8a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1870705580914048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784044062.811652:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397a8a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1870705580914048:12345-0@lo:400:kworker.0 Request processed in 30us (5642us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044062.811658:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1784044062.811671:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1784044062.811686:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3842705c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1870705580914560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784044062.811714:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3842705c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1870705580914560:12345-0@lo:400:kworker.0 Request processed in 29us (5575us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044062.811719:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1784044062.811871:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580913920 00000100:00100000:0.0:1784044062.811877:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580913920 00000100:00100000:0.0:1784044062.811918:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1784044062.811923:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397a8a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1870705580913920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784044062.811971:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397a8a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1870705580913920:12345-0@lo:400:kworker.0 Request processed in 47us (6859us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044062.811978:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00080000:2.0:1784044062.812485:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1784044062.812493:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1784044062.812496:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1784044062.812545:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b38435ef800 x1870705580915200/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784044078 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784044062.812575:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b38435ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1870705580915200:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784044062.815497:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3975b8b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1870705580914048:0@lo:400:kworker.0 00000100:00100000:1.0:1784044062.815519:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3975b8bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1870705580914560:0@lo:400:kworker.0 00010000:00080000:1.0:1784044062.815536:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b3843c88000 x1870705580915072/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784044078 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784044062.815549:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843c88000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1870705580915072:0@lo:400:kworker.0 00000100:00100000:1.0:1784044062.815564:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3975b88000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1870705580913920:0@lo:400:kworker.0 00010000:00080000:1.0:1784044062.815577:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b3975b88700 x1870705580914432/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784044078 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784044062.815587:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3975b88700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1870705580914432:0@lo:400:kworker.0 00010000:00080000:1.0:1784044062.815600:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b3975b88e00 x1870705580914944/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044078 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784044062.815610:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3975b88e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3638:1870705580914944:0@lo:400:kworker.0 00000001:02000400:0.0:1784044063.312604:0:11311:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.54.162 00010000:00010000:2.0:1784044063.376872:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784044064.397413:0:10331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1784044065.178451:0:11359:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Tue Jul 14 11:47:43 EDT 2026 00010000:00010000:1.0:1784044065.421795:0:10330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784044065.515533:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1784044065.515578:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1784044065.515607:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044065.515689:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565116288 00000100:00100000:2.0:1784044065.515699:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565116288 00000100:00100000:2.0:1784044065.515766:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565116416 00000100:00100000:2.0:1784044065.515769:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565116416 00000100:00100000:2.0:1784044065.515792:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 104 00000100:00100000:2.0:1784044065.515802:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843cadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+6:2408:x1870705565116288:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:2.0:1784044065.515873:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843cadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+6:2408:x1870705565116288:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 73us (349us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044065.515890:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 104 00000100:00100000:2.0:1784044065.515908:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 105 00000100:00100000:2.0:1784044065.515915:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843cac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+5:2408:x1870705565116416:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:2.0:1784044065.515942:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843cac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+5:2408:x1870705565116416:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 28us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044065.515948:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 105 00000100:00100000:3.0:1784044065.516065:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565116160 00000100:00100000:3.0:1784044065.516070:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565116160 00000100:00100000:3.0:1784044065.516105:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 288 00000100:00100000:3.0:1784044065.516112:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3950375050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4a09ad9-a185-4679-99bb-b6a07b865440+10:2408:x1870705565116160:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:3.0:1784044065.516138:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3950375050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4a09ad9-a185-4679-99bb-b6a07b865440+10:2408:x1870705565116160:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 27us (560us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044065.516144:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 288 00000100:00080000:1.0:1784044065.516296:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1784044065.516314:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784044065.869934:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784044065.874592:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843c8b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1870705580915328:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1784044065.874705:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044065.876578:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580915328 00000100:00100000:2.0:1784044065.876590:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580915328 00000100:00100000:2.0:1784044065.876707:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1784044065.876718:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843cad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1870705580915328:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1784044065.876771:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1784044065.876860:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843cad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1870705580915328:12345-0@lo:41:osp-pre-0-1.0 Request processed in 143us (2154us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044065.876868:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1784044065.876963:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843c8b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1870705580915328:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1784044066.452003:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784044066.893391:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1784044066.893435:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39759b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1870705580915456:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784044066.893553:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044066.893862:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580915456 00000100:00100000:1.0:1784044066.893872:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580915456 00000100:00100000:1.0:1784044066.893948:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1784044066.893957:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39759b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1870705580915456:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1784044066.893990:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784044066.894037:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39759b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1870705580915456:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (485us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044066.894042:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:1.0:1784044066.894073:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784044066.894115:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784044066.894123:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843caca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1870705580915584:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1784044066.894153:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044066.902507:0:7768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580915584 00000100:00100000:1.0:1784044066.902528:0:7768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580915584 00000100:00100000:1.0:1784044066.902604:0:7768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1784044066.902616:0:7768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843cac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1870705580915584:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1784044066.902682:0:7768:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1784044066.902771:0:7768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843cac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1870705580915584:12345-0@lo:41:osp-pre-1-0.0 Request processed in 157us (8615us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044066.902780:0:7768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1784044066.902817:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b38435ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1870705580915712:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1784044066.902867:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044066.902920:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580915712 00000100:00100000:1.0:1784044066.902925:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580915712 00000100:00100000:1.0:1784044066.902964:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1784044066.902970:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843caf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1870705580915712:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1784044066.902988:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784044066.903025:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843caf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1870705580915712:12345-0@lo:13:osp-pre-0-1.0 Request processed in 55us (157us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044066.903032:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:1.0:1784044066.903071:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b38435ee680 x1870705580915712/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784044082 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784044066.903095:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b38435ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1870705580915712:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1784044066.903119:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784044066.903145:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843caca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1870705580915584:0@lo:41:osp-pre-1-0.0 00010000:00080000:2.0:1784044066.904930:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b39759b4700 x1870705580915456/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784044082 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784044066.904961:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39759b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1870705580915456:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1784044067.476775:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784044067.917475:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784044067.917513:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843caca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1870705580915840:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1784044067.917644:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044067.917734:0:10713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580915840 00000100:00100000:1.0:1784044067.917746:0:10713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580915840 00000100:00100000:1.0:1784044067.917826:0:10713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1784044067.917837:0:10713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843cad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1870705580915840:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1784044067.917882:0:10713:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784044067.917935:0:10713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843cad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1870705580915840:12345-0@lo:13:osp-pre-1-1.0 Request processed in 100us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044067.917944:0:10713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:1.0:1784044067.917973:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1784044067.918023:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b3843caca80 x1870705580915840/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784044083 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784044067.918065:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843caca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1870705580915840:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1784044067.920328:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1784044067.920356:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39759b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1870705580915968:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784044067.920450:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044067.920760:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39759b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:3639:1870705580916096:0@lo:400:kworker.0 00000100:00100000:3.0:1784044067.920811:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044067.920835:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3975b88700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1870705580916608:0@lo:400:kworker.0 00000100:00100000:3.0:1784044067.920864:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044067.920886:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3975b8ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3639:1870705580917120:0@lo:400:kworker.0 00000100:00100000:3.0:1784044067.920913:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044067.920937:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1784044067.920942:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3975b88e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3639:1870705580916480:0@lo:400:kworker.0 00000100:00100000:3.0:1784044067.920965:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044067.920984:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3975b8b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3639:1870705580916992:0@lo:400:kworker.0 00000100:00100000:3.0:1784044067.921004:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044067.921037:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580916608 00000100:00100000:3.0:1784044067.921045:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580916608 00000100:00100000:3.0:1784044067.921101:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1784044067.921111:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3975b8b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1870705580916608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044067.922344:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3975b8b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1870705580916608:12345-0@lo:400:kworker.0 Request processed in 1226us (1469us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044067.922359:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1784044067.922551:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580915968 00000100:00100000:1.0:1784044067.922562:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580915968 00000100:00100000:1.0:1784044067.922654:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1784044067.922664:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39759b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1870705580915968:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1784044067.922692:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784044067.922750:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39759b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1870705580915968:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (2300us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044067.922757:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1784044067.922822:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580916096 00000100:00100000:1.0:1784044067.922828:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580916096 00000100:00100000:1.0:1784044067.922867:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:1.0:1784044067.922874:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3950377050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+24:3639:x1870705580916096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044067.922908:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3950377050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+24:3639:x1870705580916096:12345-0@lo:400:kworker.0 Request processed in 35us (2096us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044067.922914:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:1.0:1784044067.922959:0:9501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580917120 00000100:00100000:1.0:1784044067.922964:0:9501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580917120 00000100:00100000:1.0:1784044067.923003:0:9501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580916480 00000100:00100000:1.0:1784044067.923007:0:9501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580916480 00000100:00100000:1.0:1784044067.923023:0:9501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580916992 00000100:00100000:1.0:1784044067.923026:0:9501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580916992 00000100:00100000:1.0:1784044067.923044:0:9501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1784044067.923051:0:9501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3975b89880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1870705580917120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044067.923088:0:9501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3975b89880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1870705580917120:12345-0@lo:400:kworker.0 Request processed in 38us (2174us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044067.923110:0:9501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1784044067.923123:0:9501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1784044067.923128:0:9501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3975b89180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1870705580916480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044067.923199:0:9501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3975b89180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1870705580916480:12345-0@lo:400:kworker.0 Request processed in 47us (2209us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044067.923205:0:9501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1784044067.923216:0:9501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1784044067.923222:0:9501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1870705580916992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044067.923256:0:9501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1870705580916992:12345-0@lo:400:kworker.0 Request processed in 35us (2251us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044067.923261:0:9501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00080000:1.0:1784044067.923289:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1784044067.923295:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1784044067.923298:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784044067.923323:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39759b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1870705580916224:0@lo:400:kworker.0 00000100:00100000:1.0:1784044067.923361:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044067.924786:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3975b88000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1870705580916736:0@lo:400:kworker.0 00000100:00100000:1.0:1784044067.924865:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044067.924884:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3975b88380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3640:1870705580917248:0@lo:400:kworker.0 00000100:00100000:1.0:1784044067.924910:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044067.935011:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580916224 00000100:00100000:3.0:1784044067.935037:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580916224 00000100:00100000:3.0:1784044067.935125:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580917248 00000100:00100000:3.0:1784044067.935130:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580917248 00000100:00100000:3.0:1784044067.935240:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1784044067.935254:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843caca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1870705580916224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044067.935411:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843caca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1870705580916224:12345-0@lo:400:kworker.0 Request processed in 161us (12048us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044067.935420:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1784044067.935444:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1784044067.935450:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843cad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1870705580917248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044067.935481:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843cad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1870705580917248:12345-0@lo:400:kworker.0 Request processed in 31us (10570us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044067.935487:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1784044067.935563:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39759b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1870705580916352:0@lo:400:kworker.0 00000100:00100000:3.0:1784044067.935918:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044067.935961:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3975b8bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1870705580916864:0@lo:400:kworker.0 00000100:00100000:3.0:1784044067.935993:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044067.936018:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3975b88a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3641:1870705580917376:0@lo:400:kworker.0 00000100:00100000:3.0:1784044067.936041:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044067.936081:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580916352 00000100:00100000:3.0:1784044067.936087:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580916352 00000100:00100000:3.0:1784044067.936122:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1784044067.936128:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1870705580916352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044067.936213:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1870705580916352:12345-0@lo:400:kworker.0 Request processed in 84us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044067.936220:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1784044067.936242:0:9822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580916736 00000100:00100000:3.0:1784044067.936246:0:9822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580916736 00000100:00100000:3.0:1784044067.936279:0:9822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580916864 00000100:00100000:3.0:1784044067.936295:0:9822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580916864 00000100:00100000:3.0:1784044067.936327:0:9822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1784044067.936333:0:9822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843caed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3640:x1870705580916736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044067.936382:0:9822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843caed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3640:x1870705580916736:12345-0@lo:400:kworker.0 Request processed in 49us (11518us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044067.936388:0:9822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1784044067.936399:0:9822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1784044067.936405:0:9822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d46d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3641:x1870705580916864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044067.936432:0:9822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d46d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3641:x1870705580916864:12345-0@lo:400:kworker.0 Request processed in 28us (438us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044067.936438:0:9822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1784044067.936494:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39759b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1870705580916352:0@lo:400:kworker.0 00010000:00080000:3.0:1784044067.936513:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b3975b8bb80 x1870705580916864/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784044083 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784044067.936524:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3975b8bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1870705580916864:0@lo:400:kworker.0 00000100:00080000:3.0:1784044067.936560:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784044067.936588:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3975b88e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3639:1870705580916480:0@lo:400:kworker.0 00000100:00100000:3.0:1784044067.936605:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3975b8b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3639:1870705580916992:0@lo:400:kworker.0 00000100:00100000:3.0:1784044067.936839:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39759b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:3639:1870705580916096:0@lo:400:kworker.0 00000100:00100000:3.0:1784044067.936857:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3975b88700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1870705580916608:0@lo:400:kworker.0 00010000:00080000:3.0:1784044067.936875:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b3975b8ad80 x1870705580917120/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044083 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784044067.936885:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3975b8ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3639:1870705580917120:0@lo:400:kworker.0 00010000:00080000:3.0:1784044067.936916:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b39759b6a00 x1870705580915968/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784044083 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784044067.936936:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39759b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1870705580915968:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784044067.936984:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580917376 00000100:00100000:3.0:1784044067.936990:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580917376 00000100:00100000:3.0:1784044067.937033:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1784044067.937041:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1870705580917376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044067.937087:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1870705580917376:12345-0@lo:400:kworker.0 Request processed in 47us (1045us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044067.937094:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00080000:3.0:1784044067.937112:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1784044067.937130:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b3975b88a80 x1870705580917376/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044083 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784044067.937139:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3975b88a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3641:1870705580917376:0@lo:400:kworker.0 00000100:00100000:3.0:1784044067.937307:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3975b88380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3640:1870705580917248:0@lo:400:kworker.0 00000100:00100000:3.0:1784044067.937328:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39759b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1870705580916224:0@lo:400:kworker.0 00010000:00080000:3.0:1784044067.937340:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b3975b88000 x1870705580916736/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784044083 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784044067.937349:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3975b88000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1870705580916736:0@lo:400:kworker.0 00010000:00010000:1.0:1784044068.500577:0:10331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784044069.519486:0:10330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784044070.544083:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784044070.630991:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044070.631051:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044070.631091:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044070.631133:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565116672 00000100:00100000:2.0:1784044070.631145:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565116672 00000100:00100000:2.0:1784044070.631246:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565116800 00000100:00100000:2.0:1784044070.631249:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565116800 00000100:00100000:2.0:1784044070.631279:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 112 00000100:00100000:2.0:1784044070.631303:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843c89880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+6:2407:x1870705565116672:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:2.0:1784044070.631399:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843c89880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+6:2407:x1870705565116672:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 98us (421us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044070.631408:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 112 00000100:00100000:2.0:1784044070.631427:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 113 00000100:00100000:2.0:1784044070.631433:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843c8ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+5:2407:x1870705565116800:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:1.0:1784044070.631569:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565116544 00000100:00100000:1.0:1784044070.631574:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565116544 00000100:00100000:1.0:1784044070.631623:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 290 00000100:00100000:1.0:1784044070.631643:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3950376050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4a09ad9-a185-4679-99bb-b6a07b865440+10:2407:x1870705565116544:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:1.0:1784044070.631676:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3950376050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4a09ad9-a185-4679-99bb-b6a07b865440+10:2407:x1870705565116544:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 35us (625us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044070.631684:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 290 00000100:00080000:1.0:1784044070.631745:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1784044070.631750:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784044070.632565:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843c8ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+5:2407:x1870705565116800:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 28us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044070.632584:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 113 00000100:00100000:3.0:1784044070.989413:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1784044070.989448:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843c89500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1870705580917504:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1784044070.989541:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044070.989689:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580917504 00000100:00100000:2.0:1784044070.989701:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580917504 00000100:00100000:2.0:1784044070.989768:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1784044070.989779:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1870705580917504:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1784044070.989820:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1784044070.989871:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1870705580917504:12345-0@lo:41:osp-pre-0-1.0 Request processed in 93us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044070.989876:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1784044070.990710:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843c89500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1870705580917504:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1784044071.565970:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784044072.014634:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784044072.014667:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843caf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1870705580917632:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1784044072.014762:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044072.016798:0:7768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580917632 00000100:00100000:3.0:1784044072.016836:0:7768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580917632 00000100:00100000:3.0:1784044072.016931:0:7768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1784044072.016942:0:7768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843cac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1870705580917632:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1784044072.016995:0:7768:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1784044072.018804:0:7768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843cac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1870705580917632:12345-0@lo:41:osp-pre-1-0.0 Request processed in 1850us (4028us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044072.018823:0:7768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1784044072.018908:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843cae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1870705580917760:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1784044072.019004:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044072.019659:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580917760 00000100:00100000:1.0:1784044072.019673:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580917760 00000100:00100000:1.0:1784044072.019750:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1784044072.019761:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3975b88000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1870705580917760:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1784044072.019801:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784044072.019861:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3975b88000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1870705580917760:12345-0@lo:13:osp-pre-0-1.0 Request processed in 103us (857us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044072.019869:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:1.0:1784044072.019903:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1784044072.020242:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b3843cae680 x1870705580917760/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784044088 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784044072.020269:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843cae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1870705580917760:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1784044072.020325:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843caf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1870705580917632:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1784044072.026210:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784044072.026256:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3975b88380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1870705580917888:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784044072.026368:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044072.026726:0:10713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580917888 00000100:00100000:3.0:1784044072.026740:0:10713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580917888 00000100:00100000:3.0:1784044072.026841:0:10713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1784044072.026856:0:10713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843cadc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1870705580917888:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1784044072.026890:0:10713:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784044072.026957:0:10713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843cadc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1870705580917888:12345-0@lo:13:osp-pre-0-0.0 Request processed in 105us (590us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044072.026966:0:10713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00080000:3.0:1784044072.027018:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b3975b88380 x1870705580917888/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784044088 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784044072.027045:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3975b88380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1870705580917888:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1784044072.027313:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1784044072.591035:0:10331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784044073.037890:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3975b88380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1870705580918016:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784044073.038022:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044073.038301:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843caea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1870705580918144:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1784044073.038539:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580918016 00000100:00100000:2.0:1784044073.038549:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580918016 00000100:00100000:2.0:1784044073.038640:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1784044073.038653:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3975b88a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1870705580918016:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1784044073.038693:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784044073.038764:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3975b88a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1870705580918016:12345-0@lo:13:osp-pre-1-0.0 Request processed in 113us (756us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044073.038771:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1784044073.038824:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1784044073.038911:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784044073.038975:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843caf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:3640:1870705580918272:0@lo:400:kworker.0 00000100:00100000:3.0:1784044073.039124:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044073.039154:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784044073.039161:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843cae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1870705580918400:0@lo:400:kworker.0 00000100:00100000:3.0:1784044073.039338:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044073.039481:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580918272 00000100:00100000:2.0:1784044073.039483:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580918144 00000100:00100000:3.0:1784044073.039486:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580918272 00000100:00100000:2.0:1784044073.039486:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580918144 00000100:00100000:3.0:1784044073.039518:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:2.0:1784044073.039518:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1784044073.039525:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3950370c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+24:3640:x1870705580918272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784044073.039525:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843cace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1870705580918144:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1784044073.039539:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784044073.039564:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3950370c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+24:3640:x1870705580918272:12345-0@lo:400:kworker.0 Request processed in 39us (439us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044073.039568:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843cace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1870705580918144:12345-0@lo:13:osp-pre-1-1.0 Request processed in 44us (744us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044073.039572:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00100000:2.0:1784044073.039574:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1784044073.039730:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397f9ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1870705580918912:0@lo:400:kworker.0 00000100:00100000:3.0:1784044073.039731:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843caf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:3640:1870705580918272:0@lo:400:kworker.0 00000100:00100000:3.0:1784044073.039754:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397f9af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1870705580918784:0@lo:400:kworker.0 00000100:00100000:3.0:1784044073.039779:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044073.039780:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044073.039798:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397f9ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3641:1870705580919424:0@lo:400:kworker.0 00000100:00100000:3.0:1784044073.039801:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397f9af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1870705580919296:0@lo:400:kworker.0 00000100:00100000:1.0:1784044073.039819:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044073.039850:0:9501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580918400 00000100:00100000:3.0:1784044073.039854:0:9501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580918400 00000100:00100000:3.0:1784044073.039882:0:9501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580919424 00000100:00100000:3.0:1784044073.039885:0:9501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580919424 00000100:00100000:3.0:1784044073.039905:0:9501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1784044073.039912:0:9501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3975b8ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1870705580918400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044073.039947:0:9501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3975b8ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1870705580918400:12345-0@lo:400:kworker.0 Request processed in 36us (608us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044073.039963:0:9501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1784044073.039976:0:9501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1784044073.039981:0:9501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397f9aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1870705580919424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044073.040165:0:9501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397f9aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1870705580919424:12345-0@lo:400:kworker.0 Request processed in 183us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044073.040191:0:9501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1784044073.040197:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580918784 00000100:00100000:2.0:1784044073.040201:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580918784 00000100:00100000:2.0:1784044073.040227:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1784044073.040234:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3975b88700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1870705580918784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784044073.040270:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3975b88700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1870705580918784:12345-0@lo:400:kworker.0 Request processed in 36us (490us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044073.040277:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1784044073.040295:0:9822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580918912 00000100:00100000:2.0:1784044073.040299:0:9822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580918912 00000100:00100000:2.0:1784044073.040340:0:9822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1784044073.040346:0:9822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397f9adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3641:x1870705580918912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784044073.040386:0:9822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397f9adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3641:x1870705580918912:12345-0@lo:400:kworker.0 Request processed in 40us (606us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044073.040401:0:9822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1784044073.040802:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397f9ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3641:1870705580919424:0@lo:400:kworker.0 00010000:00080000:1.0:1784044073.040827:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b397f9ad880 x1870705580918912/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784044089 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784044073.040834:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397f9ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1870705580918912:0@lo:400:kworker.0 00000100:00080000:1.0:1784044073.040913:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1784044073.040917:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784044073.040933:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843caf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1870705580918528:0@lo:400:kworker.0 00000100:00100000:1.0:1784044073.041199:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044073.041235:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397f9aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1870705580919040:0@lo:400:kworker.0 00000100:00100000:1.0:1784044073.041262:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044073.041268:0:7768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580918528 00000100:00100000:3.0:1784044073.041274:0:7768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580918528 00000100:00100000:1.0:1784044073.041286:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397f9ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3638:1870705580919552:0@lo:400:kworker.0 00000100:00100000:1.0:1784044073.041308:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044073.041310:0:7768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1784044073.041318:0:7768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397f9ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1870705580918528:12345-0@lo:400:kworker.0 00010000:00080000:1.0:1784044073.041337:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b3975b88380 x1870705580918016/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784044089 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784044073.041357:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3975b88380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1870705580918016:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784044073.041375:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1784044073.041383:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843cae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1870705580918656:0@lo:400:kworker.0 00000100:00100000:3.0:1784044073.041385:0:7768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397f9ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1870705580918528:12345-0@lo:400:kworker.0 Request processed in 68us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044073.041416:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044073.041436:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397f9ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1870705580919168:0@lo:400:kworker.0 00000100:00100000:1.0:1784044073.041457:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044073.041494:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843caf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1870705580918528:0@lo:400:kworker.0 00000100:00100000:1.0:1784044073.041519:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580919552 00000100:00100000:1.0:1784044073.041523:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580919552 00000100:00100000:1.0:1784044073.041553:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580918656 00000100:00100000:1.0:1784044073.041556:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580918656 00000100:00100000:1.0:1784044073.041569:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580919168 00000100:00100000:1.0:1784044073.041571:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580919168 00000100:00100000:1.0:1784044073.041603:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1784044073.041608:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397f9ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1870705580919552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044073.041647:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397f9ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1870705580919552:12345-0@lo:400:kworker.0 Request processed in 38us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044073.041654:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1784044073.041669:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1784044073.041675:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397f9af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1870705580918656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044073.041701:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397f9af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1870705580918656:12345-0@lo:400:kworker.0 Request processed in 27us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044073.041707:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1784044073.041718:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1784044073.041724:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397f9ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1870705580919168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044073.041736:0:7768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1784044073.041761:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397f9ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1870705580919168:12345-0@lo:400:kworker.0 Request processed in 36us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044073.041767:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00080000:1.0:1784044073.041780:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1784044073.041782:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1784044073.041809:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b3843caea00 x1870705580918144/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784044089 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784044073.041821:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843caea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1870705580918144:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1784044073.041858:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044073.041891:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580919296 00000100:00100000:1.0:1784044073.041894:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843cae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1870705580918400:0@lo:400:kworker.0 00000100:00100000:3.0:1784044073.041895:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580919296 00000100:00100000:1.0:1784044073.041914:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397f9af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1870705580918784:0@lo:400:kworker.0 00000100:00100000:3.0:1784044073.041921:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1784044073.041926:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397f9afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1870705580919296:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1784044073.041930:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1784044073.041942:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843cae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1870705580918656:0@lo:400:kworker.0 00000100:00100000:1.0:1784044073.041951:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397f9ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1870705580919168:0@lo:400:kworker.0 00000100:00100000:3.0:1784044073.041958:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397f9afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1870705580919296:12345-0@lo:400:kworker.0 Request processed in 32us (99us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044073.041964:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1784044073.042082:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580919040 00000100:00100000:2.0:1784044073.042087:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580919040 00000100:00100000:2.0:1784044073.042126:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1784044073.042133:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397f9ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1870705580919040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784044073.042170:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397f9ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1870705580919040:12345-0@lo:400:kworker.0 Request processed in 37us (906us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044073.042198:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:1.0:1784044073.043639:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b397f9ae680 x1870705580919552/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044089 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784044073.043660:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397f9ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3638:1870705580919552:0@lo:400:kworker.0 00010000:00080000:1.0:1784044073.043721:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b397f9aed80 x1870705580919040/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784044089 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784044073.043730:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397f9aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1870705580919040:0@lo:400:kworker.0 00010000:00080000:1.0:1784044073.043947:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b397f9af100 x1870705580919296/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044089 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784044073.044032:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397f9af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1870705580919296:0@lo:400:kworker.0 00010000:00010000:2.0:1784044073.618362:0:10330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784044074.641637:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784044075.667774:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784044075.757885:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1784044075.757932:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1784044075.757965:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565117056 00000100:00100000:1.0:1784044075.757974:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565117056 00000100:00100000:1.0:1784044075.758036:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 120 00000100:00100000:1.0:1784044075.758046:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397f9af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+6:2407:x1870705565117056:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:1.0:1784044075.758137:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397f9af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+6:2407:x1870705565117056:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 92us (204us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044075.758146:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 120 00000100:00080000:1.0:1784044075.758170:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784044075.758937:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565116928 00000100:00100000:2.0:1784044075.758944:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565116928 00000100:00100000:2.0:1784044075.758996:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 292 00000100:00100000:2.0:1784044075.759004:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3950371850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4a09ad9-a185-4679-99bb-b6a07b865440+10:2407:x1870705565116928:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:2.0:1784044075.759049:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3950371850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4a09ad9-a185-4679-99bb-b6a07b865440+10:2407:x1870705565116928:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 45us (1175us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044075.759056:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 292 00000100:00100000:1.0:1784044075.768892:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044075.771901:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565117184 00000100:00100000:0.0:1784044075.771920:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565117184 00000100:00100000:0.0:1784044075.772010:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 121 00000100:00100000:0.0:1784044075.772022:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397f9aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+5:2408:x1870705565117184:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:0.0:1784044075.772109:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397f9aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+5:2408:x1870705565117184:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 89us (3228us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044075.772117:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 121 00000100:00080000:3.0:1784044075.772319:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1784044076.109885:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843c8b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1870705580919680:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1784044076.109963:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044076.115640:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580919680 00000100:00100000:2.0:1784044076.115657:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580919680 00000100:00100000:2.0:1784044076.115811:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1784044076.115822:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38435ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1870705580919680:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1784044076.115867:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1784044076.115957:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38435ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1870705580919680:12345-0@lo:41:osp-pre-0-1.0 Request processed in 137us (5993us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044076.115965:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1784044076.119801:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843c8b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1870705580919680:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1784044076.687029:0:10331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784044077.136039:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3975b8b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1870705580919808:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784044077.136124:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044077.136199:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784044077.136206:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3975b88e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1870705580919936:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1784044077.136240:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044077.136270:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3975b8bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1870705580920064:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1784044077.136307:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044077.136341:0:10713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580919808 00000100:00100000:3.0:1784044077.136348:0:10713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580919808 00000100:00100000:3.0:1784044077.136399:0:10713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580920064 00000100:00100000:3.0:1784044077.136403:0:10713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580920064 00000100:00100000:3.0:1784044077.136420:0:10713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1784044077.136428:0:10713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3975b88380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1870705580919808:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1784044077.136462:0:10713:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784044077.136521:0:10713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3975b88380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1870705580919808:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (397us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044077.136529:0:10713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1784044077.136557:0:10713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1784044077.136564:0:10713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843cae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1870705580920064:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1784044077.136574:0:10713:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784044077.136602:0:10713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843cae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1870705580920064:12345-0@lo:13:osp-pre-0-1.0 Request processed in 38us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044077.136608:0:10713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1784044077.136626:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580919936 00000100:00100000:3.0:1784044077.136630:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580919936 00000100:00100000:3.0:1784044077.136656:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1784044077.136662:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843cae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1870705580919936:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1784044077.136683:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1784044077.136712:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843cae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1870705580919936:12345-0@lo:41:osp-pre-1-0.0 Request processed in 50us (471us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044077.136728:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00080000:3.0:1784044077.136749:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1784044077.136783:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b3975b8bb80 x1870705580920064/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784044093 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784044077.136802:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3975b8bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1870705580920064:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1784044077.136833:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3975b88e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1870705580919936:0@lo:41:osp-pre-1-0.0 00010000:00080000:3.0:1784044077.136844:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b3975b8b800 x1870705580919808/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784044093 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784044077.136854:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3975b8b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1870705580919808:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1784044077.710409:0:10330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784044078.158450:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397f9ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1870705580920192:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1784044078.158527:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044078.158626:0:10713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580920192 00000100:00100000:1.0:1784044078.158635:0:10713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580920192 00000100:00100000:1.0:1784044078.158691:0:10713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1784044078.158702:0:10713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397f9ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1870705580920192:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1784044078.158733:0:10713:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784044078.158778:0:10713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397f9ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1870705580920192:12345-0@lo:13:osp-pre-1-1.0 Request processed in 77us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044078.158786:0:10713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00080000:1.0:1784044078.158808:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1784044078.158841:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b397f9ae680 x1870705580920192/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784044094 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784044078.158862:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397f9ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1870705580920192:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1784044078.159134:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1784044078.159145:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843caea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1870705580920320:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784044078.159211:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044078.159243:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580920320 00000100:00100000:3.0:1784044078.159247:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580920320 00000100:00100000:3.0:1784044078.159280:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1784044078.159286:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843caf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1870705580920320:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1784044078.159297:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784044078.159328:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843caf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1870705580920320:12345-0@lo:13:osp-pre-1-0.0 Request processed in 41us (117us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044078.159334:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00080000:3.0:1784044078.159350:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1784044078.159365:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b3843caea00 x1870705580920320/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784044094 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784044078.159378:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843caea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1870705580920320:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784044078.162021:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b38435ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:3641:1870705580920448:0@lo:400:kworker.0 00000100:00100000:0.0:1784044078.162095:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044078.162136:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397f9df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1870705580920960:0@lo:400:kworker.0 00000100:00100000:0.0:1784044078.162195:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044078.162214:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397f9df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3641:1870705580921472:0@lo:400:kworker.0 00000100:00100000:0.0:1784044078.162238:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044078.162261:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1784044078.162266:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b38435ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3641:1870705580920832:0@lo:400:kworker.0 00000100:00100000:0.0:1784044078.162285:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044078.162299:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397f9dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3641:1870705580921344:0@lo:400:kworker.0 00000100:00100000:0.0:1784044078.162316:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044078.162344:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580921472 00000100:00100000:0.0:1784044078.162350:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580921472 00000100:00100000:0.0:1784044078.162405:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580920832 00000100:00100000:0.0:1784044078.162408:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580920832 00000100:00100000:0.0:1784044078.162439:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580921344 00000100:00100000:0.0:1784044078.162443:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580921344 00000100:00100000:0.0:1784044078.162463:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1784044078.162471:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397f9dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1870705580921472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784044078.162548:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397f9dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1870705580921472:12345-0@lo:400:kworker.0 Request processed in 77us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044078.162556:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1784044078.162574:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1784044078.162579:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397f9dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1870705580920832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784044078.162608:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397f9dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1870705580920832:12345-0@lo:400:kworker.0 Request processed in 30us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044078.162614:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1784044078.162634:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1784044078.162640:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397f9df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1870705580921344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784044078.162668:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397f9df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1870705580921344:12345-0@lo:400:kworker.0 Request processed in 30us (352us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044078.162673:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00080000:0.0:1784044078.162692:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1784044078.162696:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1784044078.162707:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580920448 00000100:00100000:1.0:1784044078.162711:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580920448 00000100:00100000:0.0:1784044078.162721:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b38435ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3641:1870705580920832:0@lo:400:kworker.0 00000100:00100000:0.0:1784044078.162731:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397f9dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3641:1870705580921344:0@lo:400:kworker.0 00000100:00100000:1.0:1784044078.162738:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00010000:00080000:0.0:1784044078.162742:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b397f9df100 x1870705580921472/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044094 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784044078.162744:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3950372850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+24:3641:x1870705580920448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784044078.162753:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397f9df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3641:1870705580921472:0@lo:400:kworker.0 00000100:00100000:0.0:1784044078.162774:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b38435ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:3641:1870705580920448:0@lo:400:kworker.0 00000100:00100000:1.0:1784044078.162775:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3950372850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+24:3641:x1870705580920448:12345-0@lo:400:kworker.0 Request processed in 32us (681us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044078.162787:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00100000:1.0:1784044078.162830:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b38435efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1870705580920576:0@lo:400:kworker.0 00000100:00100000:1.0:1784044078.162856:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044078.162880:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397f9dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1870705580921088:0@lo:400:kworker.0 00000100:00100000:1.0:1784044078.162915:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044078.162930:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397f9dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3638:1870705580921600:0@lo:400:kworker.0 00000100:00100000:1.0:1784044078.162952:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044078.162959:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580920576 00000100:00100000:0.0:1784044078.162962:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580920576 00000100:00100000:1.0:1784044078.162970:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1784044078.162976:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b38435ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1870705580920704:0@lo:400:kworker.0 00000100:00100000:0.0:1784044078.162981:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580921600 00000100:00100000:0.0:1784044078.162983:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580921600 00000100:00100000:0.0:1784044078.163004:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1784044078.163010:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397f9ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1870705580920576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784044078.163041:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397f9ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1870705580920576:12345-0@lo:400:kworker.0 Request processed in 30us (184us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044078.163047:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1784044078.163059:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1784044078.163065:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397f9adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1870705580921600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784044078.163093:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397f9adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1870705580921600:12345-0@lo:400:kworker.0 Request processed in 28us (140us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044078.163106:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00080000:0.0:1784044078.163120:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784044078.163170:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044078.163217:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397f9ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1870705580921216:0@lo:400:kworker.0 00000100:00100000:1.0:1784044078.163240:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044078.163257:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397f9de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3638:1870705580921728:0@lo:400:kworker.0 00000100:00100000:1.0:1784044078.163276:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044078.163298:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b38435efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1870705580920576:0@lo:400:kworker.0 00000100:00100000:1.0:1784044078.163307:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397f9dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3638:1870705580921600:0@lo:400:kworker.0 00000100:00100000:0.0:1784044078.163321:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580920960 00000100:00100000:0.0:1784044078.163325:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580920960 00000100:00100000:1.0:1784044078.163328:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580921088 00000100:00100000:1.0:1784044078.163331:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580921088 00000100:00100000:1.0:1784044078.163352:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580921216 00000100:00100000:0.0:1784044078.163352:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580920704 00000100:00100000:1.0:1784044078.163355:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580921216 00000100:00100000:0.0:1784044078.163355:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580920704 00000100:00100000:1.0:1784044078.163372:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1784044078.163377:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397f9af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1870705580921088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784044078.163379:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1784044078.163384:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397f9ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1870705580920960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784044078.163417:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397f9ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1870705580920960:12345-0@lo:400:kworker.0 Request processed in 32us (1253us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044078.163665:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1784044078.163680:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1784044078.163687:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39502f3850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1870705580920704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784044078.163724:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39502f3850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1870705580920704:12345-0@lo:400:kworker.0 Request processed in 39us (553us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044078.163730:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1784044078.163986:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397f9df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1870705580920960:0@lo:400:kworker.0 00000100:00100000:1.0:1784044078.166100:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397f9af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1870705580921088:12345-0@lo:400:kworker.0 Request processed in 2712us (3185us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044078.166131:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1784044078.166171:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1784044078.166215:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397f9ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1870705580921216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044078.166284:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397f9ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1870705580921216:12345-0@lo:400:kworker.0 Request processed in 77us (3043us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044078.166290:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1784044078.166322:0:9501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580921728 00000100:00100000:1.0:1784044078.166329:0:9501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580921728 00000100:00100000:1.0:1784044078.166368:0:9501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1784044078.166374:0:9501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397f9ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1870705580921728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044078.168360:0:9501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397f9ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1870705580921728:12345-0@lo:400:kworker.0 Request processed in 1975us (5071us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044078.168374:0:9501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1784044078.168616:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b38435ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1870705580920704:0@lo:400:kworker.0 00010000:00080000:1.0:1784044078.168637:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b397f9ded80 x1870705580921216/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784044094 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784044078.168648:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397f9ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1870705580921216:0@lo:400:kworker.0 00010000:00080000:1.0:1784044078.168660:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b397f9de680 x1870705580921728/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044094 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784044078.168667:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397f9de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3638:1870705580921728:0@lo:400:kworker.0 00010000:00080000:1.0:1784044078.168679:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b397f9dd880 x1870705580921088/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784044094 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784044078.168688:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397f9dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1870705580921088:0@lo:400:kworker.0 00000100:00080000:0.0:1784044078.169269:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1784044078.737748:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784044079.760683:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784044080.787584:0:10331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784044080.883657:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1784044080.883692:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1784044080.883769:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1784044080.883802:0:9501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565117440 00000100:00100000:1.0:1784044080.883812:0:9501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565117440 00000100:00100000:1.0:1784044080.883876:0:9501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565117568 00000100:00100000:1.0:1784044080.883880:0:9501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565117568 00000100:00100000:1.0:1784044080.883903:0:9501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 128 00000100:00100000:1.0:1784044080.883912:0:9501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397f9aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a93fdf3c-d42f-420a-95ea-b0cbfe954363+6:2410:x1870705565117440:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:1.0:1784044080.883980:0:9501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397f9aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a93fdf3c-d42f-420a-95ea-b0cbfe954363+6:2410:x1870705565117440:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 68us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044080.883988:0:9501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 128 00000100:00100000:1.0:1784044080.884007:0:9501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 129 00000100:00100000:1.0:1784044080.884014:0:9501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397f9ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a93fdf3c-d42f-420a-95ea-b0cbfe954363+5:2410:x1870705565117568:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:1.0:1784044080.884039:0:9501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397f9ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a93fdf3c-d42f-420a-95ea-b0cbfe954363+5:2410:x1870705565117568:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 26us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044080.884045:0:9501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 129 00000100:00080000:1.0:1784044080.884065:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1784044080.884069:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784044080.884464:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565117312 00000100:00100000:0.0:1784044080.884470:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565117312 00000100:00100000:0.0:1784044080.884505:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 294 00000100:00100000:0.0:1784044080.884522:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3950370450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4a09ad9-a185-4679-99bb-b6a07b865440+10:2410:x1870705565117312:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:0.0:1784044080.884558:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3950370450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4a09ad9-a185-4679-99bb-b6a07b865440+10:2410:x1870705565117312:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 38us (911us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044080.884565:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 294 00000100:00100000:1.0:1784044081.229725:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397f9df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1870705580921856:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1784044081.229831:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044081.230098:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580921856 00000100:00100000:0.0:1784044081.230109:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580921856 00000100:00100000:0.0:1784044081.230197:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1784044081.230218:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397f9ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1870705580921856:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1784044081.230461:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1784044081.230545:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397f9ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1870705580921856:12345-0@lo:41:osp-pre-0-1.0 Request processed in 338us (712us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044081.230553:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1784044081.230707:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397f9df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1870705580921856:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1784044081.806486:0:10330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784044082.253995:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843caea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1870705580921984:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784044082.254066:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044082.255969:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397f9ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1870705580922112:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1784044082.256031:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044082.256206:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580921984 00000100:00100000:2.0:1784044082.256215:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580921984 00000100:00100000:2.0:1784044082.256280:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580922112 00000100:00100000:2.0:1784044082.256283:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580922112 00000100:00100000:2.0:1784044082.256301:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1784044082.256309:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843caf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1870705580921984:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1784044082.256349:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784044082.256394:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843caf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1870705580921984:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (2327us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044082.256402:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1784044082.256415:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1784044082.256421:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843cad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1870705580922112:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1784044082.256430:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784044082.256451:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843cad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1870705580922112:12345-0@lo:13:osp-pre-0-1.0 Request processed in 31us (421us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044082.256456:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00080000:0.0:1784044082.256574:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1784044082.256905:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b397f9ddc00 x1870705580922112/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784044098 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784044082.256929:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397f9ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1870705580922112:0@lo:13:osp-pre-0-1.0 00010000:00080000:3.0:1784044082.256964:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b3843caea00 x1870705580921984/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784044098 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784044082.256976:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843caea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1870705580921984:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784044082.257568:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397f9e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1870705580922240:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1784044082.257623:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044082.259065:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580922240 00000100:00100000:2.0:1784044082.259075:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580922240 00000100:00100000:2.0:1784044082.259127:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1784044082.259135:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397f9e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1870705580922240:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1784044082.259165:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1784044082.259264:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397f9e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1870705580922240:12345-0@lo:41:osp-pre-1-0.0 Request processed in 129us (1640us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044082.259271:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1784044082.259517:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397f9e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1870705580922240:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1784044082.833556:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784044083.277659:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843c89c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1870705580922624:0@lo:400:kworker.0 00000100:00100000:0.0:1784044083.277749:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044083.277815:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843c8a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1870705580923136:0@lo:400:kworker.0 00000100:00100000:0.0:1784044083.277842:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044083.277866:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843c89180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3638:1870705580923648:0@lo:400:kworker.0 00000100:00100000:0.0:1784044083.277890:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044083.277917:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1784044083.277923:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843c8aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1870705580922752:0@lo:400:kworker.0 00000100:00100000:0.0:1784044083.277944:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044083.277960:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843c8bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1870705580923264:0@lo:400:kworker.0 00000100:00100000:0.0:1784044083.277979:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044083.277993:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843c88a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1870705580923776:0@lo:400:kworker.0 00000100:00100000:0.0:1784044083.278011:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044083.278151:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580922624 00000100:00100000:2.0:1784044083.278159:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580922624 00000100:00100000:2.0:1784044083.278253:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1784044083.278277:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397f9df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1870705580922624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784044083.278336:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397f9df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1870705580922624:12345-0@lo:400:kworker.0 Request processed in 61us (586us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044083.278343:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1784044083.278383:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843c89c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1870705580922624:0@lo:400:kworker.0 00000100:00100000:3.0:1784044083.278560:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843c8a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3641:1870705580922496:0@lo:400:kworker.0 00000100:00100000:3.0:1784044083.278590:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044083.278606:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843c8b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1870705580923008:0@lo:400:kworker.0 00000100:00100000:3.0:1784044083.278623:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044083.278635:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843c88700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3641:1870705580923520:0@lo:400:kworker.0 00000100:00100000:3.0:1784044083.278650:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044083.278661:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:3.0:1784044083.278665:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843c88380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:3641:1870705580922368:0@lo:400:kworker.0 00000100:00100000:3.0:1784044083.278687:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044083.278702:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843c88e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1870705580922880:0@lo:400:kworker.0 00000100:00100000:3.0:1784044083.278719:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044083.278744:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843c89f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3641:1870705580923392:0@lo:400:kworker.0 00000100:00100000:3.0:1784044083.278763:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044083.278781:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843c8b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1870705580923904:0@lo:400:kworker.0 00000100:00100000:3.0:1784044083.278812:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044083.278834:0:7768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580922880 00000100:00100000:3.0:1784044083.278838:0:7768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580922880 00000100:00100000:3.0:1784044083.278864:0:7768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1784044083.278869:0:7768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843cae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1870705580922880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044083.278900:0:7768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843cae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1870705580922880:12345-0@lo:400:kworker.0 Request processed in 31us (180us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044083.278906:0:7768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1784044083.278961:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843c88e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1870705580922880:0@lo:400:kworker.0 00000100:00100000:2.0:1784044083.279163:0:9822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580923136 00000100:00100000:2.0:1784044083.279167:0:9822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580923136 00000100:00100000:2.0:1784044083.279204:0:9822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580923776 00000100:00100000:2.0:1784044083.279206:0:9822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580923776 00000100:00100000:2.0:1784044083.279224:0:9822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580923008 00000100:00100000:2.0:1784044083.279226:0:9822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580923008 00000100:00100000:2.0:1784044083.279235:0:9822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580923904 00000100:00100000:2.0:1784044083.279237:0:9822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580923904 00000100:00100000:2.0:1784044083.279258:0:9822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1784044083.279264:0:9822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397f9dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3638:x1870705580923136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784044083.279298:0:9822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397f9dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3638:x1870705580923136:12345-0@lo:400:kworker.0 Request processed in 35us (1456us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044083.279304:0:9822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1784044083.279314:0:9822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1784044083.279319:0:9822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397f9dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3638:x1870705580923776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784044083.279339:0:9822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397f9dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3638:x1870705580923776:12345-0@lo:400:kworker.0 Request processed in 21us (1327us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044083.279344:0:9822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1784044083.279353:0:9822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1784044083.279358:0:9822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843cac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3641:x1870705580923008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784044083.279377:0:9822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843cac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3641:x1870705580923008:12345-0@lo:400:kworker.0 Request processed in 19us (753us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044083.279391:0:9822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1784044083.279400:0:9822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1784044083.279405:0:9822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3975b89f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3641:x1870705580923904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784044083.279428:0:9822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3975b89f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3641:x1870705580923904:12345-0@lo:400:kworker.0 Request processed in 23us (615us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044083.279433:0:9822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1784044083.279459:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580922368 00000100:00100000:2.0:1784044083.279462:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580922368 00000100:00100000:2.0:1784044083.279482:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:2.0:1784044083.279500:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3950370850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+24:3641:x1870705580922368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784044083.279525:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3950370850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+24:3641:x1870705580922368:12345-0@lo:400:kworker.0 Request processed in 38us (838us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044083.279532:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00080000:2.0:1784044083.279558:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1784044083.279581:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b3843c88a80 x1870705580923776/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784044099 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784044083.279593:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843c88a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1870705580923776:0@lo:400:kworker.0 00010000:00080000:2.0:1784044083.279602:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b3843c8a300 x1870705580923136/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784044099 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784044083.279611:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843c8a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1870705580923136:0@lo:400:kworker.0 00000100:00100000:1.0:1784044083.280398:0:9501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580923648 00000100:00100000:1.0:1784044083.280405:0:9501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580923648 00000100:00100000:1.0:1784044083.280436:0:9501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580922752 00000100:00100000:1.0:1784044083.280438:0:9501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580922752 00000100:00100000:1.0:1784044083.280448:0:9501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580923264 00000100:00100000:1.0:1784044083.280450:0:9501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580923264 00000100:00100000:1.0:1784044083.280461:0:9501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580922496 00000100:00100000:1.0:1784044083.280463:0:9501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580922496 00000100:00100000:1.0:1784044083.280472:0:9501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580923520 00000100:00100000:1.0:1784044083.280474:0:9501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580923520 00000100:00100000:1.0:1784044083.280484:0:9501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580923392 00000100:00100000:1.0:1784044083.280498:0:9501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580923392 00000100:00100000:1.0:1784044083.280513:0:9501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1784044083.280519:0:9501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397f9de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1870705580923648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044083.280565:0:9501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397f9de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1870705580923648:12345-0@lo:400:kworker.0 Request processed in 46us (2674us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044083.280571:0:9501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1784044083.280582:0:9501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1784044083.280587:0:9501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397f9dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1870705580922752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044083.280609:0:9501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397f9dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1870705580922752:12345-0@lo:400:kworker.0 Request processed in 22us (2665us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044083.280615:0:9501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1784044083.280623:0:9501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1784044083.280629:0:9501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397f9ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1870705580923264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044083.280649:0:9501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397f9ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1870705580923264:12345-0@lo:400:kworker.0 Request processed in 21us (2670us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044083.280662:0:9501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1784044083.280672:0:9501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1784044083.280677:0:9501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843caea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1870705580922496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044083.280700:0:9501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843caea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1870705580922496:12345-0@lo:400:kworker.0 Request processed in 23us (2110us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044083.280706:0:9501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1784044083.280714:0:9501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1784044083.280719:0:9501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843cac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1870705580923520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784044083.280863:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1784044083.280872:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3975b8b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1870705580923392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784044083.280903:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3975b8b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1870705580923392:12345-0@lo:400:kworker.0 Request processed in 34us (2139us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044083.280914:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1784044083.280933:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784044083.280943:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843c89c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1870705580924032:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784044083.280973:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044083.280996:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784044083.281003:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397f9dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1870705580924160:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1784044083.281021:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044083.281041:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580924032 00000100:00100000:0.0:1784044083.281044:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580924032 00000100:00100000:0.0:1784044083.281064:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580924160 00000100:00100000:0.0:1784044083.281067:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580924160 00000100:00100000:0.0:1784044083.281089:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1784044083.281095:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397f9dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1870705580924032:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1784044083.281114:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784044083.281144:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397f9dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1870705580924032:12345-0@lo:13:osp-pre-1-0.0 Request processed in 49us (170us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044083.281150:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1784044083.281160:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1784044083.281165:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397f9dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1870705580924160:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1784044083.281191:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784044083.281214:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397f9dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1870705580924160:12345-0@lo:13:osp-pre-1-1.0 Request processed in 49us (192us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044083.281220:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1784044083.282198:0:9501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843cac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1870705580923520:12345-0@lo:400:kworker.0 Request processed in 1475us (3543us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044083.282207:0:9501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00080000:1.0:1784044083.282240:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1784044083.282502:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1784044083.282537:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843c8aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1870705580922752:0@lo:400:kworker.0 00000100:00100000:1.0:1784044083.282549:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843c8bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1870705580923264:0@lo:400:kworker.0 00010000:00080000:1.0:1784044083.282561:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b3843c89180 x1870705580923648/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044099 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784044083.282573:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843c89180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3638:1870705580923648:0@lo:400:kworker.0 00010000:00080000:1.0:1784044083.282619:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b397f9dd180 x1870705580924160/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784044099 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784044083.282634:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397f9dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1870705580924160:0@lo:13:osp-pre-1-1.0 00010000:00080000:0.0:1784044083.282713:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b3843c89c00 x1870705580924032/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784044099 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784044083.282796:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843c89c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1870705580924032:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784044083.283069:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843c88380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:3641:1870705580922368:0@lo:400:kworker.0 00010000:00080000:3.0:1784044083.283094:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b3843c89f80 x1870705580923392/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044099 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784044083.283103:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843c89f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3641:1870705580923392:0@lo:400:kworker.0 00010000:00080000:3.0:1784044083.283114:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b3843c8b100 x1870705580923904/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784044099 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784044083.283122:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843c8b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1870705580923904:0@lo:400:kworker.0 00000100:00100000:3.0:1784044083.283132:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843c8a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3641:1870705580922496:0@lo:400:kworker.0 00010000:00080000:3.0:1784044083.283198:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b3843c8b480 x1870705580923008/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784044099 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784044083.283207:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843c8b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1870705580923008:0@lo:400:kworker.0 00000100:00100000:3.0:1784044083.283220:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843c88700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3641:1870705580923520:0@lo:400:kworker.0 00010000:00010000:0.0:1784044083.855006:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1784044084.510663:0:11989:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 11:48:02 (1784044082) === 00010000:00010000:1.0:1784044084.878128:0:10331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784044085.896359:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044085.896591:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565117696 00000100:00100000:2.0:1784044085.896601:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565117696 00000100:00100000:2.0:1784044085.896658:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 296 00000100:00100000:2.0:1784044085.896669:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3950373850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4a09ad9-a185-4679-99bb-b6a07b865440+10:8739:x1870705565117696:12345-192.168.202.40@tcp:101:mount.lustre.0 00010000:00010000:2.0:1784044085.896701:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784044085.896727:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b3843798c00/0x89871fc3aba18050 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd3dffad52ca657b expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044085.896755:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b3843798c00/0x89871fc3aba18050 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca657b expref: 11 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044085.896765:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b3843798c00/0x89871fc3aba18050 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca657b expref: 11 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044085.896775:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3843798c00, rc 0) 00000100:00100000:2.0:1784044085.896834:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3950373850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4a09ad9-a185-4679-99bb-b6a07b865440+11:8739:x1870705565117696:12345-192.168.202.40@tcp:101:mount.lustre.0 Request processed in 167us (485us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044085.896840:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 296 00010000:00010000:1.0:1784044085.901501:0:10330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784044085.905494:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1784044085.905595:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565117824 00000100:00100000:1.0:1784044085.905605:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565117824 00000100:00100000:1.0:1784044085.905671:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 297 00000100:00100000:1.0:1784044085.905681:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3950371050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4a09ad9-a185-4679-99bb-b6a07b865440+11:8739:x1870705565117824:12345-192.168.202.40@tcp:501:mount.lustre.0 00000100:00100000:1.0:1784044085.905850:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3950371050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4a09ad9-a185-4679-99bb-b6a07b865440+11:8739:x1870705565117824:12345-192.168.202.40@tcp:501:mount.lustre.0 Request processed in 169us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044085.905858:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 297 00000100:00100000:1.0:1784044085.926439:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044085.926568:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565117952 00000100:00100000:0.0:1784044085.926578:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565117952 00000100:00100000:0.0:1784044085.926647:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 298 00000100:00100000:0.0:1784044085.926659:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3950373050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4a09ad9-a185-4679-99bb-b6a07b865440+11:8739:x1870705565117952:12345-192.168.202.40@tcp:503:mount.lustre.0 00000100:00100000:0.0:1784044085.926821:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3950373050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4a09ad9-a185-4679-99bb-b6a07b865440+11:8739:x1870705565117952:12345-192.168.202.40@tcp:503:mount.lustre.0 Request processed in 162us (392us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044085.926829:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 298 00000100:00100000:0.0:1784044085.944051:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044085.944887:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565118080 00000100:00100000:2.0:1784044085.944901:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565118080 00000100:00100000:2.0:1784044085.944973:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 299 00000100:00100000:2.0:1784044085.944984:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3950372050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4a09ad9-a185-4679-99bb-b6a07b865440+11:8743:x1870705565118080:12345-192.168.202.40@tcp:502:llog_process_th.0 00000100:00100000:2.0:1784044085.945147:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3950372050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4a09ad9-a185-4679-99bb-b6a07b865440+11:8743:x1870705565118080:12345-192.168.202.40@tcp:502:llog_process_th.0 Request processed in 164us (1106us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044085.945155:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 299 00000100:00100000:2.0:1784044085.991537:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044085.991580:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1784044085.991888:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565118208 00000100:00100000:1.0:1784044085.991898:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565118208 00000100:00100000:1.0:1784044085.991982:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565118336 00000100:00100000:1.0:1784044085.991986:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565118336 00000100:00100000:1.0:1784044085.992013:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 136 00000100:00100000:1.0:1784044085.992023:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843c8a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+6:2409:x1870705565118208:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:1.0:1784044085.992094:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843c8a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+6:2409:x1870705565118208:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 72us (568us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044085.992102:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 136 00000100:00100000:1.0:1784044085.992119:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 137 00000100:00100000:1.0:1784044085.992126:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843c88a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+5:2409:x1870705565118336:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:1.0:1784044085.992150:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843c88a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+5:2409:x1870705565118336:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 25us (569us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044085.992155:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 137 00000100:00080000:2.0:1784044085.992361:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1784044085.992365:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784044086.007566:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044086.007876:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565118464 00000100:00100000:0.0:1784044086.007889:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565118464 00000100:00100000:0.0:1784044086.007970:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 300 00000100:00100000:0.0:1784044086.007981:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3950373450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4a09ad9-a185-4679-99bb-b6a07b865440+11:8743:x1870705565118464:12345-192.168.202.40@tcp:502:llog_process_th.0 00000100:00100000:0.0:1784044086.008145:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3950373450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4a09ad9-a185-4679-99bb-b6a07b865440+11:8743:x1870705565118464:12345-192.168.202.40@tcp:502:llog_process_th.0 Request processed in 166us (589us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044086.008154:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 300 00000100:00100000:1.0:1784044086.015866:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044086.016435:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565118592 00000100:00100000:0.0:1784044086.016447:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565118592 00000100:00100000:0.0:1784044086.018948:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 301 00000100:00100000:0.0:1784044086.018961:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3950371450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4a09ad9-a185-4679-99bb-b6a07b865440+11:8743:x1870705565118592:12345-192.168.202.40@tcp:502:llog_process_th.0 00000100:00100000:0.0:1784044086.019151:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3950371450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4a09ad9-a185-4679-99bb-b6a07b865440+11:8743:x1870705565118592:12345-192.168.202.40@tcp:502:llog_process_th.0 Request processed in 192us (3294us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044086.019159:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 301 00000100:00100000:1.0:1784044086.026453:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044086.026961:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565118720 00000100:00100000:2.0:1784044086.026977:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565118720 00000100:00100000:2.0:1784044086.027076:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 302 00000100:00100000:2.0:1784044086.027085:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3950370050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4a09ad9-a185-4679-99bb-b6a07b865440+11:8739:x1870705565118720:12345-192.168.202.40@tcp:101:mount.lustre.0 00010000:00010000:2.0:1784044086.027105:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784044086.027125:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b3843799600/0x89871fc3aba18057 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd3dffad52ca65ac expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044086.027159:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b3843799600/0x89871fc3aba18057 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca65ac expref: 12 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044086.027169:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b3843799600/0x89871fc3aba18057 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca65ac expref: 12 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044086.027207:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3843799600, rc 0) 00000100:00100000:2.0:1784044086.027437:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3950370050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4a09ad9-a185-4679-99bb-b6a07b865440+12:8739:x1870705565118720:12345-192.168.202.40@tcp:101:mount.lustre.0 Request processed in 352us (1000us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044086.027444:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 302 00000100:00100000:2.0:1784044086.039579:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1784044086.039771:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565118848 00000100:00100000:1.0:1784044086.039790:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565118848 00000100:00100000:1.0:1784044086.039875:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 303 00000100:00100000:1.0:1784044086.039888:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3950372450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4a09ad9-a185-4679-99bb-b6a07b865440+12:8739:x1870705565118848:12345-192.168.202.40@tcp:256:mount.lustre.0 20000000:01000000:1.0:1784044086.039923:0:6506:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1784044086.039957:0:6506:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1784044086.039962:0:6506:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1784044086.039966:0:6506:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1784044086.039970:0:6506:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:1.0:1784044086.040076:0:6506:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:1.0:1784044086.042711:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3950372450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4a09ad9-a185-4679-99bb-b6a07b865440+12:8739:x1870705565118848:12345-192.168.202.40@tcp:256:mount.lustre.0 Request processed in 2806us (3126us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044086.042729:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 303 00000100:00100000:2.0:1784044086.047632:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044086.048391:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565118976 00000100:00100000:0.0:1784044086.048426:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565118976 00000100:00100000:0.0:1784044086.048574:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 304 00000100:00100000:0.0:1784044086.048586:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3950373c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4a09ad9-a185-4679-99bb-b6a07b865440+12:8739:x1870705565118976:12345-192.168.202.40@tcp:101:mount.lustre.0 00010000:00010000:0.0:1784044086.048614:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784044086.048638:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b38410b6000/0x89871fc3aba1805e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd3dffad52ca65b3 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044086.048681:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b38410b6000/0x89871fc3aba1805e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca65b3 expref: 13 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044086.048695:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b38410b6000/0x89871fc3aba1805e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca65b3 expref: 13 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044086.048707:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b38410b6000, rc 0) 00000100:00100000:0.0:1784044086.048791:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3950373c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4a09ad9-a185-4679-99bb-b6a07b865440+13:8739:x1870705565118976:12345-192.168.202.40@tcp:101:mount.lustre.0 Request processed in 208us (1174us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044086.048799:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 304 00000100:00100000:2.0:1784044086.052295:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1784044086.052568:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565119104 00000100:00100000:1.0:1784044086.052580:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565119104 00000100:00100000:1.0:1784044086.052663:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 305 00000100:00100000:1.0:1784044086.052675:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3950371c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4a09ad9-a185-4679-99bb-b6a07b865440+13:8739:x1870705565119104:12345-192.168.202.40@tcp:501:mount.lustre.0 00000100:00100000:1.0:1784044086.052890:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3950371c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4a09ad9-a185-4679-99bb-b6a07b865440+13:8739:x1870705565119104:12345-192.168.202.40@tcp:501:mount.lustre.0 Request processed in 215us (611us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044086.052900:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 305 00000100:00100000:3.0:1784044086.056380:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044086.056568:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565119232 00000100:00100000:2.0:1784044086.056581:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565119232 00000100:00100000:2.0:1784044086.056642:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 306 00000100:00100000:2.0:1784044086.056650:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3950372c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4a09ad9-a185-4679-99bb-b6a07b865440+13:8739:x1870705565119232:12345-192.168.202.40@tcp:503:mount.lustre.0 00000100:00100000:2.0:1784044086.056808:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3950372c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4a09ad9-a185-4679-99bb-b6a07b865440+13:8739:x1870705565119232:12345-192.168.202.40@tcp:503:mount.lustre.0 Request processed in 158us (646us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044086.056815:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 306 00000100:00100000:2.0:1784044086.060534:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044086.060686:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565119360 00000100:00100000:0.0:1784044086.060700:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565119360 00000100:00100000:0.0:1784044086.060766:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 307 00000100:00100000:0.0:1784044086.060778:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3970ede850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4a09ad9-a185-4679-99bb-b6a07b865440+13:8748:x1870705565119360:12345-192.168.202.40@tcp:502:llog_process_th.0 00000100:00100000:0.0:1784044086.061065:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3970ede850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4a09ad9-a185-4679-99bb-b6a07b865440+13:8748:x1870705565119360:12345-192.168.202.40@tcp:502:llog_process_th.0 Request processed in 289us (546us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044086.061072:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 307 00000100:00100000:3.0:1784044086.067817:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1784044086.070667:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565119488 00000100:00100000:1.0:1784044086.070689:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565119488 00000100:00100000:1.0:1784044086.070790:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 308 00000100:00100000:1.0:1784044086.070804:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3970edc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4a09ad9-a185-4679-99bb-b6a07b865440+13:8748:x1870705565119488:12345-192.168.202.40@tcp:502:llog_process_th.0 00000100:00100000:1.0:1784044086.071138:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3970edc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4a09ad9-a185-4679-99bb-b6a07b865440+13:8748:x1870705565119488:12345-192.168.202.40@tcp:502:llog_process_th.0 Request processed in 336us (3336us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044086.071160:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 308 00000100:00100000:2.0:1784044086.084255:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1784044086.085505:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565119616 00000100:00100000:1.0:1784044086.085520:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565119616 00000100:00100000:1.0:1784044086.085607:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16 00000100:00100000:1.0:1784044086.085620:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843c89500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2406:x1870705565119616:12345-192.168.202.40@tcp:38:mount.lustre.0 00010000:00080000:1.0:1784044086.085673:0:6513:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from 68dfcea6-5d83-4dbb-8fa3-e35542d621e5@192.168.202.40@tcp t0 exp 0000000000000000 cur 279 last 0 00000020:00000080:1.0:1784044086.085731:0:6513:0:(genops.c:1406:class_connect()) connect: client 68dfcea6-5d83-4dbb-8fa3-e35542d621e5, cookie 0x89871fc3aba18065 00000004:00100000:1.0:1784044086.085770:0:6513:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return b7 00000100:00080000:1.0:1784044086.085917:0:6513:0:(import.c:65:import_set_state_nolock()) ffff9b397b803800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1784044086.086038:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843c89500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68dfcea6-5d83-4dbb-8fa3-e35542d621e5+6:2406:x1870705565119616:12345-192.168.202.40@tcp:38:mount.lustre.0 Request processed in 418us (1798us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044086.086044:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16 00000100:00100000:3.0:1784044086.086610:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044086.086674:0:9501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565119872 00000100:00100000:0.0:1784044086.086682:0:9501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565119872 00000100:00100000:0.0:1784044086.086721:0:9501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 17 00000100:00100000:0.0:1784044086.086728:0:9501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3975b8b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2406:x1870705565119872:12345-192.168.202.40@tcp:38:mount.lustre.0 00010000:00080000:0.0:1784044086.086774:0:9501:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0001: connection from 68dfcea6-5d83-4dbb-8fa3-e35542d621e5@192.168.202.40@tcp t0 exp 0000000000000000 cur 279 last 0 00000020:00000080:0.0:1784044086.086807:0:9501:0:(genops.c:1406:class_connect()) connect: client 68dfcea6-5d83-4dbb-8fa3-e35542d621e5, cookie 0x89871fc3aba1806c 00000004:00100000:0.0:1784044086.086828:0:9501:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return b7 00000100:00080000:0.0:1784044086.086915:0:9501:0:(import.c:65:import_set_state_nolock()) ffff9b397f9b3800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1784044086.086962:0:9501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3975b8b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68dfcea6-5d83-4dbb-8fa3-e35542d621e5+6:2406:x1870705565119872:12345-192.168.202.40@tcp:38:mount.lustre.0 Request processed in 233us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044086.086970:0:9501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 17 00000100:00100000:3.0:1784044086.090528:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044086.090576:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1784044086.091105:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565119744 00000100:00100000:1.0:1784044086.091119:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565119744 00000100:00100000:0.0:1784044086.091254:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565120128 00000100:00100000:0.0:1784044086.091260:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565120128 00000100:00080000:2.0:1784044086.091303:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784044086.091319:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 18 00000100:00100000:0.0:1784044086.091333:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3975b8b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68dfcea6-5d83-4dbb-8fa3-e35542d621e5+7:8739:x1870705565120128:12345-192.168.202.40@tcp:41:mount.lustre.0 00000004:00000024:0.0:1784044086.091384:0:6511:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1784044086.091400:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 19 00000100:00100000:1.0:1784044086.091411:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3975b88700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68dfcea6-5d83-4dbb-8fa3-e35542d621e5+7:0:x1870705565119744:12345-192.168.202.40@tcp:41:mount.lustre.0 00000004:00000024:1.0:1784044086.091429:0:6513:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1784044086.091506:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3975b8b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68dfcea6-5d83-4dbb-8fa3-e35542d621e5+7:8739:x1870705565120128:12345-192.168.202.40@tcp:41:mount.lustre.0 Request processed in 174us (927us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044086.091515:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 18 00000100:00100000:1.0:1784044086.092133:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3975b88700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68dfcea6-5d83-4dbb-8fa3-e35542d621e5+6:0:x1870705565119744:12345-192.168.202.40@tcp:41:mount.lustre.0 Request processed in 722us (1618us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044086.092142:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 19 00000100:00100000:3.0:1784044086.095324:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044086.095549:0:9501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565120256 00000100:00100000:0.0:1784044086.095560:0:9501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565120256 00000100:00100000:0.0:1784044086.095644:0:9501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 20 00000100:00100000:0.0:1784044086.095655:0:9501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3975b88e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68dfcea6-5d83-4dbb-8fa3-e35542d621e5+6:8739:x1870705565120256:12345-192.168.202.40@tcp:40:mount.lustre.0 00000100:00100000:0.0:1784044086.095766:0:9501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3975b88e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68dfcea6-5d83-4dbb-8fa3-e35542d621e5+6:8739:x1870705565120256:12345-192.168.202.40@tcp:40:mount.lustre.0 Request processed in 112us (456us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044086.095775:0:9501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 20 00000100:00100000:2.0:1784044086.099095:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044086.099220:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565120000 00000100:00100000:0.0:1784044086.099237:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565120000 00000100:00100000:0.0:1784044086.099323:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 21 00000100:00100000:0.0:1784044086.099351:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843c8b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68dfcea6-5d83-4dbb-8fa3-e35542d621e5+6:0:x1870705565120000:12345-192.168.202.40@tcp:41:mount.lustre.0 00000004:00000024:0.0:1784044086.099401:0:6511:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1784044086.099532:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843c8b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68dfcea6-5d83-4dbb-8fa3-e35542d621e5+6:0:x1870705565120000:12345-192.168.202.40@tcp:41:mount.lustre.0 Request processed in 182us (452us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044086.099541:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 21 00000100:00080000:2.0:1784044086.100195:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1784044086.106406:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044086.106457:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044086.106502:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044086.107501:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565120640 00000100:00100000:0.0:1784044086.107517:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565120640 00000100:00100000:0.0:1784044086.107594:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 5 00000100:00100000:0.0:1784044086.107603:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3975b8bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:68dfcea6-5d83-4dbb-8fa3-e35542d621e5+6:8739:x1870705565120640:12345-192.168.202.40@tcp:900:mount.lustre.0 00000100:00100000:0.0:1784044086.107703:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3975b8bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:68dfcea6-5d83-4dbb-8fa3-e35542d621e5+6:8739:x1870705565120640:12345-192.168.202.40@tcp:900:mount.lustre.0 Request processed in 101us (1313us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044086.107709:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 5 00000100:00100000:1.0:1784044086.109614:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565120384 00000100:00100000:1.0:1784044086.109630:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565120384 00000100:00100000:1.0:1784044086.109674:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565120512 00000100:00100000:1.0:1784044086.109677:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565120512 00000100:00100000:1.0:1784044086.109698:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 22 00000100:00100000:1.0:1784044086.109704:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39759b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2406:x1870705565120384:12345-192.168.202.40@tcp:8:mount.lustre.0 00010000:00080000:1.0:1784044086.109756:0:8427:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from 68dfcea6-5d83-4dbb-8fa3-e35542d621e5@192.168.202.40@tcp t0 exp 0000000000000000 cur 279 last 0 00000020:00000080:1.0:1784044086.109787:0:8427:0:(genops.c:1406:class_connect()) connect: client 68dfcea6-5d83-4dbb-8fa3-e35542d621e5, cookie 0x89871fc3aba18073 00002000:00100000:1.0:1784044086.109800:0:8427:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 68dfcea6-5d83-4dbb-8fa3-e35542d621e5/ffff9b397b802000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136a2 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1784044086.109820:0:8427:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return b7 00002000:00080000:1.0:1784044086.109916:0:8427:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1784044086.109950:0:8427:0:(import.c:65:import_set_state_nolock()) ffff9b397b805000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1784044086.110157:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 23 00000100:00100000:3.0:1784044086.110162:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39759b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2406:x1870705565120512:12345-192.168.202.40@tcp:8:mount.lustre.0 00010000:00080000:3.0:1784044086.110191:0:8428:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from 68dfcea6-5d83-4dbb-8fa3-e35542d621e5@192.168.202.40@tcp t0 exp 0000000000000000 cur 279 last 0 00000020:00000080:3.0:1784044086.110209:0:8428:0:(genops.c:1406:class_connect()) connect: client 68dfcea6-5d83-4dbb-8fa3-e35542d621e5, cookie 0x89871fc3aba1807a 00002000:00100000:3.0:1784044086.110212:0:8428:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 68dfcea6-5d83-4dbb-8fa3-e35542d621e5/ffff9b3843c36800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136a2 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1784044086.110232:0:8428:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return b7 00002000:00080000:3.0:1784044086.110268:0:8428:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1784044086.110279:0:8428:0:(import.c:65:import_set_state_nolock()) ffff9b3843c31800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1784044086.110342:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39759b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:68dfcea6-5d83-4dbb-8fa3-e35542d621e5+6:2406:x1870705565120512:12345-192.168.202.40@tcp:8:mount.lustre.0 Request processed in 177us (3839us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044086.110350:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 23 00000100:00100000:3.0:1784044086.110433:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044086.110568:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565120768 00000100:00100000:3.0:1784044086.110573:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565120768 00000100:00100000:3.0:1784044086.110606:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 1 00000100:00100000:3.0:1784044086.110612:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39759b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:68dfcea6-5d83-4dbb-8fa3-e35542d621e5+6:8739:x1870705565120768:12345-192.168.202.40@tcp:33:mount.lustre.0 00000004:00200000:3.0:1784044086.110691:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1784044086.110746:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39759b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:68dfcea6-5d83-4dbb-8fa3-e35542d621e5+6:8739:x1870705565120768:12345-192.168.202.40@tcp:33:mount.lustre.0 Request processed in 134us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044086.110751:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 1 00000100:00100000:1.0:1784044086.111009:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39759b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:68dfcea6-5d83-4dbb-8fa3-e35542d621e5+6:2406:x1870705565120384:12345-192.168.202.40@tcp:8:mount.lustre.0 Request processed in 1303us (4550us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044086.111014:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 22 00000100:00100000:1.0:1784044086.352982:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397f9dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1870705580924288:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1784044086.353091:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044086.353484:0:7768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580924288 00000100:00100000:3.0:1784044086.353495:0:7768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580924288 00000100:00100000:3.0:1784044086.353572:0:7768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1784044086.353583:0:7768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397f9e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1870705580924288:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1784044086.353622:0:7768:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1784044086.353691:0:7768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397f9e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1870705580924288:12345-0@lo:41:osp-pre-0-1.0 Request processed in 109us (599us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044086.353699:0:7768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1784044086.353801:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397f9dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1870705580924288:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1784044086.925620:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784044087.373970:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39759b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1870705580924416:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784044087.374088:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044087.374226:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580924416 00000100:00100000:3.0:1784044087.374235:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580924416 00000100:00100000:3.0:1784044087.374328:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1784044087.374340:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39759b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1870705580924416:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1784044087.374374:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784044087.374426:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39759b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1870705580924416:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (339us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044087.374435:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:3.0:1784044087.374474:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1784044087.374509:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b39759b6a00 x1870705580924416/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784044103 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784044087.374532:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39759b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1870705580924416:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784044087.374885:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397f9e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1870705580924672:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1784044087.374923:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044087.374961:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580924672 00000100:00100000:1.0:1784044087.374966:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580924672 00000100:00100000:1.0:1784044087.375001:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1784044087.375007:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397f9e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1870705580924672:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1784044087.375038:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1784044087.375079:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397f9e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1870705580924672:12345-0@lo:41:osp-pre-1-0.0 Request processed in 71us (154us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044087.375085:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1784044087.375113:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397f9e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1870705580924544:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1784044087.375154:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044087.375208:0:10713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580924544 00000100:00100000:1.0:1784044087.375212:0:10713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580924544 00000100:00100000:1.0:1784044087.375265:0:10713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1784044087.375273:0:10713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397f9e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1870705580924544:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1784044087.375286:0:10713:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784044087.375318:0:10713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397f9e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1870705580924544:12345-0@lo:13:osp-pre-0-1.0 Request processed in 46us (163us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044087.375324:0:10713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00080000:1.0:1784044087.375339:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784044087.375361:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397f9e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1870705580924672:0@lo:41:osp-pre-1-0.0 00010000:00080000:1.0:1784044087.375387:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b397f9e2d80 x1870705580924544/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784044103 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784044087.375400:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397f9e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1870705580924544:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1784044087.952354:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784044088.399557:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397f9e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1870705580924800:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1784044088.399666:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044088.399773:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580924800 00000100:00100000:1.0:1784044088.399783:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580924800 00000100:00100000:1.0:1784044088.399858:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1784044088.399869:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397bdfa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1870705580924800:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1784044088.399909:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784044088.399960:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397bdfa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1870705580924800:12345-0@lo:13:osp-pre-1-1.0 Request processed in 93us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044088.399968:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00080000:1.0:1784044088.400210:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1784044088.400268:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b397f9e2d80 x1870705580924800/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784044104 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784044088.400291:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397f9e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1870705580924800:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1784044088.406352:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397f9e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:3640:1870705580924928:0@lo:400:kworker.0 00000100:00100000:1.0:1784044088.406465:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044088.406519:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397f9e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1870705580925440:0@lo:400:kworker.0 00000100:00100000:1.0:1784044088.406552:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044088.406574:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397f9e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1870705580925952:0@lo:400:kworker.0 00000100:00100000:1.0:1784044088.406603:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044088.407016:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1784044088.407023:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397f9e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1870705580925056:0@lo:400:kworker.0 00000100:00100000:1.0:1784044088.407050:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044088.407070:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397f9e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1870705580925568:0@lo:400:kworker.0 00000100:00100000:1.0:1784044088.407099:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044088.407120:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397f9e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3640:1870705580926080:0@lo:400:kworker.0 00000100:00100000:1.0:1784044088.407141:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044088.407206:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580924928 00000100:00100000:1.0:1784044088.407215:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580924928 00000100:00100000:1.0:1784044088.407277:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 309 00000100:00100000:1.0:1784044088.407287:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3970edf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+24:3640:x1870705580924928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044088.407349:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3970edf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+24:3640:x1870705580924928:12345-0@lo:400:kworker.0 Request processed in 63us (884us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044088.407357:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 309 00000100:00100000:1.0:1784044088.407398:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580925440 00000100:00100000:1.0:1784044088.407402:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580925440 00000100:00100000:1.0:1784044088.409477:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1784044088.409497:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397f9e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1870705580925440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044088.409602:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397f9e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1870705580925440:12345-0@lo:400:kworker.0 Request processed in 112us (3048us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044088.409875:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1784044088.409922:0:9501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580925952 00000100:00100000:1.0:1784044088.409931:0:9501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580925952 00000100:00100000:1.0:1784044088.409993:0:9501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580925056 00000100:00100000:1.0:1784044088.409997:0:9501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580925056 00000100:00100000:1.0:1784044088.410011:0:9501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580926080 00000100:00100000:1.0:1784044088.410013:0:9501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580926080 00000100:00100000:1.0:1784044088.410027:0:9501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1784044088.410032:0:9501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397f9e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1870705580925952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044088.410069:0:9501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397f9e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1870705580925952:12345-0@lo:400:kworker.0 Request processed in 36us (3465us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044088.410075:0:9501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1784044088.410086:0:9501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1784044088.410091:0:9501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397f9e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1870705580925056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044088.410117:0:9501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397f9e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1870705580925056:12345-0@lo:400:kworker.0 Request processed in 26us (3066us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044088.410123:0:9501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1784044088.410133:0:9501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1784044088.410138:0:9501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3975b88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1870705580926080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044088.410163:0:9501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3975b88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1870705580926080:12345-0@lo:400:kworker.0 Request processed in 25us (3022us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044088.410168:0:9501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1784044088.410213:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580925568 00000100:00100000:1.0:1784044088.410224:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580925568 00000100:00100000:1.0:1784044088.410260:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1784044088.410267:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3975b8a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1870705580925568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044088.410301:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3975b8a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1870705580925568:12345-0@lo:400:kworker.0 Request processed in 34us (3201us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044088.410308:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1784044088.410362:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397f9e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1870705580925184:0@lo:400:kworker.0 00000100:00100000:1.0:1784044088.410407:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044088.410453:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397f9e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1870705580925696:0@lo:400:kworker.0 00000100:00100000:1.0:1784044088.410478:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044088.410495:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397f9e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3638:1870705580926208:0@lo:400:kworker.0 00000100:00100000:1.0:1784044088.410516:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044088.410536:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1784044088.410542:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397f9e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1870705580925312:0@lo:400:kworker.0 00000100:00100000:1.0:1784044088.410564:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044088.410581:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397f9e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1870705580925824:0@lo:400:kworker.0 00000100:00100000:1.0:1784044088.410604:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044088.410637:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397f9e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1870705580926336:0@lo:400:kworker.0 00000100:00100000:1.0:1784044088.410657:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044088.410687:0:7768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580925184 00000100:00100000:1.0:1784044088.410691:0:7768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580925184 00000100:00100000:1.0:1784044088.410716:0:7768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1784044088.410722:0:7768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3975b88a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1870705580925184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044088.410769:0:7768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3975b88a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1870705580925184:12345-0@lo:400:kworker.0 Request processed in 47us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044088.410775:0:7768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1784044088.417753:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580926208 00000100:00100000:3.0:1784044088.417782:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580926208 00000100:00100000:3.0:1784044088.417860:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580925312 00000100:00100000:3.0:1784044088.417863:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580925312 00000100:00100000:3.0:1784044088.418398:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580925824 00000100:00100000:3.0:1784044088.418403:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580925824 00000100:00100000:3.0:1784044088.418435:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1784044088.418462:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397f9ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1870705580926208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044088.418593:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397f9ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1870705580926208:12345-0@lo:400:kworker.0 Request processed in 134us (8075us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044088.418601:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1784044088.418623:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1784044088.418630:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843caf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1870705580925312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044088.418660:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843caf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1870705580925312:12345-0@lo:400:kworker.0 Request processed in 31us (8096us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044088.418667:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1784044088.418681:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1784044088.418687:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843cad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1870705580925824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044088.418715:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843cad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1870705580925824:12345-0@lo:400:kworker.0 Request processed in 29us (8111us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044088.418721:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00080000:3.0:1784044088.418743:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1784044088.418750:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1784044088.418789:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39759b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1870705580926464:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784044088.418836:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044088.422115:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397f9e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1870705580925056:0@lo:400:kworker.0 00010000:00080000:3.0:1784044088.422167:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b397f9e2a00 x1870705580925568/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784044104 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784044088.423032:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397f9e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1870705580925568:0@lo:400:kworker.0 00000100:00100000:3.0:1784044088.423061:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397f9e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3640:1870705580926080:0@lo:400:kworker.0 00000100:00100000:3.0:1784044088.423073:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397f9e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:3640:1870705580924928:0@lo:400:kworker.0 00000100:00100000:3.0:1784044088.423085:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397f9e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1870705580925440:0@lo:400:kworker.0 00010000:00080000:3.0:1784044088.423100:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b397f9e2300 x1870705580925952/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044104 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784044088.423110:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397f9e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1870705580925952:0@lo:400:kworker.0 00000100:00100000:1.0:1784044088.426968:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580926464 00000100:00100000:1.0:1784044088.426990:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580926464 00000100:00100000:1.0:1784044088.427078:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1784044088.427090:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39759b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1870705580926464:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1784044088.427121:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784044088.427240:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39759b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1870705580926464:12345-0@lo:13:osp-pre-1-0.0 Request processed in 153us (8403us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044088.427248:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1784044088.427278:0:9822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580925696 00000100:00100000:1.0:1784044088.427282:0:9822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580925696 00000100:00100000:1.0:1784044088.427304:0:9822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580926336 00000100:00100000:1.0:1784044088.427307:0:9822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580926336 00000100:00100000:1.0:1784044088.427323:0:9822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1784044088.427328:0:9822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3975b88380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3638:x1870705580925696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044088.427365:0:9822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3975b88380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3638:x1870705580925696:12345-0@lo:400:kworker.0 Request processed in 36us (16885us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044088.427371:0:9822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1784044088.427383:0:9822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1784044088.427388:0:9822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843cadc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3638:x1870705580926336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044088.427415:0:9822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843cadc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3638:x1870705580926336:12345-0@lo:400:kworker.0 Request processed in 27us (16756us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044088.427421:0:9822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:3.0:1784044088.428036:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784044088.428205:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397f9e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1870705580925312:0@lo:400:kworker.0 00000100:00100000:1.0:1784044088.428224:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397f9e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1870705580925824:0@lo:400:kworker.0 00010000:00080000:1.0:1784044088.428239:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b397f9e0700 x1870705580926336/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784044104 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00080000:2.0:1784044088.428251:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b39759b6a00 x1870705580926464/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784044104 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784044088.428266:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397f9e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1870705580926336:0@lo:400:kworker.0 00000100:00100000:2.0:1784044088.428278:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39759b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1870705580926464:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784044088.428282:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397f9e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1870705580925184:0@lo:400:kworker.0 00010000:00080000:1.0:1784044088.428292:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b397f9e0e00 x1870705580925696/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784044104 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784044088.428299:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397f9e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1870705580925696:0@lo:400:kworker.0 00010000:00080000:1.0:1784044088.428311:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b397f9e1f80 x1870705580926208/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044104 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784044088.428320:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397f9e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3638:1870705580926208:0@lo:400:kworker.0 00010000:00010000:2.0:1784044088.983571:0:10331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784044089.997659:0:10330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784044091.023850:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784044091.118835:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044091.118883:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044091.118913:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044091.118937:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044091.118960:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044091.118975:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044091.118997:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044091.119027:0:9501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565121152 00000100:00100000:3.0:1784044091.119036:0:9501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565121152 00000100:00100000:3.0:1784044091.119087:0:9501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565121408 00000100:00100000:3.0:1784044091.119091:0:9501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565121408 00000100:00100000:3.0:1784044091.119103:0:9501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565121024 00000100:00100000:3.0:1784044091.119105:0:9501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565121024 00000100:00100000:3.0:1784044091.119115:0:9501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565121280 00000100:00100000:3.0:1784044091.119117:0:9501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565121280 00000100:00100000:3.0:1784044091.119130:0:9501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 144 00000100:00100000:3.0:1784044091.119139:0:9501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39759b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a93fdf3c-d42f-420a-95ea-b0cbfe954363+5:2409:x1870705565121152:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:3.0:1784044091.119259:0:9501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39759b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a93fdf3c-d42f-420a-95ea-b0cbfe954363+5:2409:x1870705565121152:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 120us (375us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044091.119278:0:9501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 144 00000100:00100000:3.0:1784044091.119296:0:9501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 145 00000100:00100000:3.0:1784044091.119303:0:9501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39759b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68dfcea6-5d83-4dbb-8fa3-e35542d621e5+6:2409:x1870705565121408:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:3.0:1784044091.119330:0:9501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39759b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68dfcea6-5d83-4dbb-8fa3-e35542d621e5+6:2409:x1870705565121408:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 27us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044091.119336:0:9501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 145 00000100:00100000:3.0:1784044091.119348:0:9501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 146 00000100:00100000:3.0:1784044091.119353:0:9501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39759b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a93fdf3c-d42f-420a-95ea-b0cbfe954363+6:2409:x1870705565121024:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:3.0:1784044091.119376:0:9501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39759b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a93fdf3c-d42f-420a-95ea-b0cbfe954363+6:2409:x1870705565121024:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 22us (415us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044091.119381:0:9501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 146 00000100:00100000:3.0:1784044091.119392:0:9501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 147 00000100:00100000:3.0:1784044091.119398:0:9501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39759b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68dfcea6-5d83-4dbb-8fa3-e35542d621e5+6:2409:x1870705565121280:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:3.0:1784044091.119430:0:9501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39759b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68dfcea6-5d83-4dbb-8fa3-e35542d621e5+6:2409:x1870705565121280:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 32us (453us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044091.119436:0:9501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 147 00000100:00100000:3.0:1784044091.119453:0:9822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565121664 00000100:00100000:3.0:1784044091.119456:0:9822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565121664 00000100:00100000:3.0:1784044091.119482:0:9822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565121536 00000100:00100000:3.0:1784044091.119485:0:9822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565121536 00000100:00100000:3.0:1784044091.119519:0:9822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 51 00000100:00100000:3.0:1784044091.119526:0:9822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39759b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:68dfcea6-5d83-4dbb-8fa3-e35542d621e5+6:2409:x1870705565121664:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:3.0:1784044091.119557:0:9822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39759b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:68dfcea6-5d83-4dbb-8fa3-e35542d621e5+6:2409:x1870705565121664:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 33us (620us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044091.119563:0:9822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 51 00000100:00100000:3.0:1784044091.119574:0:9822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 52 00000100:00100000:3.0:1784044091.119579:0:9822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39759b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:68dfcea6-5d83-4dbb-8fa3-e35542d621e5+6:2409:x1870705565121536:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:3.0:1784044091.119598:0:9822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39759b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:68dfcea6-5d83-4dbb-8fa3-e35542d621e5+6:2409:x1870705565121536:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 19us (601us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044091.119603:0:9822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 52 00000100:00080000:3.0:1784044091.119627:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1784044091.119631:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1784044091.119633:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1784044091.119635:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1784044091.122704:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565120896 00000100:00100000:1.0:1784044091.122721:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565120896 00000100:00100000:1.0:1784044091.122785:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 310 00000100:00100000:1.0:1784044091.122795:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3970edd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4a09ad9-a185-4679-99bb-b6a07b865440+13:2409:x1870705565120896:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:1.0:1784044091.122866:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3970edd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4a09ad9-a185-4679-99bb-b6a07b865440+13:2409:x1870705565120896:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 71us (4040us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044091.122873:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 310 00000100:00100000:2.0:1784044091.469702:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784044091.472634:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397f9ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1870705580926592:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1784044091.472713:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044091.476084:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580926592 00000100:00100000:1.0:1784044091.476097:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580926592 00000100:00100000:1.0:1784044091.476183:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1784044091.476192:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843c88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1870705580926592:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1784044091.476227:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1784044091.476332:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843c88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1870705580926592:12345-0@lo:41:osp-pre-0-1.0 Request processed in 140us (3619us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044091.476339:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1784044091.476788:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397f9ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1870705580926592:0@lo:41:osp-pre-0-1.0 00000001:00100000:2.0:1784044091.994275:0:9505:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 68dfcea6-5d83-4dbb-8fa3-e35542d621e5 00000001:00100000:3.0:1784044091.994574:0:7443:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 68dfcea6-5d83-4dbb-8fa3-e35542d621e5 00000001:00100000:2.0:1784044091.994814:0:6490:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 68dfcea6-5d83-4dbb-8fa3-e35542d621e5 00000001:00100000:0.0:1784044091.994899:0:8421:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 68dfcea6-5d83-4dbb-8fa3-e35542d621e5 00010000:00010000:0.0:1784044092.045400:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784044092.493572:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1784044092.493598:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843cace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1870705580926848:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1784044092.493672:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044092.493704:0:10713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580926848 00000100:00100000:1.0:1784044092.493711:0:10713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580926848 00000100:00100000:3.0:1784044092.493721:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397f9e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1870705580926720:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784044092.493744:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044092.493760:0:10713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580926720 00000100:00100000:1.0:1784044092.493763:0:10713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580926720 00000100:00100000:1.0:1784044092.493780:0:10713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00080000:3.0:1784044092.493786:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784044092.493788:0:10713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397f9e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1870705580926848:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1784044092.493803:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1784044092.493810:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397f9e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1870705580926720:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1784044092.493817:0:10713:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00002000:00000024:3.0:1784044092.493818:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784044092.493860:0:10713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397f9e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1870705580926848:12345-0@lo:13:osp-pre-0-1.0 Request processed in 73us (188us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044092.493867:0:10713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1784044092.494799:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1784044092.494812:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843c88700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1870705580926976:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1784044092.494853:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044092.494886:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580926976 00000100:00100000:2.0:1784044092.494891:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580926976 00000100:00100000:2.0:1784044092.494926:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1784044092.494933:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843c8b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1870705580926976:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1784044092.494960:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1784044092.494998:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843c8b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1870705580926976:12345-0@lo:41:osp-pre-1-0.0 Request processed in 65us (144us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044092.495004:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1784044092.495055:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843c88700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1870705580926976:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1784044092.496579:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397f9e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1870705580926720:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2754us (2819us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044092.496610:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00010000:00080000:1.0:1784044092.501926:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b3843cace00 x1870705580926848/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784044108 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784044092.501952:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843cace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1870705580926848:0@lo:13:osp-pre-0-1.0 00010000:00080000:1.0:1784044092.501977:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b397f9e1f80 x1870705580926720/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784044108 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784044092.501989:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397f9e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1870705580926720:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1784044093.079118:0:10331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784044093.518217:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784044093.518243:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397f9e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1870705580927104:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784044093.518313:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044093.518574:0:10713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580927104 00000100:00100000:3.0:1784044093.518584:0:10713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580927104 00000100:00100000:3.0:1784044093.518663:0:10713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1784044093.518674:0:10713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397f9df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1870705580927104:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1784044093.518707:0:10713:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784044093.518755:0:10713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397f9df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1870705580927104:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (442us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044093.518761:0:10713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00010000:00080000:0.0:1784044093.519041:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b397f9e0700 x1870705580927104/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784044109 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784044093.519071:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397f9e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1870705580927104:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1784044093.519302:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784044093.520192:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784044093.520210:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397f9dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1870705580927232:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1784044093.520259:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044093.520302:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580927232 00000100:00100000:0.0:1784044093.520317:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580927232 00000100:00100000:0.0:1784044093.520367:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1784044093.520375:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397f9de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1870705580927232:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1784044093.520402:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784044093.520444:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397f9de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1870705580927232:12345-0@lo:13:osp-pre-1-1.0 Request processed in 69us (183us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044093.520451:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00010000:00080000:0.0:1784044093.520482:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b397f9dd880 x1870705580927232/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784044109 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784044093.520498:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397f9dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1870705580927232:0@lo:13:osp-pre-1-1.0 00000100:00080000:3.0:1784044093.528108:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784044093.532943:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843c88700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:3639:1870705580927360:0@lo:400:kworker.0 00000100:00100000:2.0:1784044093.533035:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044093.535094:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843c8a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1870705580927488:0@lo:400:kworker.0 00000100:00100000:2.0:1784044093.535161:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044093.535427:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843c89f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1870705580927616:0@lo:400:kworker.0 00000100:00100000:2.0:1784044093.535458:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044093.535498:0:7768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580927616 00000100:00100000:2.0:1784044093.535506:0:7768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580927616 00000100:00100000:2.0:1784044093.535554:0:7768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1784044093.535563:0:7768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843c88380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1870705580927616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784044093.535618:0:7768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843c88380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1870705580927616:12345-0@lo:400:kworker.0 Request processed in 55us (159us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044093.535626:0:7768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1784044093.535669:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843c89f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1870705580927616:0@lo:400:kworker.0 00000100:00100000:2.0:1784044093.535705:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1784044093.535712:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843c89f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3639:1870705580927744:0@lo:400:kworker.0 00000100:00100000:2.0:1784044093.535735:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044093.535764:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580927488 00000100:00100000:2.0:1784044093.535768:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580927488 00000100:00100000:2.0:1784044093.535794:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580927744 00000100:00100000:2.0:1784044093.535798:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580927744 00000100:00100000:2.0:1784044093.535818:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1784044093.535824:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843c8b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1870705580927488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784044093.535860:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843c8b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1870705580927488:12345-0@lo:400:kworker.0 Request processed in 35us (699us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044093.535885:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1784044093.535899:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1784044093.535905:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843c89c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1870705580927744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784044093.535937:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843c89c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1870705580927744:12345-0@lo:400:kworker.0 Request processed in 32us (201us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044093.535943:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1784044093.535968:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843c8a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1870705580927488:0@lo:400:kworker.0 00000100:00100000:2.0:1784044093.535983:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843c89f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3639:1870705580927744:0@lo:400:kworker.0 00000100:00100000:2.0:1784044093.537432:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843c89f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1870705580927872:0@lo:400:kworker.0 00000100:00100000:2.0:1784044093.537485:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044093.537541:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580927872 00000100:00100000:2.0:1784044093.537547:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580927872 00000100:00100000:2.0:1784044093.537582:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1784044093.537589:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843c8a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1870705580927872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784044093.537635:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843c8a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1870705580927872:12345-0@lo:400:kworker.0 Request processed in 46us (149us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044093.537642:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1784044093.537675:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843c89f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1870705580927872:0@lo:400:kworker.0 00000100:00100000:2.0:1784044093.537718:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843c89f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1870705580928000:0@lo:400:kworker.0 00000100:00100000:2.0:1784044093.537742:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044093.537773:0:9822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580928000 00000100:00100000:2.0:1784044093.537776:0:9822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580928000 00000100:00100000:2.0:1784044093.537803:0:9822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1784044093.537810:0:9822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843c89180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3640:x1870705580928000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784044093.537858:0:9822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843c89180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3640:x1870705580928000:12345-0@lo:400:kworker.0 Request processed in 48us (114us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044093.537864:0:9822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:2.0:1784044093.537892:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b3843c89f80 x1870705580928000/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784044109 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784044093.537902:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843c89f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1870705580928000:0@lo:400:kworker.0 00000100:00100000:2.0:1784044093.537935:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843c89f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1870705580928128:0@lo:400:kworker.0 00000100:00100000:2.0:1784044093.537957:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044093.537984:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580928128 00000100:00100000:2.0:1784044093.537987:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580928128 00000100:00100000:0.0:1784044093.539419:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580927360 00000100:00100000:0.0:1784044093.539431:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580927360 00000100:00100000:0.0:1784044093.539476:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 311 00000100:00100000:0.0:1784044093.539484:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3970edf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+24:3639:x1870705580927360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784044093.539554:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3970edf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+24:3639:x1870705580927360:12345-0@lo:400:kworker.0 Request processed in 70us (6518us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044093.539560:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 311 00000100:00100000:0.0:1784044093.539620:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843c88700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:3639:1870705580927360:0@lo:400:kworker.0 00000100:00100000:2.0:1784044093.541471:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1784044093.541492:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843c8bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1870705580928128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784044093.541580:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843c8bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1870705580928128:12345-0@lo:400:kworker.0 Request processed in 98us (3621us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044093.541588:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00010000:00080000:0.0:1784044093.551937:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b3843c89f80 x1870705580928128/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784044109 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784044093.551957:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843c89f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1870705580928128:0@lo:400:kworker.0 00000100:00100000:1.0:1784044093.563608:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843c8aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1870705580928256:0@lo:400:kworker.0 00000100:00100000:1.0:1784044093.563681:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044093.564322:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580928256 00000100:00100000:0.0:1784044093.564330:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580928256 00000100:00100000:0.0:1784044093.564411:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1784044093.564422:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843cace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1870705580928256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784044093.567884:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843c88e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3639:1870705580928384:0@lo:400:kworker.0 00000100:00100000:2.0:1784044093.567969:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044093.575130:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580928384 00000100:00100000:2.0:1784044093.575151:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580928384 00000100:00100000:2.0:1784044093.575237:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1784044093.575250:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843c89f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1870705580928384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784044093.575599:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843c89f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1870705580928384:12345-0@lo:400:kworker.0 Request processed in 353us (7628us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044093.575608:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00010000:00080000:2.0:1784044093.575662:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b3843c88e00 x1870705580928384/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044109 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784044093.575690:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843c88e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3639:1870705580928384:0@lo:400:kworker.0 00000100:00100000:2.0:1784044093.575755:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843c88e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3640:1870705580928512:0@lo:400:kworker.0 00000100:00100000:2.0:1784044093.575790:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044093.575822:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580928512 00000100:00100000:2.0:1784044093.575826:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580928512 00000100:00100000:2.0:1784044093.575853:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1784044093.575859:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843c88700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1870705580928512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784044093.575893:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843c88700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1870705580928512:12345-0@lo:400:kworker.0 Request processed in 33us (102us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044093.575898:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1784044093.575923:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843c88e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3640:1870705580928512:0@lo:400:kworker.0 00000100:00100000:2.0:1784044093.575956:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843c88e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3641:1870705580928640:0@lo:400:kworker.0 00000100:00100000:2.0:1784044093.575994:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044093.576020:0:9501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580928640 00000100:00100000:2.0:1784044093.576023:0:9501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580928640 00000100:00100000:2.0:1784044093.576120:0:9501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1784044093.576127:0:9501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843caad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1870705580928640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784044093.576290:0:9501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843caad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1870705580928640:12345-0@lo:400:kworker.0 Request processed in 163us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044093.576296:0:9501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00010000:00080000:2.0:1784044093.576323:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b3843c88e00 x1870705580928640/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044109 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784044093.576341:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843cace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1870705580928256:12345-0@lo:400:kworker.0 Request processed in 11921us (12659us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044093.576349:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00080000:0.0:1784044093.576405:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1784044093.576408:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784044093.576494:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843c88e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3641:1870705580928640:0@lo:400:kworker.0 00000100:00100000:1.0:1784044093.585785:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843c8aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1870705580928256:0@lo:400:kworker.0 00010000:00010000:1.0:1784044094.093421:0:10330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1784044094.197558:0:12182:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg240-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:1.0:1784044095.132274:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784044096.147080:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784044096.239074:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044096.239114:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044096.239148:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044096.239197:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044096.239221:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044096.239239:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044096.239260:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044096.239305:0:9822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565122432 00000100:00100000:0.0:1784044096.239314:0:9822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565122432 00000100:00100000:0.0:1784044096.239379:0:9822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565122560 00000100:00100000:0.0:1784044096.239382:0:9822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565122560 00000100:00100000:0.0:1784044096.239409:0:9822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 55 00000100:00100000:0.0:1784044096.239419:0:9822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397f9dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:68dfcea6-5d83-4dbb-8fa3-e35542d621e5+5:2407:x1870705565122432:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:0.0:1784044096.239498:0:9822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397f9dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:68dfcea6-5d83-4dbb-8fa3-e35542d621e5+5:2407:x1870705565122432:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 81us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044096.239507:0:9822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 55 00000100:00100000:0.0:1784044096.239525:0:9822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 56 00000100:00100000:0.0:1784044096.239531:0:9822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397f9dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:68dfcea6-5d83-4dbb-8fa3-e35542d621e5+5:2407:x1870705565122560:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:0.0:1784044096.239559:0:9822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397f9dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:68dfcea6-5d83-4dbb-8fa3-e35542d621e5+5:2407:x1870705565122560:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 28us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044096.239576:0:9822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 56 00000100:00100000:0.0:1784044096.239596:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565121920 00000100:00100000:0.0:1784044096.239600:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565121920 00000100:00100000:0.0:1784044096.239622:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565122176 00000100:00100000:0.0:1784044096.239625:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565122176 00000100:00100000:0.0:1784044096.239637:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565122048 00000100:00100000:0.0:1784044096.239639:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565122048 00000100:00100000:0.0:1784044096.239653:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565122304 00000100:00100000:0.0:1784044096.239656:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565122304 00000100:00100000:0.0:1784044096.239670:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 154 00000100:00100000:0.0:1784044096.239676:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397f9dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+6:2407:x1870705565121920:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:0.0:1784044096.239704:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397f9dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+6:2407:x1870705565121920:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 28us (638us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044096.239711:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 154 00000100:00100000:0.0:1784044096.239724:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 155 00000100:00100000:0.0:1784044096.239729:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397f9ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68dfcea6-5d83-4dbb-8fa3-e35542d621e5+5:2407:x1870705565122176:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:0.0:1784044096.239751:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397f9ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68dfcea6-5d83-4dbb-8fa3-e35542d621e5+5:2407:x1870705565122176:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 22us (637us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044096.239757:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 155 00000100:00100000:0.0:1784044096.239767:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 156 00000100:00100000:0.0:1784044096.239772:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397f9ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+5:2407:x1870705565122048:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:0.0:1784044096.239794:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397f9ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+5:2407:x1870705565122048:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 22us (572us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044096.239799:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 156 00000100:00100000:0.0:1784044096.239811:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 157 00000100:00100000:0.0:1784044096.239825:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397f9dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68dfcea6-5d83-4dbb-8fa3-e35542d621e5+5:2407:x1870705565122304:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:0.0:1784044096.239850:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397f9dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68dfcea6-5d83-4dbb-8fa3-e35542d621e5+5:2407:x1870705565122304:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 26us (611us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044096.239856:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 157 00000100:00080000:0.0:1784044096.239881:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1784044096.239885:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1784044096.239888:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784044096.239890:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784044096.240158:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565121792 00000100:00100000:1.0:1784044096.240164:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565121792 00000100:00100000:1.0:1784044096.240227:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 312 00000100:00100000:1.0:1784044096.240241:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3970ede050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4a09ad9-a185-4679-99bb-b6a07b865440+13:2407:x1870705565121792:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:1.0:1784044096.240291:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3970ede050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4a09ad9-a185-4679-99bb-b6a07b865440+13:2407:x1870705565121792:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 51us (1093us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044096.240297:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 312 00000100:00100000:2.0:1784044096.599407:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397f9dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1870705580928768:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1784044096.600150:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044096.600318:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580928768 00000100:00100000:2.0:1784044096.600328:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580928768 00000100:00100000:2.0:1784044096.600401:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1784044096.600411:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843ca9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1870705580928768:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1784044096.600888:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1784044096.600960:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843ca9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1870705580928768:12345-0@lo:41:osp-pre-0-1.0 Request processed in 550us (811us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044096.600968:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1784044096.601121:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397f9dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1870705580928768:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1784044097.165604:0:10331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784044097.613620:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843cae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1870705580928896:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1784044097.613751:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044097.613867:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1784044097.613879:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397f9e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1870705580929024:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784044097.613925:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044097.614150:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580928896 00000100:00100000:0.0:1784044097.614159:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580928896 00000100:00100000:0.0:1784044097.614299:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580929024 00000100:00100000:0.0:1784044097.614303:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580929024 00000100:00100000:0.0:1784044097.614324:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1784044097.614332:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397f9dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1870705580928896:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1784044097.614375:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784044097.614434:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397f9dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1870705580928896:12345-0@lo:13:osp-pre-0-1.0 Request processed in 102us (682us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044097.614442:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1784044097.614459:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1784044097.614465:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397f9e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1870705580929024:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1784044097.614475:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784044097.614503:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397f9e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1870705580929024:12345-0@lo:13:osp-pre-0-0.0 Request processed in 39us (578us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044097.614509:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:0.0:1784044097.614529:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1784044097.614574:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b397f9e3480 x1870705580929024/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784044113 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784044097.614592:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397f9e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1870705580929024:0@lo:13:osp-pre-0-0.0 00010000:00080000:1.0:1784044097.614757:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b3843cae300 x1870705580928896/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784044113 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784044097.614771:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843cae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1870705580928896:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1784044097.616697:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843cae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1870705580929152:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1784044097.616830:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044097.616931:0:7768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580929152 00000100:00100000:1.0:1784044097.616938:0:7768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580929152 00000100:00100000:1.0:1784044097.616986:0:7768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1784044097.616996:0:7768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397f9e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1870705580929152:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1784044097.617028:0:7768:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1784044097.617081:0:7768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397f9e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1870705580929152:12345-0@lo:41:osp-pre-1-0.0 Request processed in 86us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044097.617088:0:7768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1784044097.617136:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843cae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1870705580929152:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1784044098.189435:0:10330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784044098.637632:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1784044098.637701:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397f9e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1870705580929408:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784044098.637775:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044098.637929:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580929408 00000100:00100000:2.0:1784044098.637939:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580929408 00000100:00100000:2.0:1784044098.638026:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1784044098.638036:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397f9e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1870705580929408:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1784044098.638069:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784044098.638115:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397f9e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1870705580929408:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044098.638122:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:3.0:1784044098.638199:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1784044098.638232:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b397f9e1c00 x1870705580929408/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784044114 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784044098.638251:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397f9e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1870705580929408:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784044098.638673:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3945930000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1870705580929536:0@lo:400:kworker.0 00000100:00100000:0.0:1784044098.638734:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044098.638759:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3945930e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1870705580930048:0@lo:400:kworker.0 00000100:00100000:0.0:1784044098.638783:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044098.638800:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b384316ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3640:1870705580930560:0@lo:400:kworker.0 00000100:00100000:0.0:1784044098.638820:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044098.638838:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1784044098.638844:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3945931f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1870705580929664:0@lo:400:kworker.0 00000100:00100000:0.0:1784044098.638884:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044098.638903:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3945932a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1870705580930176:0@lo:400:kworker.0 00000100:00100000:0.0:1784044098.638928:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044098.638944:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b384316fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3640:1870705580930688:0@lo:400:kworker.0 00000100:00100000:0.0:1784044098.638965:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044098.638996:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580929536 00000100:00100000:0.0:1784044098.639001:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580929536 00000100:00100000:3.0:1784044098.639114:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3945932d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:3639:1870705580929280:0@lo:400:kworker.0 00000100:00100000:3.0:1784044098.639146:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044098.639256:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580929664 00000100:00100000:1.0:1784044098.639260:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580929664 00000100:00100000:1.0:1784044098.639291:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1784044098.639299:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b384316c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1870705580929664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044098.639357:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b384316c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1870705580929664:12345-0@lo:400:kworker.0 Request processed in 48us (461us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044098.639364:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1784044098.639434:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3945931500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1870705580929792:0@lo:400:kworker.0 00000100:00100000:2.0:1784044098.639464:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044098.646395:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3945933480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1870705580929920:0@lo:400:kworker.0 00000100:00100000:3.0:1784044098.646664:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044098.646706:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b384316d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3639:1870705580930432:0@lo:400:kworker.0 00000100:00100000:3.0:1784044098.646735:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044098.646760:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843cae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1870705580930944:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1784044098.646782:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044098.646827:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580929280 00000100:00100000:3.0:1784044098.646835:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580929280 00000100:00100000:3.0:1784044098.646885:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 313 00000100:00100000:3.0:1784044098.646894:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3970edf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+24:3639:x1870705580929280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044098.646948:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3970edf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+24:3639:x1870705580929280:12345-0@lo:400:kworker.0 Request processed in 55us (7800us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044098.646955:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 313 00000100:00100000:3.0:1784044098.646988:0:10713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580930944 00000100:00100000:1.0:1784044098.647109:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580930560 00000100:00100000:1.0:1784044098.647121:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580930560 00000100:00100000:1.0:1784044098.647135:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580929920 00000100:00100000:1.0:1784044098.647138:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580929920 00000100:00100000:1.0:1784044098.647166:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1784044098.647188:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397f9e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1870705580929920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044098.647229:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397f9e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1870705580929920:12345-0@lo:400:kworker.0 Request processed in 55us (566us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044098.647234:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1784044098.647255:0:9822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580930048 00000100:00100000:1.0:1784044098.647259:0:9822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580930048 00000100:00100000:1.0:1784044098.647283:0:9822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580930176 00000100:00100000:1.0:1784044098.647286:0:9822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580930176 00000100:00100000:1.0:1784044098.647303:0:9822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1784044098.647308:0:9822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b384316d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3640:x1870705580930048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044098.647340:0:9822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b384316d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3640:x1870705580930048:12345-0@lo:400:kworker.0 Request processed in 31us (8556us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044098.647356:0:9822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1784044098.647368:0:9822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1784044098.647374:0:9822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b384316dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3640:x1870705580930176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044098.647403:0:9822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b384316dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3640:x1870705580930176:12345-0@lo:400:kworker.0 Request processed in 29us (8474us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044098.647409:0:9822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1784044098.647738:0:9501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580930688 00000100:00100000:0.0:1784044098.647744:0:9501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580930688 00000100:00100000:0.0:1784044098.647775:0:9501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580929792 00000100:00100000:0.0:1784044098.647778:0:9501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580929792 00000100:00100000:0.0:1784044098.647791:0:9501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580930432 00000100:00100000:0.0:1784044098.647794:0:9501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580930432 00000100:00100000:0.0:1784044098.647811:0:9501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1784044098.647817:0:9501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b384316ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1870705580929536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784044098.647870:0:9501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b384316ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1870705580929536:12345-0@lo:400:kworker.0 Request processed in 53us (9136us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044098.647877:0:9501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1784044098.647892:0:9501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1784044098.647898:0:9501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397bbbf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1870705580930688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784044098.647926:0:9501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397bbbf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1870705580930688:12345-0@lo:400:kworker.0 Request processed in 28us (8960us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044098.647932:0:9501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1784044098.647943:0:9501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1784044098.647948:0:9501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843cab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1870705580929792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784044098.647977:0:9501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843cab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1870705580929792:12345-0@lo:400:kworker.0 Request processed in 29us (8513us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044098.647983:0:9501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1784044098.648596:0:10713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580930944 00000100:00100000:3.0:1784044098.648649:0:10713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1784044098.648657:0:10713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397f9e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1870705580930944:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1784044098.648673:0:10713:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784044098.648714:0:10713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397f9e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1870705580930944:12345-0@lo:13:osp-pre-1-1.0 Request processed in 58us (1930us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044098.648720:0:10713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00080000:3.0:1784044098.648746:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1784044098.648750:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1784044098.648783:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b3843cae300 x1870705580930944/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784044114 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784044098.648804:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843cae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1870705580930944:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1784044098.648818:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3945932d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:3639:1870705580929280:0@lo:400:kworker.0 00000100:00100000:3.0:1784044098.648842:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3945933480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1870705580929920:0@lo:400:kworker.0 00000100:00100000:0.0:1784044098.649045:0:9501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1784044098.649053:0:9501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397f9e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1870705580930432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784044098.649092:0:9501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397f9e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1870705580930432:12345-0@lo:400:kworker.0 Request processed in 40us (2358us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044098.649098:0:9501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1784044098.649268:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3945931500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1870705580929792:0@lo:400:kworker.0 00000100:00100000:2.0:1784044098.649280:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3945930a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1870705580930304:0@lo:400:kworker.0 00000100:00100000:2.0:1784044098.649314:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044098.649341:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b384316f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1870705580930816:0@lo:400:kworker.0 00000100:00100000:2.0:1784044098.649377:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044098.649421:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580930304 00000100:00100000:2.0:1784044098.649437:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580930304 00000100:00100000:2.0:1784044098.649546:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1784044098.649556:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843ca8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1870705580930304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784044098.649592:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843ca8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1870705580930304:12345-0@lo:400:kworker.0 Request processed in 39us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044098.649599:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1784044098.649619:0:9822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580930816 00000100:00100000:2.0:1784044098.649622:0:9822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580930816 00000100:00100000:2.0:1784044098.649642:0:9822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1784044098.649648:0:9822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843caa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3638:x1870705580930816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784044098.649677:0:9822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843caa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3638:x1870705580930816:12345-0@lo:400:kworker.0 Request processed in 29us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044098.649683:0:9822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1784044098.649709:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3945930a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1870705580930304:0@lo:400:kworker.0 00010000:00080000:2.0:1784044098.649721:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b384316f480 x1870705580930816/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784044114 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784044098.649730:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b384316f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1870705580930816:0@lo:400:kworker.0 00000100:00100000:1.0:1784044098.650110:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3945931f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1870705580929664:0@lo:400:kworker.0 00010000:00080000:1.0:1784044098.650123:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b3945932a00 x1870705580930176/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784044114 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784044098.650132:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3945932a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1870705580930176:0@lo:400:kworker.0 00010000:00080000:1.0:1784044098.650143:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b384316fb80 x1870705580930688/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044114 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784044098.650162:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b384316fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3640:1870705580930688:0@lo:400:kworker.0 00000100:00100000:1.0:1784044098.650214:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3945930000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1870705580929536:0@lo:400:kworker.0 00010000:00080000:1.0:1784044098.650228:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b3945930e00 x1870705580930048/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784044114 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784044098.650237:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3945930e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1870705580930048:0@lo:400:kworker.0 00000100:00100000:1.0:1784044098.650304:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1784044098.650311:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b384316ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1870705580930560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044098.650368:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b384316ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1870705580930560:12345-0@lo:400:kworker.0 Request processed in 57us (11547us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044098.650374:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1784044098.650399:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b384316ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3640:1870705580930560:0@lo:400:kworker.0 00000100:00080000:3.0:1784044098.651127:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1784044098.651160:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b384316d500 x1870705580930432/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044114 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784044098.651194:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b384316d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3639:1870705580930432:0@lo:400:kworker.0 00010000:00010000:1.0:1784044099.216657:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784044100.254955:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784044101.272542:0:10331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784044101.349638:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044101.349679:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044101.349711:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044101.349735:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044101.349752:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044101.349768:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044101.349793:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044101.349859:0:9501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565122816 00000100:00100000:2.0:1784044101.349868:0:9501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565122816 00000100:00100000:2.0:1784044101.349924:0:9501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565123072 00000100:00100000:2.0:1784044101.349928:0:9501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565123072 00000100:00100000:2.0:1784044101.349942:0:9501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565122944 00000100:00100000:2.0:1784044101.349945:0:9501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565122944 00000100:00100000:2.0:1784044101.349957:0:9501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565123200 00000100:00100000:2.0:1784044101.349979:0:9501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565123200 00000100:00100000:2.0:1784044101.350003:0:9501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 164 00000100:00100000:2.0:1784044101.350012:0:9501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397f9e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a93fdf3c-d42f-420a-95ea-b0cbfe954363+6:2409:x1870705565122816:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:2.0:1784044101.350087:0:9501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397f9e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a93fdf3c-d42f-420a-95ea-b0cbfe954363+6:2409:x1870705565122816:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 75us (458us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044101.350094:0:9501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 164 00000100:00100000:2.0:1784044101.350112:0:9501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 165 00000100:00100000:2.0:1784044101.350118:0:9501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397f9e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68dfcea6-5d83-4dbb-8fa3-e35542d621e5+5:2409:x1870705565123072:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:2.0:1784044101.350144:0:9501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397f9e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68dfcea6-5d83-4dbb-8fa3-e35542d621e5+5:2409:x1870705565123072:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 26us (464us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044101.350150:0:9501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 165 00000100:00100000:2.0:1784044101.350161:0:9501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 166 00000100:00100000:2.0:1784044101.350167:0:9501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397f9e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a93fdf3c-d42f-420a-95ea-b0cbfe954363+5:2409:x1870705565122944:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:2.0:1784044101.350219:0:9501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397f9e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a93fdf3c-d42f-420a-95ea-b0cbfe954363+5:2409:x1870705565122944:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 53us (466us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044101.350225:0:9501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 166 00000100:00100000:2.0:1784044101.350237:0:9501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 167 00000100:00100000:2.0:1784044101.350243:0:9501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3945930e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68dfcea6-5d83-4dbb-8fa3-e35542d621e5+5:2409:x1870705565123200:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:2.0:1784044101.350264:0:9501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3945930e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68dfcea6-5d83-4dbb-8fa3-e35542d621e5+5:2409:x1870705565123200:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 21us (495us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044101.350269:0:9501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 167 00000100:00100000:2.0:1784044101.350289:0:9822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565123328 00000100:00100000:2.0:1784044101.350292:0:9822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565123328 00000100:00100000:2.0:1784044101.350318:0:9822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565123456 00000100:00100000:2.0:1784044101.350338:0:9822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565123456 00000100:00100000:2.0:1784044101.350362:0:9822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 60 00000100:00100000:2.0:1784044101.350369:0:9822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397f9e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:68dfcea6-5d83-4dbb-8fa3-e35542d621e5+5:2409:x1870705565123328:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:2.0:1784044101.350395:0:9822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397f9e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:68dfcea6-5d83-4dbb-8fa3-e35542d621e5+5:2409:x1870705565123328:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 27us (684us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044101.350401:0:9822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 60 00000100:00100000:2.0:1784044101.350412:0:9822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 61 00000100:00100000:2.0:1784044101.350417:0:9822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3945930000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:68dfcea6-5d83-4dbb-8fa3-e35542d621e5+5:2409:x1870705565123456:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:2.0:1784044101.350438:0:9822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3945930000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:68dfcea6-5d83-4dbb-8fa3-e35542d621e5+5:2409:x1870705565123456:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 20us (644us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044101.350443:0:9822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 61 00000100:00100000:0.0:1784044101.350824:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565122688 00000100:00100000:0.0:1784044101.350830:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565122688 00000100:00100000:0.0:1784044101.350862:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 314 00000100:00100000:0.0:1784044101.350869:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3970edd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4a09ad9-a185-4679-99bb-b6a07b865440+13:2409:x1870705565122688:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:0.0:1784044101.350905:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3970edd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4a09ad9-a185-4679-99bb-b6a07b865440+13:2409:x1870705565122688:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 37us (1168us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044101.350922:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 314 00000100:00080000:3.0:1784044101.351348:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1784044101.351353:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1784044101.351356:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1784044101.351358:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784044101.720406:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1784044101.720434:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3945932a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1870705580931072:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1784044101.720530:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044101.722016:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580931072 00000100:00100000:2.0:1784044101.722027:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580931072 00000100:00100000:2.0:1784044101.722242:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1784044101.722284:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3945931f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1870705580931072:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1784044101.722336:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1784044101.722428:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3945931f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1870705580931072:12345-0@lo:41:osp-pre-0-1.0 Request processed in 177us (1898us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044101.722436:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1784044101.724404:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3945932a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1870705580931072:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1784044102.285626:0:10330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784044102.735387:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3945930a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1870705580931200:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784044102.735460:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044102.735812:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843caf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1870705580931328:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1784044102.735841:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044102.737050:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784044102.737066:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843caaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1870705580931456:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1784044102.737112:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044102.737213:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580931456 00000100:00100000:2.0:1784044102.737221:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580931456 00000100:00100000:2.0:1784044102.737290:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1784044102.737301:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843cad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1870705580931456:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1784044102.737389:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1784044102.737436:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843cad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1870705580931456:12345-0@lo:41:osp-pre-1-0.0 Request processed in 136us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044102.737444:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1784044102.738345:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843caaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1870705580931456:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1784044102.740548:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580931200 00000100:00100000:3.0:1784044102.740570:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580931200 00000100:00100000:3.0:1784044102.740630:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580931328 00000100:00100000:3.0:1784044102.740633:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580931328 00000100:00100000:3.0:1784044102.740660:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1784044102.740670:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843ca9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1870705580931200:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1784044102.740705:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784044102.740800:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843ca9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1870705580931200:12345-0@lo:13:osp-pre-0-0.0 Request processed in 132us (5338us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044102.740808:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1784044102.740828:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1784044102.740835:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843caf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1870705580931328:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1784044102.740846:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784044102.740878:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843caf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1870705580931328:12345-0@lo:13:osp-pre-0-1.0 Request processed in 43us (5035us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044102.740885:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00010000:00080000:2.0:1784044102.740918:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b3945930a80 x1870705580931200/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784044118 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784044102.740937:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3945930a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1870705580931200:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1784044102.741445:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1784044102.741489:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b3843caf100 x1870705580931328/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784044118 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784044102.741518:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843caf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1870705580931328:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1784044103.309831:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1784044103.490025:0:12498:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1784044103.490581:0:12498:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1784044103.761576:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3945933480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1870705580931712:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784044103.765511:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044103.765596:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843ce7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3641:1870705580932224:0@lo:400:kworker.0 00000100:00100000:2.0:1784044103.765685:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044103.765706:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843ce6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3641:1870705580932736:0@lo:400:kworker.0 00000100:00100000:2.0:1784044103.765727:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044103.765921:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843ce4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1870705580933248:0@lo:400:kworker.0 00000100:00100000:2.0:1784044103.765949:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044103.765976:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:2.0:1784044103.765984:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3945931500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1870705580931584:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1784044103.766007:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044103.766025:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3945932a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1870705580932096:0@lo:400:kworker.0 00000100:00100000:2.0:1784044103.766073:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044103.766436:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843ce5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1870705580932608:0@lo:400:kworker.0 00000100:00100000:2.0:1784044103.766460:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044103.766477:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843ce7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3641:1870705580933120:0@lo:400:kworker.0 00000100:00100000:2.0:1784044103.766495:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044103.766526:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3945930a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3639:1870705580931968:0@lo:400:kworker.0 00000100:00100000:2.0:1784044103.766549:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044103.766581:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843ce7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1870705580932480:0@lo:400:kworker.0 00000100:00100000:2.0:1784044103.766603:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044103.766620:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843ce6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3639:1870705580932992:0@lo:400:kworker.0 00000100:00100000:2.0:1784044103.766640:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044103.766918:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580932096 00000100:00100000:3.0:1784044103.766928:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580932096 00000100:00100000:3.0:1784044103.766978:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1784044103.766988:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843ca8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1870705580932096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044103.767049:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843ca8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1870705580932096:12345-0@lo:400:kworker.0 Request processed in 62us (975us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044103.767056:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1784044103.768920:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580931712 00000100:00100000:3.0:1784044103.768933:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580931712 00000100:00100000:3.0:1784044103.769044:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580931584 00000100:00100000:3.0:1784044103.769049:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580931584 00000100:00100000:3.0:1784044103.769152:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1784044103.769161:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843ca8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1870705580931712:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1784044103.769223:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784044103.769288:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843ca8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1870705580931712:12345-0@lo:13:osp-pre-1-0.0 Request processed in 128us (3786us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044103.769296:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1784044103.769323:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1784044103.769439:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:2.0:1784044103.769452:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3945932d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:3639:1870705580931840:0@lo:400:kworker.0 00000100:00100000:2.0:1784044103.769492:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044103.769527:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843ce4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1870705580932352:0@lo:400:kworker.0 00000100:00100000:2.0:1784044103.769552:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044103.769572:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843ce5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3639:1870705580932864:0@lo:400:kworker.0 00000100:00100000:2.0:1784044103.769595:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044103.769607:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843ce4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1870705580933376:0@lo:400:kworker.0 00000100:00100000:2.0:1784044103.769627:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044103.769658:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580933248 00000100:00100000:2.0:1784044103.769662:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580933248 00000100:00100000:3.0:1784044103.770432:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843ca9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1870705580931584:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1784044103.770449:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784044103.770485:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843ca9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1870705580931584:12345-0@lo:13:osp-pre-1-1.0 Request processed in 60us (4477us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044103.770491:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1784044103.770516:0:9822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580932608 00000100:00100000:3.0:1784044103.770520:0:9822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580932608 00000100:00100000:3.0:1784044103.770542:0:9822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580932480 00000100:00100000:3.0:1784044103.770544:0:9822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580932480 00000100:00100000:3.0:1784044103.770554:0:9822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580933376 00000100:00100000:3.0:1784044103.770556:0:9822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580933376 00000100:00100000:3.0:1784044103.770568:0:9822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1784044103.770573:0:9822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843ca9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3641:x1870705580932608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044103.770604:0:9822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843ca9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3641:x1870705580932608:12345-0@lo:400:kworker.0 Request processed in 30us (4143us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044103.770611:0:9822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1784044103.770622:0:9822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1784044103.770627:0:9822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843cab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3639:x1870705580932480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044103.770659:0:9822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843cab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3639:x1870705580932480:12345-0@lo:400:kworker.0 Request processed in 32us (4055us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044103.771472:0:9822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00080000:1.0:1784044103.771609:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784044103.777542:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1784044103.777569:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b384316ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1870705580933376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784044103.777694:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b384316ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1870705580933376:12345-0@lo:400:kworker.0 Request processed in 137us (8064us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044103.777703:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1784044103.777725:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1784044103.777745:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843cabb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1870705580933248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784044103.777957:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843cabb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1870705580933248:12345-0@lo:400:kworker.0 Request processed in 224us (12006us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044103.777964:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00010000:00080000:2.0:1784044103.778036:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b3945931500 x1870705580931584/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784044119 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784044103.778070:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3945931500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1870705580931584:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1784044103.778094:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3945932a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1870705580932096:0@lo:400:kworker.0 00010000:00080000:2.0:1784044103.778106:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b3843ce5500 x1870705580932608/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784044119 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784044103.778115:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843ce5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1870705580932608:0@lo:400:kworker.0 00010000:00080000:2.0:1784044103.778126:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b3945933480 x1870705580931712/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784044119 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784044103.778138:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3945933480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1870705580931712:0@lo:13:osp-pre-1-0.0 00010000:00080000:2.0:1784044103.778147:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b3843ce4700 x1870705580933248/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784044119 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784044103.778154:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843ce4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1870705580933248:0@lo:400:kworker.0 00010000:00080000:2.0:1784044103.778224:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b3843ce4e00 x1870705580933376/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784044119 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784044103.778232:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843ce4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1870705580933376:0@lo:400:kworker.0 00010000:00080000:2.0:1784044103.778243:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b3843ce7480 x1870705580932480/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784044119 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784044103.778250:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843ce7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1870705580932480:0@lo:400:kworker.0 00000100:00100000:3.0:1784044103.778524:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580932224 00000100:00100000:3.0:1784044103.778532:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580932224 00000100:00100000:3.0:1784044103.778565:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580932736 00000100:00100000:3.0:1784044103.778568:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580932736 00000100:00100000:3.0:1784044103.778597:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580933120 00000100:00100000:3.0:1784044103.778600:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580933120 00000100:00100000:3.0:1784044103.778614:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580931968 00000100:00100000:3.0:1784044103.778616:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580931968 00000100:00100000:3.0:1784044103.778627:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580932992 00000100:00100000:3.0:1784044103.778629:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580932992 00000100:00100000:3.0:1784044103.778642:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580932864 00000100:00100000:3.0:1784044103.778645:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580932864 00000100:00100000:3.0:1784044103.778660:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1784044103.778677:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843cab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1870705580932224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044103.778726:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843cab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1870705580932224:12345-0@lo:400:kworker.0 Request processed in 60us (13039us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044103.778911:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1784044103.778926:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1784044103.778933:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843caa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1870705580932736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044103.778966:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843caa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1870705580932736:12345-0@lo:400:kworker.0 Request processed in 34us (13238us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044103.778973:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1784044103.778984:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1784044103.778991:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843ca8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1870705580933120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044103.779018:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843ca8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1870705580933120:12345-0@lo:400:kworker.0 Request processed in 29us (12523us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044103.779024:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1784044103.779036:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1784044103.779042:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843ca8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1870705580931968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044103.779103:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843ca8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1870705580931968:12345-0@lo:400:kworker.0 Request processed in 62us (12553us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044103.779110:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1784044103.779123:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1784044103.779129:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843ca9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1870705580932992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044103.779159:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843ca9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1870705580932992:12345-0@lo:400:kworker.0 Request processed in 31us (12518us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044103.779165:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1784044103.779204:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1784044103.779212:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b384316d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1870705580932864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044103.779242:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b384316d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1870705580932864:12345-0@lo:400:kworker.0 Request processed in 30us (9645us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044103.779247:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1784044103.780040:0:7768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580932352 00000100:00100000:1.0:1784044103.780048:0:7768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580932352 00000100:00100000:1.0:1784044103.780091:0:7768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1784044103.780099:0:7768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843caaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1870705580932352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044103.780144:0:7768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843caaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1870705580932352:12345-0@lo:400:kworker.0 Request processed in 46us (10590us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044103.780151:0:7768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1784044103.780171:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580931840 00000100:00100000:1.0:1784044103.780196:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580931840 00000100:00100000:1.0:1784044103.780224:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 315 00000100:00100000:1.0:1784044103.780231:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3970edc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+24:3639:x1870705580931840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044103.780263:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3970edc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+24:3639:x1870705580931840:12345-0@lo:400:kworker.0 Request processed in 33us (10771us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044103.780270:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 315 00000100:00080000:1.0:1784044103.780321:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1784044103.780450:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1784044103.780588:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b3843ce7800 x1870705580933120/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044119 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784044103.780603:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843ce7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3641:1870705580933120:0@lo:400:kworker.0 00000100:00100000:2.0:1784044103.780634:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843ce7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3641:1870705580932224:0@lo:400:kworker.0 00000100:00100000:2.0:1784044103.780646:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843ce6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3641:1870705580932736:0@lo:400:kworker.0 00000100:00100000:2.0:1784044103.780888:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3945932d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:3639:1870705580931840:0@lo:400:kworker.0 00000100:00100000:2.0:1784044103.780901:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843ce4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1870705580932352:0@lo:400:kworker.0 00010000:00080000:2.0:1784044103.780915:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b3843ce5880 x1870705580932864/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044119 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784044103.780925:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843ce5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3639:1870705580932864:0@lo:400:kworker.0 00000100:00100000:2.0:1784044103.780936:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3945930a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3639:1870705580931968:0@lo:400:kworker.0 00000100:00100000:2.0:1784044103.780948:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843ce6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3639:1870705580932992:0@lo:400:kworker.0 00010000:00010000:3.0:1784044104.333775:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784044105.358701:0:10331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1784044106.030948:0:12596:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1784044106.031242:0:12596:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1784044106.381770:0:10330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784044106.478628:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044106.478734:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044106.478766:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1784044106.480646:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565123584 00000100:00100000:1.0:1784044106.480670:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565123584 00000100:00100000:1.0:1784044106.480734:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 316 00000100:00100000:1.0:1784044106.480746:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3970ede450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4a09ad9-a185-4679-99bb-b6a07b865440+13:2409:x1870705565123584:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:1.0:1784044106.480841:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3970ede450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4a09ad9-a185-4679-99bb-b6a07b865440+13:2409:x1870705565123584:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 96us (2105us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044106.480860:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 316 00000100:00100000:3.0:1784044106.489561:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044106.494467:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565123712 00000100:00100000:2.0:1784044106.494482:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565123712 00000100:00100000:2.0:1784044106.494600:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565123840 00000100:00100000:2.0:1784044106.494604:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565123840 00000100:00100000:2.0:1784044106.494633:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 174 00000100:00100000:2.0:1784044106.498029:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843ce4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+6:2410:x1870705565123712:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:2.0:1784044106.498156:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843ce4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+6:2410:x1870705565123712:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 3512us (19536us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044106.498168:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 174 00000100:00100000:2.0:1784044106.498222:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 175 00000100:00100000:2.0:1784044106.498232:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843ce6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+5:2409:x1870705565123840:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:2.0:1784044106.498260:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843ce6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+5:2409:x1870705565123840:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 29us (19493us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044106.498293:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 175 00000100:00100000:3.0:1784044106.498939:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044106.498959:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044106.498987:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044106.499011:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565124224 00000100:00100000:3.0:1784044106.499020:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565124224 00000100:00100000:3.0:1784044106.499064:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565124352 00000100:00100000:3.0:1784044106.499068:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565124352 00000100:00100000:3.0:1784044106.499103:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 24 00000100:00100000:3.0:1784044106.499112:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843ce6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:68dfcea6-5d83-4dbb-8fa3-e35542d621e5+5:2406:x1870705565124224:12345-192.168.202.40@tcp:9:kworker.0 00000020:00000080:3.0:1784044106.499144:0:8427:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x89871fc3aba18073 00000100:00080000:3.0:1784044106.499153:0:8427:0:(import.c:65:import_set_state_nolock()) ffff9b397b805000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1784044106.499225:0:8427:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:3.0:1784044106.499409:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843ce6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:68dfcea6-5d83-4dbb-8fa3-e35542d621e5+2:2406:x1870705565124224:12345-192.168.202.40@tcp:9:kworker.0 Request processed in 297us (447us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044106.499416:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 24 00000100:00100000:3.0:1784044106.499430:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 25 00000100:00100000:3.0:1784044106.499437:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843ce6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:68dfcea6-5d83-4dbb-8fa3-e35542d621e5+5:2406:x1870705565124352:12345-192.168.202.40@tcp:9:kworker.0 00000020:00000080:3.0:1784044106.499447:0:8427:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x89871fc3aba1807a 00000100:00080000:3.0:1784044106.499452:0:8427:0:(import.c:65:import_set_state_nolock()) ffff9b3843c31800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1784044106.499472:0:8427:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:3.0:1784044106.499556:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843ce6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:68dfcea6-5d83-4dbb-8fa3-e35542d621e5+2:2406:x1870705565124352:12345-192.168.202.40@tcp:9:kworker.0 Request processed in 119us (568us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044106.500189:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565124096 00000100:00100000:0.0:1784044106.500194:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565124096 00000100:00100000:0.0:1784044106.500224:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565123968 00000100:00100000:0.0:1784044106.500227:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565123968 00000100:00100000:0.0:1784044106.500244:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 176 00000100:00100000:0.0:1784044106.500250:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843ce4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68dfcea6-5d83-4dbb-8fa3-e35542d621e5+5:2409:x1870705565124096:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:0.0:1784044106.500296:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843ce4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68dfcea6-5d83-4dbb-8fa3-e35542d621e5+5:2409:x1870705565124096:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 46us (10745us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044106.500303:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 176 00000100:00100000:0.0:1784044106.500317:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 177 00000100:00100000:0.0:1784044106.500322:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843ce5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68dfcea6-5d83-4dbb-8fa3-e35542d621e5+5:2410:x1870705565123968:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:0.0:1784044106.500346:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843ce5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68dfcea6-5d83-4dbb-8fa3-e35542d621e5+5:2410:x1870705565123968:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 24us (1409us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044106.500351:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 177 00000100:00100000:3.0:1784044106.500405:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 25 00010000:00010000:3.0:1784044106.500434:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1784044106.501430:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784044106.501436:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1784044106.501440:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1784044106.501442:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1784044106.506886:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784044106.836302:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843ce5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1870705580933504:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1784044106.836383:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044106.836473:0:7768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580933504 00000100:00100000:0.0:1784044106.836481:0:7768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580933504 00000100:00100000:0.0:1784044106.836552:0:7768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1784044106.836725:0:7768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397bbbdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1870705580933504:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1784044106.836783:0:7768:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1784044106.837122:0:7768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397bbbdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1870705580933504:12345-0@lo:41:osp-pre-0-1.0 Request processed in 561us (738us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044106.837131:0:7768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1784044106.837228:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843ce5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1870705580933504:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1784044107.413381:0:10331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784044107.853793:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843ce4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1870705580933632:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1784044107.853866:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044107.853937:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580933632 00000100:00100000:3.0:1784044107.853945:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580933632 00000100:00100000:3.0:1784044107.854009:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1784044107.854021:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843ce6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1870705580933632:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1784044107.854056:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1784044107.854106:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843ce6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1870705580933632:12345-0@lo:41:osp-pre-1-0.0 Request processed in 87us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044107.854114:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1784044107.854200:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843ce4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1870705580933632:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1784044107.854333:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b384316fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1870705580933760:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1784044107.854369:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044107.854411:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580933760 00000100:00100000:2.0:1784044107.854416:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580933760 00000100:00100000:2.0:1784044107.854472:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1784044107.854480:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b384316f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1870705580933760:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1784044107.854500:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784044107.854538:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b384316f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1870705580933760:12345-0@lo:13:osp-pre-0-1.0 Request processed in 59us (168us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044107.854544:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00010000:00080000:2.0:1784044107.854580:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b384316fb80 x1870705580933760/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784044123 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784044107.854596:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b384316fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1870705580933760:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1784044107.854968:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843ce4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1870705580933888:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784044107.854996:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1784044107.855142:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784044107.861133:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580933888 00000100:00100000:3.0:1784044107.861148:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580933888 00000100:00100000:3.0:1784044107.861658:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1784044107.861669:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b384316fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1870705580933888:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1784044107.861699:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784044107.861797:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b384316fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1870705580933888:12345-0@lo:13:osp-pre-0-0.0 Request processed in 130us (6800us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044107.861805:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00010000:00080000:1.0:1784044107.863609:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b3843ce4380 x1870705580933888/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784044123 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784044107.863648:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843ce4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1870705580933888:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1784044107.866531:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1784044108.429755:0:10330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1784044108.790375:0:12693:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1784044108.790926:0:12693:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1784044108.877476:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784044108.877500:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843caf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1870705580934016:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1784044108.877566:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044108.877625:0:10713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580934016 00000100:00100000:1.0:1784044108.877632:0:10713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580934016 00000100:00100000:1.0:1784044108.877686:0:10713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1784044108.877694:0:10713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843cae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1870705580934016:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1784044108.877738:0:10713:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784044108.877783:0:10713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843cae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1870705580934016:12345-0@lo:13:osp-pre-1-1.0 Request processed in 89us (216us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044108.877790:0:10713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00080000:1.0:1784044108.877811:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1784044108.877842:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b3843caf100 x1870705580934016/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784044124 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784044108.877860:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843caf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1870705580934016:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1784044108.878088:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1784044108.878099:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843ce7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1870705580934144:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784044108.878130:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044108.878164:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580934144 00000100:00100000:3.0:1784044108.878167:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580934144 00000100:00100000:3.0:1784044108.878221:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1784044108.878228:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843ce7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1870705580934144:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1784044108.878240:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784044108.878282:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843ce7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1870705580934144:12345-0@lo:13:osp-pre-1-0.0 Request processed in 54us (151us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044108.878289:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00010000:00080000:3.0:1784044108.878314:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b3843ce7100 x1870705580934144/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784044124 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784044108.878327:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843ce7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1870705580934144:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784044108.878507:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3945933480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1870705580934528:0@lo:400:kworker.0 00000100:00100000:2.0:1784044108.878542:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044108.878562:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843c88e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1870705580935040:0@lo:400:kworker.0 00000100:00100000:2.0:1784044108.878585:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044108.878600:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3639:1870705580935552:0@lo:400:kworker.0 00000100:00100000:2.0:1784044108.878637:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044108.878657:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1784044108.878662:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3945932d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3639:1870705580934400:0@lo:400:kworker.0 00000100:00100000:2.0:1784044108.878682:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044108.878699:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843c8aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1870705580934912:0@lo:400:kworker.0 00000100:00100000:2.0:1784044108.878735:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044108.878750:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3639:1870705580935424:0@lo:400:kworker.0 00000100:00100000:2.0:1784044108.878769:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044108.878793:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580934528 00000100:00100000:2.0:1784044108.878796:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580934528 00000100:00100000:2.0:1784044108.878826:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1784044108.878833:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1870705580934528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784044108.878871:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1870705580934528:12345-0@lo:400:kworker.0 Request processed in 38us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044108.878877:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1784044108.878898:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580935552 00000100:00100000:2.0:1784044108.878901:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580935552 00000100:00100000:2.0:1784044108.878925:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580934400 00000100:00100000:2.0:1784044108.878929:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580934400 00000100:00100000:2.0:1784044108.878940:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580935424 00000100:00100000:2.0:1784044108.878942:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580935424 00000100:00100000:2.0:1784044108.878957:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1784044108.878963:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1870705580935552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784044108.878994:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1870705580935552:12345-0@lo:400:kworker.0 Request processed in 31us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044108.879000:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1784044108.879013:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1784044108.879025:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1870705580934400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784044108.879056:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1870705580934400:12345-0@lo:400:kworker.0 Request processed in 31us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044108.879061:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1784044108.879073:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1784044108.879080:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1870705580935424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784044108.879107:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1870705580935424:12345-0@lo:400:kworker.0 Request processed in 28us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044108.879114:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1784044108.879142:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3945932d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3639:1870705580934400:0@lo:400:kworker.0 00000100:00100000:2.0:1784044108.879151:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3639:1870705580935424:0@lo:400:kworker.0 00000100:00100000:2.0:1784044108.879158:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3945933480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1870705580934528:0@lo:400:kworker.0 00010000:00080000:2.0:1784044108.879167:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b3843d2dc00 x1870705580935552/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044124 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784044108.879195:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3639:1870705580935552:0@lo:400:kworker.0 00000100:00100000:1.0:1784044108.879372:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3945932a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1870705580934656:0@lo:400:kworker.0 00000100:00100000:1.0:1784044108.879402:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044108.879429:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3640:1870705580935168:0@lo:400:kworker.0 00000100:00100000:1.0:1784044108.879471:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044108.879492:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1784044108.879498:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3945930a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:3640:1870705580934272:0@lo:400:kworker.0 00000100:00100000:1.0:1784044108.879522:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044108.879544:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3945931500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1870705580934784:0@lo:400:kworker.0 00000100:00100000:1.0:1784044108.879565:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044108.879581:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1870705580935296:0@lo:400:kworker.0 00000100:00100000:1.0:1784044108.879600:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044108.879619:0:9501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580934656 00000100:00100000:1.0:1784044108.879623:0:9501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580934656 00000100:00100000:1.0:1784044108.879641:0:9501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580935168 00000100:00100000:1.0:1784044108.879644:0:9501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580935168 00000100:00100000:1.0:1784044108.879656:0:9501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580935296 00000100:00100000:1.0:1784044108.879658:0:9501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580935296 00000100:00100000:1.0:1784044108.879671:0:9501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1784044108.879676:0:9501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843caf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1870705580934656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044108.879724:0:9501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843caf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1870705580934656:12345-0@lo:400:kworker.0 Request processed in 35us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044108.879731:0:9501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1784044108.879745:0:9501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1784044108.879750:0:9501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843dbf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1870705580935168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044108.879778:0:9501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843dbf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1870705580935168:12345-0@lo:400:kworker.0 Request processed in 28us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044108.879784:0:9501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1784044108.879795:0:9501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1784044108.879800:0:9501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843dbe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1870705580935296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044108.879833:0:9501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843dbe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1870705580935296:12345-0@lo:400:kworker.0 Request processed in 32us (231us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044108.879839:0:9501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1784044108.879869:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580934272 00000100:00100000:1.0:1784044108.879873:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580934272 00000100:00100000:1.0:1784044108.879898:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 317 00000100:00100000:1.0:1784044108.879904:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3970edfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+24:3640:x1870705580934272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044108.879933:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3970edfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+24:3640:x1870705580934272:12345-0@lo:400:kworker.0 Request processed in 29us (410us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044108.879938:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 317 00000100:00100000:1.0:1784044108.879963:0:7768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580934784 00000100:00100000:1.0:1784044108.879967:0:7768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580934784 00000100:00100000:1.0:1784044108.879993:0:7768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1784044108.879998:0:7768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843dbc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1870705580934784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044108.880026:0:7768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843dbc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1870705580934784:12345-0@lo:400:kworker.0 Request processed in 27us (459us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044108.880031:0:7768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00080000:1.0:1784044108.880052:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1784044108.880055:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1784044108.880057:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784044108.880096:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3945930a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:3640:1870705580934272:0@lo:400:kworker.0 00000100:00100000:1.0:1784044108.880106:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3945931500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1870705580934784:0@lo:400:kworker.0 00010000:00080000:1.0:1784044108.880115:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b3843d2c380 x1870705580935296/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044124 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784044108.880124:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1870705580935296:0@lo:400:kworker.0 00000100:00100000:1.0:1784044108.880144:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3945932a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1870705580934656:0@lo:400:kworker.0 00000100:00100000:1.0:1784044108.880151:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3640:1870705580935168:0@lo:400:kworker.0 00000100:00100000:3.0:1784044108.880429:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580935040 00000100:00100000:3.0:1784044108.880434:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580935040 00000100:00100000:3.0:1784044108.880462:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580934912 00000100:00100000:3.0:1784044108.880472:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580934912 00000100:00100000:3.0:1784044108.880494:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1784044108.880501:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1870705580935040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044108.880542:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1870705580935040:12345-0@lo:400:kworker.0 Request processed in 41us (1956us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044108.880548:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1784044108.880562:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1784044108.880567:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1870705580934912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044108.880593:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1870705580934912:12345-0@lo:400:kworker.0 Request processed in 26us (1858us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044108.880598:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00010000:00080000:3.0:1784044108.880643:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b3843c8aa00 x1870705580934912/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784044124 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784044108.880653:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843c8aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1870705580934912:0@lo:400:kworker.0 00010000:00080000:3.0:1784044108.880664:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b3843c88e00 x1870705580935040/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784044124 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784044108.880671:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843c88e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1870705580935040:0@lo:400:kworker.0 00010000:00010000:3.0:1784044109.457372:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784044110.477377:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1784044111.154005:0:12790:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1784044111.154474:0:12790:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1784044111.501466:0:10331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784044111.594337:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1784044111.594376:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1784044111.594398:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1784044111.594415:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1784044111.594443:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1784044111.594471:0:9501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565124736 00000100:00100000:1.0:1784044111.594480:0:9501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565124736 00000100:00100000:1.0:1784044111.594534:0:9501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565124992 00000100:00100000:1.0:1784044111.594538:0:9501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565124992 00000100:00100000:1.0:1784044111.594553:0:9501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565124608 00000100:00100000:1.0:1784044111.594555:0:9501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565124608 00000100:00100000:1.0:1784044111.594566:0:9501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565124864 00000100:00100000:1.0:1784044111.594568:0:9501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565124864 00000100:00100000:1.0:1784044111.594584:0:9501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 184 00000100:00100000:1.0:1784044111.594594:0:9501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843dbdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a93fdf3c-d42f-420a-95ea-b0cbfe954363+5:2407:x1870705565124736:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:1.0:1784044111.594669:0:9501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843dbdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a93fdf3c-d42f-420a-95ea-b0cbfe954363+5:2407:x1870705565124736:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 76us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044111.594676:0:9501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 184 00000100:00100000:1.0:1784044111.594693:0:9501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 185 00000100:00100000:1.0:1784044111.594698:0:9501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843dbea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68dfcea6-5d83-4dbb-8fa3-e35542d621e5+5:2407:x1870705565124992:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:1.0:1784044111.594719:0:9501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843dbea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68dfcea6-5d83-4dbb-8fa3-e35542d621e5+5:2407:x1870705565124992:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 21us (321us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044111.594725:0:9501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 185 00000100:00100000:1.0:1784044111.594754:0:9501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 186 00000100:00100000:1.0:1784044111.594759:0:9501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843dbce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a93fdf3c-d42f-420a-95ea-b0cbfe954363+6:2407:x1870705565124608:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:1.0:1784044111.594786:0:9501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843dbce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a93fdf3c-d42f-420a-95ea-b0cbfe954363+6:2407:x1870705565124608:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 27us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044111.594791:0:9501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 186 00000100:00100000:1.0:1784044111.594801:0:9501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 187 00000100:00100000:1.0:1784044111.594806:0:9501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843dbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68dfcea6-5d83-4dbb-8fa3-e35542d621e5+5:2407:x1870705565124864:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:1.0:1784044111.594825:0:9501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843dbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68dfcea6-5d83-4dbb-8fa3-e35542d621e5+5:2407:x1870705565124864:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 20us (383us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044111.594831:0:9501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 187 00000100:00080000:1.0:1784044111.594856:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1784044111.594862:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1784044111.595983:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565124480 00000100:00100000:3.0:1784044111.595996:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565124480 00000100:00100000:3.0:1784044111.596045:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 318 00000100:00100000:3.0:1784044111.596054:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3970eddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4a09ad9-a185-4679-99bb-b6a07b865440+13:2407:x1870705565124480:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:3.0:1784044111.596109:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3970eddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4a09ad9-a185-4679-99bb-b6a07b865440+13:2407:x1870705565124480:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 57us (1782us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044111.596117:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 318 00000100:00100000:1.0:1784044111.952537:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843dbe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1870705580935680:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1784044111.952615:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044111.952696:0:7768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580935680 00000100:00100000:1.0:1784044111.952705:0:7768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580935680 00000001:00100000:0.0:1784044111.953085:0:8421:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 68dfcea6-5d83-4dbb-8fa3-e35542d621e5 00000020:00000080:0.0:1784044111.953092:0:8421:0:(genops.c:906:class_export_put()) final put ffff9b397b802000/68dfcea6-5d83-4dbb-8fa3-e35542d621e5 00000020:00000080:2.0:1784044111.953219:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9b397b802000/68dfcea6-5d83-4dbb-8fa3-e35542d621e5 for lustre-OST0000 00000020:00000080:2.0:1784044111.953551:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9b397b805000 for lustre-OST0000 00000100:00100000:1.0:1784044111.953712:0:7768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1784044111.954088:0:7768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843dbfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1870705580935680:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1784044111.954126:0:7768:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1784044111.954212:0:7768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843dbfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1870705580935680:12345-0@lo:41:osp-pre-0-1.0 Request processed in 128us (1595us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044111.954221:0:7768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1784044111.954574:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843dbe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1870705580935680:0@lo:41:osp-pre-0-1.0 00000001:00100000:0.0:1784044111.954868:0:9505:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 68dfcea6-5d83-4dbb-8fa3-e35542d621e5 00000020:00000080:0.0:1784044111.954873:0:9505:0:(genops.c:906:class_export_put()) final put ffff9b3843c36800/68dfcea6-5d83-4dbb-8fa3-e35542d621e5 00000020:00000080:2.0:1784044111.954950:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9b3843c36800/68dfcea6-5d83-4dbb-8fa3-e35542d621e5 for lustre-OST0001 00000020:00000080:2.0:1784044111.955112:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9b3843c31800 for lustre-OST0001 00010000:00010000:1.0:1784044112.525510:0:10330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784044112.979143:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843ce7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1870705580935808:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1784044112.979245:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044112.979343:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580935808 00000100:00100000:3.0:1784044112.979353:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580935808 00000100:00100000:3.0:1784044112.979408:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1784044112.979418:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843ce7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1870705580935808:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1784044112.979453:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784044112.979497:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843ce7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1870705580935808:12345-0@lo:13:osp-pre-0-1.0 Request processed in 81us (252us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044112.979504:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00080000:3.0:1784044112.979526:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1784044112.979558:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b3843ce7100 x1870705580935808/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784044128 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784044112.979577:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843ce7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1870705580935808:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1784044112.980407:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784044112.980422:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397bbbe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1870705580935936:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1784044112.980467:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044112.980505:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580935936 00000100:00100000:0.0:1784044112.980510:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580935936 00000100:00100000:0.0:1784044112.980546:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1784044112.980564:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397bbbc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1870705580935936:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1784044112.980592:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1784044112.980632:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397bbbc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1870705580935936:12345-0@lo:41:osp-pre-1-0.0 Request processed in 79us (164us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044112.980639:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1784044112.980692:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397bbbe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1870705580935936:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1784044112.981284:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784044112.981305:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843ce7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1870705580936064:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784044112.981345:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044112.981389:0:10713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580936064 00000100:00100000:3.0:1784044112.981394:0:10713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580936064 00000100:00100000:3.0:1784044112.981435:0:10713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1784044112.981442:0:10713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843ce4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1870705580936064:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1784044112.981458:0:10713:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784044112.981493:0:10713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843ce4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1870705580936064:12345-0@lo:13:osp-pre-0-0.0 Request processed in 51us (146us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044112.981499:0:10713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00080000:3.0:1784044112.981515:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1784044112.981544:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b3843ce7100 x1870705580936064/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784044128 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784044112.981571:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843ce7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1870705580936064:0@lo:13:osp-pre-0-0.0 00000020:00000004:2.0:1784044113.097115:0:12888:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1784044113.097397:0:12888:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1784044113.550053:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784044113.997509:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784044113.997533:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843dbe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1870705580936192:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1784044113.997617:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044113.997815:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580936192 00000100:00100000:2.0:1784044113.997825:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580936192 00000100:00100000:2.0:1784044113.997876:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1784044113.997903:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397bbbe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1870705580936192:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1784044113.997934:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784044113.997982:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397bbbe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1870705580936192:12345-0@lo:13:osp-pre-1-1.0 Request processed in 83us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044113.997989:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00010000:00080000:2.0:1784044113.998030:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b3843dbe300 x1870705580936192/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784044129 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784044113.998052:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843dbe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1870705580936192:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1784044113.998115:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784044113.998332:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843dbd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1870705580936576:0@lo:400:kworker.0 00000100:00100000:1.0:1784044113.998365:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044113.998383:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843dbd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1870705580937088:0@lo:400:kworker.0 00000100:00100000:1.0:1784044113.998406:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044113.998422:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843cff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3639:1870705580937600:0@lo:400:kworker.0 00000100:00100000:1.0:1784044113.998443:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044113.998468:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1784044113.998474:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843dbc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3639:1870705580936448:0@lo:400:kworker.0 00000100:00100000:1.0:1784044113.998495:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044113.998510:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843dbf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1870705580936960:0@lo:400:kworker.0 00000100:00100000:1.0:1784044113.998530:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044113.998544:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843dbe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3639:1870705580937472:0@lo:400:kworker.0 00000100:00100000:1.0:1784044113.998563:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044113.998590:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580936576 00000100:00100000:1.0:1784044113.998595:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580936576 00000100:00100000:1.0:1784044114.001381:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1784044114.001402:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843cfed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1870705580936576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044114.001503:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843cfed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1870705580936576:12345-0@lo:400:kworker.0 Request processed in 110us (3137us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044114.001512:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1784044114.001544:0:9501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580937600 00000100:00100000:1.0:1784044114.001552:0:9501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580937600 00000100:00100000:1.0:1784044114.001587:0:9501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580936448 00000100:00100000:1.0:1784044114.001590:0:9501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580936448 00000100:00100000:1.0:1784044114.001603:0:9501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580937472 00000100:00100000:1.0:1784044114.001605:0:9501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580937472 00000100:00100000:1.0:1784044114.001617:0:9501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:1.0:1784044114.001640:0:9501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843cff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1870705580937600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044114.001673:0:9501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843cff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1870705580937600:12345-0@lo:400:kworker.0 Request processed in 34us (3229us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044114.001678:0:9501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:1.0:1784044114.001692:0:9501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:1.0:1784044114.001697:0:9501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843cfc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1870705580936448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044114.001723:0:9501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843cfc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1870705580936448:12345-0@lo:400:kworker.0 Request processed in 27us (3228us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044114.001729:0:9501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:1.0:1784044114.001739:0:9501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:1.0:1784044114.001745:0:9501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843cfdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1870705580937472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044114.001772:0:9501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843cfdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1870705580937472:12345-0@lo:400:kworker.0 Request processed in 27us (3207us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044114.001777:0:9501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00080000:1.0:1784044114.001807:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1784044114.001812:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1784044114.001847:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843dbc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3639:1870705580936448:0@lo:400:kworker.0 00000100:00100000:1.0:1784044114.001861:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843dbe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3639:1870705580937472:0@lo:400:kworker.0 00000100:00100000:1.0:1784044114.001872:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843dbd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1870705580936576:0@lo:400:kworker.0 00010000:00080000:1.0:1784044114.001885:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b3843cff800 x1870705580937600/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044129 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784044114.001896:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843cff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3639:1870705580937600:0@lo:400:kworker.0 00000100:00100000:2.0:1784044114.002080:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843dbdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:3641:1870705580936320:0@lo:400:kworker.0 00000100:00100000:2.0:1784044114.002120:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044114.002146:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843dbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1870705580936832:0@lo:400:kworker.0 00000100:00100000:2.0:1784044114.002195:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044114.002225:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843dbd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3641:1870705580937344:0@lo:400:kworker.0 00000100:00100000:2.0:1784044114.002246:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044114.002263:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1784044114.002269:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843dbca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3641:1870705580936704:0@lo:400:kworker.0 00000100:00100000:2.0:1784044114.002284:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044114.002295:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843dbed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3641:1870705580937216:0@lo:400:kworker.0 00000100:00100000:2.0:1784044114.002310:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044114.002319:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843cfd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1870705580937728:0@lo:400:kworker.0 00000100:00100000:2.0:1784044114.002335:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044114.002357:0:7768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580936832 00000100:00100000:2.0:1784044114.002361:0:7768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580936832 00000100:00100000:2.0:1784044114.002382:0:7768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1784044114.002388:0:7768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1870705580936832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784044114.002426:0:7768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1870705580936832:12345-0@lo:400:kworker.0 Request processed in 38us (230us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044114.002431:0:7768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1784044114.002446:0:9501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580937344 00000100:00100000:2.0:1784044114.002449:0:9501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580937344 00000100:00100000:2.0:1784044114.002472:0:9501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580936704 00000100:00100000:2.0:1784044114.002474:0:9501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580936704 00000100:00100000:2.0:1784044114.002484:0:9501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580937216 00000100:00100000:2.0:1784044114.002486:0:9501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580937216 00000100:00100000:2.0:1784044114.002499:0:9501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:2.0:1784044114.002504:0:9501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1870705580937344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784044114.002531:0:9501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1870705580937344:12345-0@lo:400:kworker.0 Request processed in 27us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044114.002537:0:9501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:2.0:1784044114.002547:0:9501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:2.0:1784044114.002552:0:9501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1870705580936704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784044114.002577:0:9501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1870705580936704:12345-0@lo:400:kworker.0 Request processed in 24us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044114.002583:0:9501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:2.0:1784044114.002592:0:9501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:2.0:1784044114.002597:0:9501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1870705580937216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784044114.002859:0:9501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1870705580937216:12345-0@lo:400:kworker.0 Request processed in 260us (547us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044114.002865:0:9501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00080000:2.0:1784044114.002883:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1784044114.002886:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1784044114.002903:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843dbca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3641:1870705580936704:0@lo:400:kworker.0 00000100:00100000:2.0:1784044114.002918:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843dbed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3641:1870705580937216:0@lo:400:kworker.0 00000100:00100000:2.0:1784044114.002926:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843dbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1870705580936832:0@lo:400:kworker.0 00010000:00080000:2.0:1784044114.002934:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b3843dbd500 x1870705580937344/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044130 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784044114.002944:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843dbd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3641:1870705580937344:0@lo:400:kworker.0 00000100:00100000:1.0:1784044114.003154:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580936320 00000100:00100000:1.0:1784044114.003160:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580936320 00000100:00100000:1.0:1784044114.003240:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 319 00000100:00100000:1.0:1784044114.003246:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3965efcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+24:3641:x1870705580936320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044114.003296:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3965efcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+24:3641:x1870705580936320:12345-0@lo:400:kworker.0 Request processed in 50us (1175us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044114.003301:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 319 00000100:00100000:3.0:1784044114.003498:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580937088 00000100:00100000:3.0:1784044114.003503:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580937088 00000100:00100000:3.0:1784044114.003619:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580936960 00000100:00100000:3.0:1784044114.003623:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580936960 00000100:00100000:3.0:1784044114.003637:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580937728 00000100:00100000:3.0:1784044114.003640:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580937728 00000100:00100000:3.0:1784044114.003653:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1784044114.003658:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843cfd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1870705580937088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044114.003699:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843cfd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1870705580937088:12345-0@lo:400:kworker.0 Request processed in 41us (5292us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044114.003705:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1784044114.003716:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1784044114.003722:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843cfe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1870705580936960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044114.003747:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843cfe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1870705580936960:12345-0@lo:400:kworker.0 Request processed in 26us (5216us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044114.003752:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1784044114.003762:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1784044114.003768:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1870705580937728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044114.003792:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1870705580937728:12345-0@lo:400:kworker.0 Request processed in 26us (1456us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044114.003797:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00080000:3.0:1784044114.003824:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1784044114.003827:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1784044114.003848:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b3843dbf800 x1870705580936960/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784044129 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784044114.003867:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843dbf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1870705580936960:0@lo:400:kworker.0 00010000:00080000:3.0:1784044114.003880:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b3843dbd880 x1870705580937088/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784044129 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784044114.003888:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843dbd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1870705580937088:0@lo:400:kworker.0 00000100:00100000:0.0:1784044114.004102:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843cff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1870705580937856:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784044114.004137:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1784044114.004202:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b3843cfd880 x1870705580937728/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784044130 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784044114.004224:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843cfd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1870705580937728:0@lo:400:kworker.0 00000100:00100000:0.0:1784044114.004235:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843dbdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:3641:1870705580936320:0@lo:400:kworker.0 00000100:00100000:1.0:1784044114.004409:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580937856 00000100:00100000:1.0:1784044114.004414:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580937856 00000100:00100000:1.0:1784044114.004446:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1784044114.004453:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397bbbca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1870705580937856:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1784044114.004467:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784044114.004508:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397bbbca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1870705580937856:12345-0@lo:13:osp-pre-1-0.0 Request processed in 56us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044114.004515:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00010000:00080000:0.0:1784044114.004577:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b3843cff800 x1870705580937856/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784044130 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784044114.004589:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843cff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1870705580937856:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1784044114.573424:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784044115.601904:0:10331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784044116.621964:0:10330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784044116.712903:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1784044116.712973:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1784044116.713014:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1784044116.713045:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1784044116.713078:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1784044116.713107:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565125376 00000100:00100000:1.0:1784044116.713116:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565125376 00000100:00100000:1.0:1784044116.713233:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565125632 00000100:00100000:1.0:1784044116.713237:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565125632 00000100:00100000:1.0:1784044116.713254:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565125248 00000100:00100000:1.0:1784044116.713256:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565125248 00000100:00100000:1.0:1784044116.713282:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565125504 00000100:00100000:1.0:1784044116.713284:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565125504 00000100:00100000:1.0:1784044116.713299:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 194 00000100:00100000:1.0:1784044116.713331:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843cfea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+5:2408:x1870705565125376:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:1.0:1784044116.713416:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843cfea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+5:2408:x1870705565125376:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 88us (442us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044116.713423:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 194 00000100:00100000:1.0:1784044116.713440:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 195 00000100:00100000:1.0:1784044116.713446:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843cfce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68dfcea6-5d83-4dbb-8fa3-e35542d621e5+5:2408:x1870705565125632:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:1.0:1784044116.713468:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843cfce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68dfcea6-5d83-4dbb-8fa3-e35542d621e5+5:2408:x1870705565125632:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 23us (454us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044116.713474:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 195 00000100:00100000:1.0:1784044116.713484:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 196 00000100:00100000:1.0:1784044116.713490:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843cff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+6:2408:x1870705565125248:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:1.0:1784044116.713508:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843cff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+6:2408:x1870705565125248:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 19us (464us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044116.713513:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 196 00000100:00100000:1.0:1784044116.713522:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 197 00000100:00100000:1.0:1784044116.713527:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843cfe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68dfcea6-5d83-4dbb-8fa3-e35542d621e5+5:2408:x1870705565125504:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:1.0:1784044116.713544:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843cfe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68dfcea6-5d83-4dbb-8fa3-e35542d621e5+5:2408:x1870705565125504:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 17us (466us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044116.713550:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 197 00000100:00080000:3.0:1784044116.714079:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1784044116.714085:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1784044116.714710:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565125120 00000100:00100000:2.0:1784044116.714718:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565125120 00000100:00100000:2.0:1784044116.714778:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 320 00000100:00100000:2.0:1784044116.714788:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3970edec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4a09ad9-a185-4679-99bb-b6a07b865440+13:2408:x1870705565125120:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:2.0:1784044116.714851:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3970edec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4a09ad9-a185-4679-99bb-b6a07b865440+13:2408:x1870705565125120:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 64us (1959us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044116.714859:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 320 00000100:00100000:1.0:1784044117.069354:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1784044117.069378:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843cffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1870705580937984:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1784044117.069449:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044117.069654:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580937984 00000100:00100000:1.0:1784044117.069663:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580937984 00000100:00100000:1.0:1784044117.069723:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1784044117.069732:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843cfdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1870705580937984:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1784044117.069766:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1784044117.069815:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843cfdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1870705580937984:12345-0@lo:41:osp-pre-0-1.0 Request processed in 84us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044117.069823:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1784044117.069873:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843cffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1870705580937984:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1784044117.650034:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1784044118.008149:0:13032:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:3.0:1784044118.093361:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784044118.093394:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843ce7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1870705580938112:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784044118.093499:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044118.093578:0:10713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580938112 00000100:00100000:3.0:1784044118.093588:0:10713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580938112 00000100:00100000:3.0:1784044118.093674:0:10713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1784044118.093686:0:10713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843ce4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1870705580938112:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1784044118.093732:0:10713:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784044118.093785:0:10713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843ce4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1870705580938112:12345-0@lo:13:osp-pre-0-0.0 Request processed in 101us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044118.093793:0:10713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00080000:3.0:1784044118.093816:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784044118.093859:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00080000:3.0:1784044118.093861:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b3843ce7100 x1870705580938112/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784044134 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784044118.093869:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397bbbd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1870705580938240:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1784044118.093878:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843ce7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1870705580938112:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784044118.093901:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044118.094049:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580938240 00000100:00100000:3.0:1784044118.094053:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580938240 00000100:00100000:3.0:1784044118.094093:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1784044118.094122:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397bbbd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1870705580938240:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1784044118.094151:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1784044118.094359:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784044118.094371:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1870705580938368:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1784044118.094401:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044118.094478:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580938368 00000100:00100000:2.0:1784044118.094483:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580938368 00000100:00100000:2.0:1784044118.094526:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1784044118.094532:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397bbbe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1870705580938368:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1784044118.094544:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784044118.094580:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397bbbe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1870705580938368:12345-0@lo:13:osp-pre-0-1.0 Request processed in 48us (178us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044118.094586:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00010000:00080000:2.0:1784044118.094609:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b3843d2c000 x1870705580938368/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784044134 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784044118.094623:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1870705580938368:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1784044118.094687:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784044118.094735:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397bbbd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1870705580938240:12345-0@lo:41:osp-pre-1-0.0 Request processed in 103us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044118.094748:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1784044118.094782:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397bbbd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1870705580938240:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1784044118.672473:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784044119.117482:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1784044119.117524:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397bbbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1870705580938496:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784044119.117613:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044119.117716:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580938496 00000100:00100000:2.0:1784044119.117726:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580938496 00000100:00100000:2.0:1784044119.117787:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1784044119.117798:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1870705580938496:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1784044119.117848:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784044119.117892:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1870705580938496:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044119.118056:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00080000:2.0:1784044119.118142:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1784044119.118354:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b397bbbc000 x1870705580938496/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784044135 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784044119.118373:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397bbbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1870705580938496:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784044119.118759:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784044119.118770:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397bbbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1870705580938624:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1784044119.118806:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044119.118862:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580938624 00000100:00100000:0.0:1784044119.118867:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580938624 00000100:00100000:0.0:1784044119.118913:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1784044119.118921:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397bbbd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1870705580938624:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1784044119.118933:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784044119.118969:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397bbbd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1870705580938624:12345-0@lo:13:osp-pre-1-1.0 Request processed in 50us (163us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044119.118975:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00010000:00080000:0.0:1784044119.118997:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b397bbbc000 x1870705580938624/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784044135 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784044119.119008:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397bbbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1870705580938624:0@lo:13:osp-pre-1-1.0 00000100:00080000:3.0:1784044119.119252:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784044119.120454:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843cfc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3641:1870705580938880:0@lo:400:kworker.0 00000100:00100000:1.0:1784044119.120507:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044119.120531:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843cff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1870705580939392:0@lo:400:kworker.0 00000100:00100000:1.0:1784044119.120555:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044119.120572:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843dbf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3641:1870705580939904:0@lo:400:kworker.0 00000100:00100000:1.0:1784044119.120590:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044119.120609:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1784044119.120614:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843cffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:3641:1870705580938752:0@lo:400:kworker.0 00000100:00100000:1.0:1784044119.120660:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044119.120684:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843cfc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1870705580939264:0@lo:400:kworker.0 00000100:00100000:1.0:1784044119.120708:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044119.120724:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843dbd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3641:1870705580939776:0@lo:400:kworker.0 00000100:00100000:1.0:1784044119.120743:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044119.120775:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580938880 00000100:00100000:1.0:1784044119.120782:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580938880 00000100:00100000:1.0:1784044119.120819:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580939904 00000100:00100000:1.0:1784044119.120836:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580939904 00000100:00100000:1.0:1784044119.120861:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580939776 00000100:00100000:1.0:1784044119.120864:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580939776 00000100:00100000:1.0:1784044119.120881:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:1.0:1784044119.120889:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843dbc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1870705580938880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044119.120937:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843dbc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1870705580938880:12345-0@lo:400:kworker.0 Request processed in 48us (430us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044119.120945:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:1.0:1784044119.120964:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:1.0:1784044119.120969:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843dbca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1870705580939904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044119.120995:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843dbca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1870705580939904:12345-0@lo:400:kworker.0 Request processed in 26us (403us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044119.121000:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:1.0:1784044119.121011:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:1.0:1784044119.121017:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843dbe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1870705580939776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044119.121042:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843dbe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1870705580939776:12345-0@lo:400:kworker.0 Request processed in 26us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044119.121048:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:1.0:1784044119.121065:0:9822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580939392 00000100:00100000:1.0:1784044119.121069:0:9822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580939392 00000100:00100000:1.0:1784044119.121092:0:9822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1784044119.121098:0:9822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843dbed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3641:x1870705580939392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044119.121127:0:9822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843dbed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3641:x1870705580939392:12345-0@lo:400:kworker.0 Request processed in 29us (571us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044119.121133:0:9822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1784044119.121153:0:7768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580939264 00000100:00100000:1.0:1784044119.121156:0:7768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580939264 00000100:00100000:2.0:1784044119.121223:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580938752 00000100:00100000:2.0:1784044119.121228:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580938752 00000100:00100000:1.0:1784044119.121231:0:7768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1784044119.121236:0:7768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843dbd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1870705580939264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784044119.121252:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 321 00000100:00100000:2.0:1784044119.121258:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3965efd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+24:3641:x1870705580938752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044119.121273:0:7768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843dbd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1870705580939264:12345-0@lo:400:kworker.0 Request processed in 36us (564us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044119.121279:0:7768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1784044119.121292:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3965efd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+24:3641:x1870705580938752:12345-0@lo:400:kworker.0 Request processed in 34us (632us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044119.121298:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 321 00000100:00100000:1.0:1784044119.121311:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843cffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:3641:1870705580938752:0@lo:400:kworker.0 00000100:00100000:1.0:1784044119.121323:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843cfc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1870705580939264:0@lo:400:kworker.0 00010000:00080000:1.0:1784044119.121333:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b3843dbd880 x1870705580939776/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044135 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1784044119.121341:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1784044119.121343:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843dbd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3641:1870705580939776:0@lo:400:kworker.0 00000100:00080000:2.0:1784044119.121345:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784044119.121351:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843cfc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3641:1870705580938880:0@lo:400:kworker.0 00000100:00100000:2.0:1784044119.121353:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843cfca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3639:1870705580939136:0@lo:400:kworker.0 00010000:00080000:1.0:1784044119.121360:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b3843cff800 x1870705580939392/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784044135 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784044119.121367:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843cff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1870705580939392:0@lo:400:kworker.0 00000100:00100000:1.0:1784044119.121375:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843dbf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3641:1870705580939904:0@lo:400:kworker.0 00000100:00100000:2.0:1784044119.121376:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044119.121391:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843dbdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3639:1870705580939648:0@lo:400:kworker.0 00000100:00100000:2.0:1784044119.121422:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044119.121440:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1784044119.121446:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843cfd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1870705580939008:0@lo:400:kworker.0 00000100:00100000:2.0:1784044119.121464:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044119.121480:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843cfd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1870705580939520:0@lo:400:kworker.0 00000100:00100000:2.0:1784044119.121498:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044119.121513:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843dbd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3639:1870705580940032:0@lo:400:kworker.0 00000100:00100000:2.0:1784044119.121545:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044119.121577:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580939136 00000100:00100000:2.0:1784044119.121581:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580939136 00000100:00100000:2.0:1784044119.121598:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580939648 00000100:00100000:2.0:1784044119.121600:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580939648 00000100:00100000:2.0:1784044119.121626:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580940032 00000100:00100000:2.0:1784044119.121629:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580940032 00000100:00100000:2.0:1784044119.121642:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:2.0:1784044119.121647:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1870705580939136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784044119.121679:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1870705580939136:12345-0@lo:400:kworker.0 Request processed in 31us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044119.121685:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:2.0:1784044119.121696:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:2.0:1784044119.121702:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1870705580939648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784044119.121727:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1870705580939648:12345-0@lo:400:kworker.0 Request processed in 26us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044119.121733:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:2.0:1784044119.121743:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:2.0:1784044119.121748:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1870705580940032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784044119.121782:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1870705580940032:12345-0@lo:400:kworker.0 Request processed in 34us (236us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044119.121789:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:0.0:1784044119.121971:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580939008 00000100:00100000:0.0:1784044119.121975:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580939008 00000100:00100000:0.0:1784044119.122103:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1784044119.122112:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1870705580939008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784044119.122145:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1870705580939008:12345-0@lo:400:kworker.0 Request processed in 35us (680us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044119.122150:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00080000:1.0:1784044119.122268:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1784044119.122272:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784044119.125018:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580939520 00000100:00100000:2.0:1784044119.125036:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580939520 00000100:00100000:2.0:1784044119.125128:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1784044119.125139:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d2d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1870705580939520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784044119.125280:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d2d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1870705580939520:12345-0@lo:400:kworker.0 Request processed in 144us (3780us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044119.125288:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1784044119.125344:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843cfd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1870705580939008:0@lo:400:kworker.0 00010000:00080000:2.0:1784044119.125362:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b3843cfd880 x1870705580939520/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784044135 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784044119.125372:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843cfd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1870705580939520:0@lo:400:kworker.0 00010000:00080000:2.0:1784044119.125383:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b3843dbd500 x1870705580940032/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044135 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784044119.125392:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843dbd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3639:1870705580940032:0@lo:400:kworker.0 00000100:00100000:2.0:1784044119.125404:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843cfca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3639:1870705580939136:0@lo:400:kworker.0 00000100:00100000:2.0:1784044119.125414:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843dbdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3639:1870705580939648:0@lo:400:kworker.0 00010000:00010000:3.0:1784044119.694666:0:10331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784044120.725676:0:10330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784044121.747377:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784044121.830284:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044121.830394:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565125760 00000100:00100000:2.0:1784044121.830406:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565125760 00000100:00100000:2.0:1784044121.830463:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 322 00000100:00100000:2.0:1784044121.830473:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3965efc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4a09ad9-a185-4679-99bb-b6a07b865440+13:2410:x1870705565125760:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:2.0:1784044121.830575:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3965efc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4a09ad9-a185-4679-99bb-b6a07b865440+13:2410:x1870705565125760:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 102us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044121.830583:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 322 00000100:00100000:3.0:1784044121.835011:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044121.836493:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565125888 00000100:00100000:2.0:1784044121.836509:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565125888 00000100:00100000:2.0:1784044121.836627:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 204 00000100:00100000:2.0:1784044121.836640:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843ce7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+6:2410:x1870705565125888:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:2.0:1784044121.836740:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843ce7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+6:2410:x1870705565125888:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 103us (1740us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044121.836747:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 204 00000100:00080000:1.0:1784044121.836833:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784044121.863639:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1784044121.863683:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1784044121.863716:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1784044121.863765:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565126144 00000100:00100000:1.0:1784044121.863776:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565126144 00000100:00100000:3.0:1784044121.863805:0:9501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565126016 00000100:00100000:3.0:1784044121.863820:0:9501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565126016 00000100:00100000:1.0:1784044121.863846:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565126272 00000100:00100000:1.0:1784044121.863852:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565126272 00000100:00100000:3.0:1784044121.863897:0:9501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 205 00000100:00100000:3.0:1784044121.863916:0:9501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843dbf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68dfcea6-5d83-4dbb-8fa3-e35542d621e5+5:2409:x1870705565126144:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:3.0:1784044121.864042:0:9501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843dbf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68dfcea6-5d83-4dbb-8fa3-e35542d621e5+5:2409:x1870705565126144:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 132us (414us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044121.864079:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 206 00000100:00100000:1.0:1784044121.864094:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843dbd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+5:2410:x1870705565126016:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:1.0:1784044121.864212:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843dbd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+5:2410:x1870705565126016:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 121us (527us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044121.864221:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 206 00000100:00100000:1.0:1784044121.864241:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 207 00000100:00100000:1.0:1784044121.864249:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843dbc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68dfcea6-5d83-4dbb-8fa3-e35542d621e5+5:2410:x1870705565126272:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:1.0:1784044121.864273:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843dbc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68dfcea6-5d83-4dbb-8fa3-e35542d621e5+5:2410:x1870705565126272:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 25us (556us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044121.864279:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 207 00000100:00080000:1.0:1784044121.864299:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1784044121.864303:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784044121.873332:0:9501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 205 00000020:00000080:2.0:1784044122.100558:0:13180:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffcb92c8b60 20000000:00000080:2.0:1784044122.100587:0:13180:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9b38430b7800 uarg=0000000000000000 20000000:01000000:2.0:1784044122.100652:0:13180:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1784044122.100660:0:13180:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1784044122.100665:0:13180:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1784044122.101291:0:13181:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:3.0:1784044122.101705:0:13180:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:3.0:1784044122.109019:0:13180:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1784044122.109077:0:13180:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b39759f9400/0x89871fc3aba18081 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044122.109108:0:13180:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b39759f8800/0x89871fc3aba18011 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6574 expref: 12 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044122.109121:0:13180:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b39586ef000/0x89871fc3aba1801f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x89871fc3aba18018 expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044122.109129:0:13180:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b39759f9800/0x89871fc3aba1802d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x89871fc3aba18026 expref: 23 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044122.109168:0:13180:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b39586ef400/0x89871fc3aba1803b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x89871fc3aba18034 expref: 23 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044122.109531:0:13180:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b39759f8600/0x89871fc3aba18049 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x89871fc3aba18042 expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044122.109541:0:13180:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b38410b6000/0x89871fc3aba1805e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca65b3 expref: 12 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044122.109552:0:13180:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b39759f9400/0x89871fc3aba18081 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044122.109619:0:13180:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b38410b6000/0x89871fc3aba1805e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca65b3 expref: 12 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044122.109638:0:13180:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b38410b6000/0x89871fc3aba1805e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca65b3 expref: 12 pid: 6504 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044122.109657:0:13180:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843ce5500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13180:1870705580940160:192.168.202.40@tcp:104: 00010000:00010000:3.0:1784044122.109812:0:13180:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b39759f8600/0x89871fc3aba18049 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x89871fc3aba18042 expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044122.109821:0:13180:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b39759f8600/0x89871fc3aba18049 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x89871fc3aba18042 expref: 23 pid: 6506 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044122.109831:0:13180:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843ce4380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13180:1870705580940288:0@lo:104: 00000100:00100000:3.0:1784044122.109969:0:13180:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1784044122.110022:0:13180:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b39586ef400/0x89871fc3aba1803b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x89871fc3aba18034 expref: 23 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044122.110041:0:13180:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b39586ef400/0x89871fc3aba1803b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x89871fc3aba18034 expref: 23 pid: 6504 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044122.110051:0:13180:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843c88e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13180:1870705580940416:0@lo:104: 00000100:00100000:3.0:1784044122.110079:0:13180:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1784044122.110104:0:13180:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b39759f9800/0x89871fc3aba1802d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x89871fc3aba18026 expref: 23 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044122.110113:0:13180:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b39759f9800/0x89871fc3aba1802d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x89871fc3aba18026 expref: 23 pid: 6504 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044122.110122:0:13180:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b38420aa300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13180:1870705580940544:0@lo:104: 00000100:00100000:3.0:1784044122.110206:0:13180:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1784044122.110235:0:13180:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b39586ef000/0x89871fc3aba1801f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x89871fc3aba18018 expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044122.110244:0:13180:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b39586ef000/0x89871fc3aba1801f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x89871fc3aba18018 expref: 23 pid: 6505 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044122.110253:0:13180:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b38420ab800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13180:1870705580940672:0@lo:104: 00000100:00100000:3.0:1784044122.110279:0:13180:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1784044122.110297:0:13180:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b39759f8800/0x89871fc3aba18011 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6574 expref: 12 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044122.110306:0:13180:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b39759f8800/0x89871fc3aba18011 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6574 expref: 12 pid: 6505 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044122.110317:0:13180:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b38420aad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13180:1870705580940800:192.168.202.40@tcp:104: 00000100:00100000:3.0:1784044122.110353:0:13180:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b38436ea840 going to sleep for 11 seconds 00000100:00100000:2.0:1784044122.110529:0:6494:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1784044122.110552:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580940288 00000100:00100000:2.0:1784044122.110562:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580940288 00000100:00100000:2.0:1784044122.110629:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580940416 00000100:00100000:2.0:1784044122.110632:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580940416 00000100:00100000:2.0:1784044122.110646:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580940544 00000100:00100000:2.0:1784044122.110648:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580940544 00000100:00100000:2.0:1784044122.110659:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580940672 00000100:00100000:2.0:1784044122.110661:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580940672 00000100:00100000:2.0:1784044122.110676:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1784044122.110688:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843ce5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+6:13180:x1870705580940288:12345-0@lo:104: 00010000:00010000:2.0:1784044122.110705:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.140@tcp lock: ffff9b39586ee400/0x89871fc3aba18042 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x89871fc3aba18049 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044122.110796:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1784044122.110803:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843ce5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+6:13180:x1870705580940288:12345-0@lo:104: Request processed in 117us (834us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044122.110812:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1784044122.110839:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1784044122.110845:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843c8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+5:13180:x1870705580940416:12345-0@lo:104: 00010000:00010000:2.0:1784044122.110854:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.140@tcp lock: ffff9b39759f9c00/0x89871fc3aba18034 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x89871fc3aba1803b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044122.110976:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1784044122.110983:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843c8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+5:13180:x1870705580940416:12345-0@lo:104: Request processed in 138us (903us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044122.110990:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1784044122.111003:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1784044122.111010:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38420a8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+4:13180:x1870705580940544:12345-0@lo:104: 00010000:00010000:2.0:1784044122.111019:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.140@tcp lock: ffff9b39759f8200/0x89871fc3aba18026 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x89871fc3aba1802d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044122.111056:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1784044122.111062:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38420a8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+4:13180:x1870705580940544:12345-0@lo:104: Request processed in 53us (856us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044122.111068:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1784044122.111080:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1784044122.111086:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3975ac2850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+3:13180:x1870705580940672:12345-0@lo:104: 00010000:00010000:2.0:1784044122.111094:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.140@tcp lock: ffff9b39759f8e00/0x89871fc3aba18018 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x89871fc3aba1801f expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044122.111147:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1784044122.111153:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3975ac2850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+3:13180:x1870705580940672:12345-0@lo:104: Request processed in 68us (874us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044122.111159:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00010000:2.0:1784044122.111240:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1784044122.111249:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: ffff9b39586ee400/0x89871fc3aba18042 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x89871fc3aba18049 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044122.111257:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b39586ee400 already unused, calling callback (ffffffffc113cc20) 10000000:00010000:2.0:1784044122.111262:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: ffff9b39586ee400/0x89871fc3aba18042 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x89871fc3aba18049 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044122.111272:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9b39586ee400/0x89871fc3aba18042 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x89871fc3aba18049 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784044122.111280:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9b39586ee400/0x89871fc3aba18042 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x89871fc3aba18049 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784044122.111286:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1784044122.111326:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.140@tcp lock: ffff9b39586ee400/0x89871fc3aba18042 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x89871fc3aba18049 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044122.111332:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784044122.111360:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: ffff9b39586ee400/0x89871fc3aba18042 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x89871fc3aba18049 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044122.111367:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9b39586ee400/0x89871fc3aba18042 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x89871fc3aba18049 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044122.112042:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1784044122.112046:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: ffff9b39759f9c00/0x89871fc3aba18034 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x89871fc3aba1803b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044122.112053:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b39759f9c00 already unused, calling callback (ffffffffc113cc20) 10000000:00010000:2.0:1784044122.112056:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: ffff9b39759f9c00/0x89871fc3aba18034 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x89871fc3aba1803b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044122.112063:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9b39759f9c00/0x89871fc3aba18034 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x89871fc3aba1803b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784044122.112070:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9b39759f9c00/0x89871fc3aba18034 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x89871fc3aba1803b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784044122.112075:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1784044122.112095:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.140@tcp lock: ffff9b39759f9c00/0x89871fc3aba18034 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x89871fc3aba1803b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044122.112101:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784044122.112144:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: ffff9b39759f9c00/0x89871fc3aba18034 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x89871fc3aba1803b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044122.112151:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9b39759f9c00/0x89871fc3aba18034 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x89871fc3aba1803b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044122.112161:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1784044122.112165:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: ffff9b39759f8200/0x89871fc3aba18026 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x89871fc3aba1802d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044122.112202:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b39759f8200 already unused, calling callback (ffffffffc113cc20) 10000000:00010000:2.0:1784044122.112205:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: ffff9b39759f8200/0x89871fc3aba18026 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x89871fc3aba1802d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044122.112212:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9b39759f8200/0x89871fc3aba18026 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x89871fc3aba1802d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784044122.112219:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9b39759f8200/0x89871fc3aba18026 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x89871fc3aba1802d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784044122.112225:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1784044122.112239:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.140@tcp lock: ffff9b39759f8200/0x89871fc3aba18026 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x89871fc3aba1802d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044122.112244:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784044122.112251:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: ffff9b39759f8200/0x89871fc3aba18026 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x89871fc3aba1802d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044122.112256:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9b39759f8200/0x89871fc3aba18026 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x89871fc3aba1802d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044122.112265:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784044122.112268:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: ffff9b39759f8e00/0x89871fc3aba18018 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x89871fc3aba1801f expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044122.112273:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b39759f8e00 already unused, calling callback (ffffffffc113cc20) 10000000:00010000:2.0:1784044122.112276:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: ffff9b39759f8e00/0x89871fc3aba18018 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x89871fc3aba1801f expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044122.112291:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9b39759f8e00/0x89871fc3aba18018 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x89871fc3aba1801f expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784044122.112298:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9b39759f8e00/0x89871fc3aba18018 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x89871fc3aba1801f expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784044122.112303:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1784044122.112317:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.140@tcp lock: ffff9b39759f8e00/0x89871fc3aba18018 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x89871fc3aba1801f expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044122.112323:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784044122.112330:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: ffff9b39759f8e00/0x89871fc3aba18018 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x89871fc3aba1801f expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044122.112336:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9b39759f8e00/0x89871fc3aba18018 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x89871fc3aba1801f expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044122.112351:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784044122.112353:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784044122.112354:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784044122.112363:0:10331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784044122.112622:0:13180:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843ce4380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13180:1870705580940288:0@lo:104: 00000100:00100000:3.0:1784044122.112634:0:13180:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843c88e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13180:1870705580940416:0@lo:104: 00000100:00100000:3.0:1784044122.112644:0:13180:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b38420aa300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13180:1870705580940544:0@lo:104: 00000100:00100000:3.0:1784044122.112652:0:13180:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b38420ab800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13180:1870705580940672:0@lo:104: 00000100:00100000:0.0:1784044122.112727:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843ce5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:3640:1870705580941056:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784044122.112802:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044122.112857:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784044122.112863:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843c8aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:3640:1870705580941184:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784044122.113020:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580941056 00000100:00100000:3.0:1784044122.113027:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580941056 00010000:00010000:3.0:1784044122.113067:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b39586ef400/0x89871fc3aba1803b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x89871fc3aba18034 expref: 24 pid: 6504 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044122.113108:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1784044122.113117:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397bbbc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+24:3640:x1870705580941056:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784044122.113143:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784044122.113150:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b39586ef400/0x89871fc3aba1803b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x89871fc3aba18034 expref: 24 pid: 6504 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044122.113161:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b39586ef400/0x89871fc3aba1803b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x89871fc3aba18034 expref: 24 pid: 6504 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044122.113206:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b39586ef400/0x89871fc3aba1803b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x89871fc3aba18034 expref: 24 pid: 6504 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044122.113225:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784044122.113260:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397bbbc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+23:3640:x1870705580941056:12345-0@lo:103:ldlm_bl.0 Request processed in 144us (458us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044122.113267:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00010000:2.0:1784044122.113327:0:10330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784044122.113339:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784044122.113366:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:3639:1870705580940928:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784044122.113720:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044122.113773:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843ce5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:3640:1870705580941056:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784044122.113872:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580941184 00000100:00100000:3.0:1784044122.113888:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580941184 00010000:00010000:3.0:1784044122.113925:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b39759f9800/0x89871fc3aba1802d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x89871fc3aba18026 expref: 23 pid: 6504 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044122.113950:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1784044122.113957:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843c55c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+23:3640:x1870705580941184:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784044122.113966:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784044122.113970:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b39759f9800/0x89871fc3aba1802d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x89871fc3aba18026 expref: 23 pid: 6504 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044122.113980:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b39759f9800/0x89871fc3aba1802d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x89871fc3aba18026 expref: 23 pid: 6504 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044122.113993:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b39759f9800/0x89871fc3aba1802d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x89871fc3aba18026 expref: 23 pid: 6504 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044122.114005:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784044122.114034:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843c55c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+22:3640:x1870705580941184:12345-0@lo:103:ldlm_bl.0 Request processed in 78us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044122.114042:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1784044122.114273:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843c8aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:3640:1870705580941184:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784044122.114595:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044122.114629:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1784044122.114638:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3945932a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:3639:1870705580941312:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784044122.114661:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044122.114704:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580940928 00000100:00100000:2.0:1784044122.114711:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580940928 00010000:00010000:2.0:1784044122.114733:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b39759f8600/0x89871fc3aba18049 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x89871fc3aba18042 expref: 22 pid: 6506 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044122.114749:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580941312 00000100:00100000:2.0:1784044122.114752:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580941312 00010000:00010000:2.0:1784044122.114765:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b39586ef000/0x89871fc3aba1801f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x89871fc3aba18018 expref: 23 pid: 6505 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044122.115118:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1784044122.115130:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3945931500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+23:3639:x1870705580940928:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784044122.115154:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784044122.115160:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b39759f8600/0x89871fc3aba18049 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x89871fc3aba18042 expref: 23 pid: 6506 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044122.115171:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b39759f8600/0x89871fc3aba18049 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x89871fc3aba18042 expref: 23 pid: 6506 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044122.115211:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b39759f8600/0x89871fc3aba18049 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x89871fc3aba18042 expref: 23 pid: 6506 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044122.115225:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784044122.115264:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3945931500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+22:3639:x1870705580940928:12345-0@lo:103:ldlm_bl.0 Request processed in 136us (669us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044122.115319:0:6496:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1784044122.115329:0:6496:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:3.0:1784044122.116234:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1784044122.116251:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3945930a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+22:3639:x1870705580941312:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784044122.116267:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784044122.116274:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b39586ef000/0x89871fc3aba1801f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x89871fc3aba18018 expref: 22 pid: 6505 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044122.116287:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b39586ef000/0x89871fc3aba1801f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x89871fc3aba18018 expref: 22 pid: 6505 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044122.116304:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b39586ef000/0x89871fc3aba1801f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x89871fc3aba18018 expref: 22 pid: 6505 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044122.116340:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784044122.116665:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3945930a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+21:3639:x1870705580941312:12345-0@lo:103:ldlm_bl.0 Request processed in 420us (2001us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044122.116674:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1784044122.116742:0:13180:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843ce5500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13180:1870705580940160:192.168.202.40@tcp:104: 00000100:00100000:3.0:1784044122.116755:0:13180:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b38420aad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13180:1870705580940800:192.168.202.40@tcp:104: 00010000:00010000:3.0:1784044122.116810:0:13180:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b39759f9400/0x89871fc3aba18081 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044122.117171:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044122.117301:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044122.117325:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565126528 00000100:00100000:3.0:1784044122.117333:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565126528 00010000:00010000:3.0:1784044122.117362:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b39759f8800/0x89871fc3aba18011 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6574 expref: 13 pid: 6505 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044122.117392:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565126400 00000100:00100000:3.0:1784044122.117396:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565126400 00010000:00010000:3.0:1784044122.117408:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b38410b6000/0x89871fc3aba1805e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca65b3 expref: 14 pid: 6504 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044122.117423:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 44 00000100:00100000:3.0:1784044122.117430:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38420aad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c4a09ad9-a185-4679-99bb-b6a07b865440+14:2410:x1870705565126528:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784044122.117441:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784044122.117445:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b39759f8800/0x89871fc3aba18011 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6574 expref: 14 pid: 6505 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044122.117472:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b39759f8800/0x89871fc3aba18011 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6574 expref: 14 pid: 6505 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044122.117487:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b39759f8800/0x89871fc3aba18011 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6574 expref: 14 pid: 6505 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044122.117502:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784044122.117555:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38420aad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c4a09ad9-a185-4679-99bb-b6a07b865440+13:2410:x1870705565126528:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 125us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044122.117563:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 44 00000100:00100000:3.0:1784044122.117580:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 45 00000100:00100000:3.0:1784044122.117586:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3944093450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c4a09ad9-a185-4679-99bb-b6a07b865440+12:2410:x1870705565126400:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784044122.117594:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784044122.117599:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b38410b6000/0x89871fc3aba1805e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca65b3 expref: 12 pid: 6504 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044122.117609:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b38410b6000/0x89871fc3aba1805e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca65b3 expref: 12 pid: 6504 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044122.117620:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b38410b6000/0x89871fc3aba1805e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca65b3 expref: 12 pid: 6504 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044122.117632:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b39759f9400/0x89871fc3aba18081 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044122.117641:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b39759f9400/0x89871fc3aba18081 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044122.117668:0:6498:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b39759f9400/0x89871fc3aba18081 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044122.117675:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b39759f9400/0x89871fc3aba18081 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044122.117681:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b39759f9400/0x89871fc3aba18081 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044122.117689:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b39759f9400/0x89871fc3aba18081 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044122.117696:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b39759f9400 already unused, calling callback (ffffffffc0b56230) 00010000:00010000:3.0:1784044122.117701:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b39759f9400/0x89871fc3aba18081 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044122.117710:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b39759f9400/0x89871fc3aba18081 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044122.117726:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b39759f9400/0x89871fc3aba18081 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044122.117736:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784044122.117758:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3944093450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c4a09ad9-a185-4679-99bb-b6a07b865440+11:2410:x1870705565126400:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 171us (457us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044122.117765:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 45 00010000:00010000:3.0:1784044122.117802:0:13180:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b39759f9400/0x89871fc3aba18081 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044122.117810:0:13180:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b39759f9400/0x89871fc3aba18081 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044122.117823:0:13180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b39759f9400/0x89871fc3aba18081 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044122.121762:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1784044122.123457:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3945932a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:3639:1870705580941312:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784044122.123475:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:3639:1870705580940928:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784044122.189733:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784044122.189769:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843dbdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1870705580941440:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1784044122.190026:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044122.190085:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580941440 00000100:00100000:1.0:1784044122.190095:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580941440 00000100:00100000:1.0:1784044122.190169:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1784044122.190208:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38420ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1870705580941440:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1784044122.190257:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1784044122.190333:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38420ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1870705580941440:12345-0@lo:41:osp-pre-0-1.0 Request processed in 128us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044122.190420:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843dbdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1870705580941440:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1784044122.198418:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00010000:00010000:2.0:1784044122.765525:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784044123.213336:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1784044123.213361:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3945930a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1870705580941568:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1784044123.213434:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044123.213516:0:10713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580941568 00000100:00100000:2.0:1784044123.213524:0:10713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580941568 00000100:00100000:2.0:1784044123.213581:0:10713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1784044123.213591:0:10713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3945931500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1870705580941568:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1784044123.213622:0:10713:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784044123.213681:0:10713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3945931500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1870705580941568:12345-0@lo:13:osp-pre-0-1.0 Request processed in 91us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044123.213688:0:10713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00080000:2.0:1784044123.213707:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1784044123.213736:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b3945930a80 x1870705580941568/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784044139 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784044123.213753:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3945930a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1870705580941568:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1784044123.215591:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784044123.215609:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b38420aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1870705580941696:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784044123.215674:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044123.215897:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580941696 00000100:00100000:3.0:1784044123.215903:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580941696 00000100:00100000:3.0:1784044123.215961:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1784044123.215968:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843dbd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1870705580941696:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1784044123.215987:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784044123.216027:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843dbd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1870705580941696:12345-0@lo:13:osp-pre-0-0.0 Request processed in 59us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044123.216040:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1784044123.216806:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3945930a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1870705580941824:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1784044123.216843:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044123.216881:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580941824 00000100:00100000:2.0:1784044123.216885:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580941824 00000100:00100000:2.0:1784044123.216913:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1784044123.216920:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3945933480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1870705580941824:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1784044123.216947:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1784044123.216984:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3945933480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1870705580941824:12345-0@lo:41:osp-pre-1-0.0 Request processed in 64us (140us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044123.216990:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1784044123.217028:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3945930a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1870705580941824:0@lo:41:osp-pre-1-0.0 00000100:00080000:1.0:1784044123.217293:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1784044123.217320:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b38420aa300 x1870705580941696/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784044139 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784044123.217336:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b38420aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1870705580941696:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1784044123.790927:0:10331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784044123.879604:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044123.879710:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565126656 00000100:00100000:2.0:1784044123.879720:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565126656 00000100:00100000:2.0:1784044123.879801:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 323 00000100:00100000:2.0:1784044123.879812:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3965efbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4a09ad9-a185-4679-99bb-b6a07b865440+11:6180:x1870705565126656:12345-192.168.202.40@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784044123.879830:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784044123.879854:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b3843798200/0x89871fc3aba18088 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd3dffad52ca65e4 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044123.879894:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b3843798200/0x89871fc3aba18088 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca65e4 expref: 12 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044123.879906:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b3843798200/0x89871fc3aba18088 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca65e4 expref: 12 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044123.879915:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3843798200, rc 0) 00000100:00100000:2.0:1784044123.879980:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3965efbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4a09ad9-a185-4679-99bb-b6a07b865440+12:6180:x1870705565126656:12345-192.168.202.40@tcp:101:ll_cfg_requeue.0 Request processed in 169us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044123.879988:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 323 00000100:00100000:1.0:1784044123.884259:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044123.884399:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565126784 00000100:00100000:0.0:1784044123.884409:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565126784 00000100:00100000:0.0:1784044123.884461:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 324 00000100:00100000:0.0:1784044123.884479:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3965efac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4a09ad9-a185-4679-99bb-b6a07b865440+12:6180:x1870705565126784:12345-192.168.202.40@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784044123.884620:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3965efac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4a09ad9-a185-4679-99bb-b6a07b865440+12:6180:x1870705565126784:12345-192.168.202.40@tcp:501:ll_cfg_requeue.0 Request processed in 143us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044123.884628:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 324 00000100:00100000:3.0:1784044123.887288:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1784044123.887546:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565126912 00000100:00100000:1.0:1784044123.887554:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565126912 00000100:00100000:1.0:1784044123.887619:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 325 00000100:00100000:1.0:1784044123.887628:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3965ef8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4a09ad9-a185-4679-99bb-b6a07b865440+12:6180:x1870705565126912:12345-192.168.202.40@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784044123.887770:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3965ef8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4a09ad9-a185-4679-99bb-b6a07b865440+12:6180:x1870705565126912:12345-192.168.202.40@tcp:503:ll_cfg_requeue.0 Request processed in 143us (500us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044123.887778:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 325 00000100:00100000:1.0:1784044123.894166:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044123.894720:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565127040 00000100:00100000:2.0:1784044123.894732:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565127040 00000100:00100000:2.0:1784044123.894790:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 326 00000100:00100000:2.0:1784044123.894800:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3965ef9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4a09ad9-a185-4679-99bb-b6a07b865440+12:6180:x1870705565127040:12345-192.168.202.40@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784044123.894818:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784044123.894837:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b3843798800/0x89871fc3aba1808f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd3dffad52ca65eb expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044123.894875:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b3843798800/0x89871fc3aba1808f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca65eb expref: 13 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044123.894886:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b3843798800/0x89871fc3aba1808f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca65eb expref: 13 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044123.894911:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3843798800, rc 0) 00000100:00100000:2.0:1784044123.894972:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3965ef9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4a09ad9-a185-4679-99bb-b6a07b865440+13:6180:x1870705565127040:12345-192.168.202.40@tcp:101:ll_cfg_requeue.0 Request processed in 174us (816us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044123.894979:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 326 00000100:00100000:2.0:1784044123.898082:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044123.898227:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565127168 00000100:00100000:0.0:1784044123.898236:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565127168 00000100:00100000:0.0:1784044123.898308:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 327 00000100:00100000:0.0:1784044123.898320:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3965ef9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4a09ad9-a185-4679-99bb-b6a07b865440+13:6180:x1870705565127168:12345-192.168.202.40@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784044123.898483:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3965ef9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4a09ad9-a185-4679-99bb-b6a07b865440+13:6180:x1870705565127168:12345-192.168.202.40@tcp:501:ll_cfg_requeue.0 Request processed in 166us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044123.898491:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 327 00000100:00100000:2.0:1784044123.917263:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044123.917433:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565127296 00000100:00100000:3.0:1784044123.917444:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565127296 00000100:00100000:3.0:1784044123.917494:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 328 00000100:00100000:3.0:1784044123.917504:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3965ef8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4a09ad9-a185-4679-99bb-b6a07b865440+13:6180:x1870705565127296:12345-192.168.202.40@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784044123.917671:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3965ef8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4a09ad9-a185-4679-99bb-b6a07b865440+13:6180:x1870705565127296:12345-192.168.202.40@tcp:503:ll_cfg_requeue.0 Request processed in 167us (415us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044123.917679:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 328 10000000:01000000:2.0:1784044124.109256:0:6508:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1784044124.109275:0:6508:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9b384244a000 from 7 10000000:01000000:2.0:1784044124.109281:0:6508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1784044124.109341:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b3843798e00/0x89871fc3aba18096 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044124.109357:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9b3843798e00/0x89871fc3aba18096 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044124.109370:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9b3843798e00/0x89871fc3aba18096 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044124.109403:0:6508:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3945930a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580941952:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1784044124.109478:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044124.109556:0:6508:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3843df7d80 going to sleep for 11 seconds 00000100:00100000:3.0:1784044124.109754:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580941952 00000100:00100000:3.0:1784044124.109764:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580941952 00000100:00100000:3.0:1784044124.109831:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 329 00000100:00100000:3.0:1784044124.109840:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3965efa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+20:6508:x1870705580941952:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784044124.109855:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784044124.109868:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b39759f9400/0x89871fc3aba1809d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x89871fc3aba18096 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044124.109892:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b39759f9400/0x89871fc3aba1809d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x89871fc3aba18096 expref: 21 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044124.109903:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b39759f9400/0x89871fc3aba1809d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x89871fc3aba18096 expref: 21 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044124.109912:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b39759f9400, rc 0) 00000100:00100000:3.0:1784044124.109957:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3965efa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+21:6508:x1870705580941952:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 117us (478us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044124.109964:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 329 00000100:00100000:0.0:1784044124.110068:0:6508:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3945930a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580941952:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784044124.110083:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9b3843798e00/0x89871fc3aba18096 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba1809d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044124.110092:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9b3843798e00/0x89871fc3aba18096 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x89871fc3aba1809d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044124.110171:0:6508:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843c54700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580942080:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784044124.110229:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044124.110248:0:6508:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3942e1a3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784044124.110371:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580942080 00000100:00100000:3.0:1784044124.110376:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580942080 00000100:00100000:3.0:1784044124.110409:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 330 00000100:00100000:3.0:1784044124.110416:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3965ef8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+21:6508:x1870705580942080:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784044124.110531:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3965ef8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+21:6508:x1870705580942080:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 116us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044124.110539:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 330 00000100:00100000:3.0:1784044124.110568:0:6508:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843c54700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580942080:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784044124.110611:0:6508:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b38420aa680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580942208:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784044124.110650:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044124.110663:0:6508:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b38436eacc0 going to sleep for 11 seconds 00000100:00100000:3.0:1784044124.110680:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580942208 00000100:00100000:3.0:1784044124.110683:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580942208 00000100:00100000:3.0:1784044124.110699:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 331 00000100:00100000:3.0:1784044124.110704:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3965efb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+21:6508:x1870705580942208:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784044124.110773:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3965efb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+21:6508:x1870705580942208:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 67us (122us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044124.110780:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 331 00000100:00100000:3.0:1784044124.110815:0:6508:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b38420aa680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580942208:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1784044124.111513:0:13231:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1784044124.111567:0:6508:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1784044124.111587:0:6508:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1784044124.111594:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b3843798e00/0x89871fc3aba18096 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba1809d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044124.111604:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9b3843798e00/0x89871fc3aba18096 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba1809d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784044124.111612:0:6508:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1784044124.111615:0:6508:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9b3975aa3000 from 7 10000000:01000000:3.0:1784044124.111617:0:6508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1784044124.111638:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b39759f8800/0x89871fc3aba180a4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044124.111645:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9b39759f8800/0x89871fc3aba180a4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044124.111653:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9b39759f8800/0x89871fc3aba180a4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044124.111668:0:6508:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b38420aa680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580942336:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784044124.111703:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044124.111718:0:6508:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b397ab38900 going to sleep for 11 seconds 00000100:00100000:3.0:1784044124.111731:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580942336 00000100:00100000:3.0:1784044124.111734:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580942336 00000100:00100000:3.0:1784044124.111757:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 332 00000100:00100000:3.0:1784044124.111763:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3965ef9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+21:6508:x1870705580942336:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784044124.111771:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784044124.111781:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b39759f9800/0x89871fc3aba180ab lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x89871fc3aba180a4 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044124.111797:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b39759f9800/0x89871fc3aba180ab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x89871fc3aba180a4 expref: 22 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044124.111806:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b39759f9800/0x89871fc3aba180ab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x89871fc3aba180a4 expref: 22 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044124.111814:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b39759f9800, rc 0) 00000100:00100000:3.0:1784044124.111840:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3965ef9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+22:6508:x1870705580942336:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 77us (136us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044124.111845:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 332 00000100:00100000:3.0:1784044124.111874:0:6508:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b38420aa680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580942336:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784044124.111886:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9b39759f8800/0x89871fc3aba180a4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba180ab expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044124.111894:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9b39759f8800/0x89871fc3aba180a4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x89871fc3aba180ab expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044124.111931:0:6508:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b38420aa680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580942464:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784044124.111958:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044124.111969:0:6508:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b397ab38900 going to sleep for 11 seconds 00000100:00100000:3.0:1784044124.111980:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580942464 00000100:00100000:3.0:1784044124.111982:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580942464 00000100:00100000:3.0:1784044124.111997:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 333 00000100:00100000:3.0:1784044124.112002:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3965efa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+22:6508:x1870705580942464:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784044124.112075:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3965efa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+22:6508:x1870705580942464:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 72us (116us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044124.112081:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 333 00000100:00100000:3.0:1784044124.112105:0:6508:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b38420aa680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580942464:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784044124.112140:0:6508:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b38420aa680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580942592:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784044124.112171:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044124.112203:0:6508:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b397ab38900 going to sleep for 11 seconds 00000100:00100000:3.0:1784044124.112213:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580942592 00000100:00100000:3.0:1784044124.112216:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580942592 00000100:00100000:3.0:1784044124.112232:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 334 00000100:00100000:3.0:1784044124.112236:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3965efb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+22:6508:x1870705580942592:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784044124.112295:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3965efb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+22:6508:x1870705580942592:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 58us (123us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044124.112301:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 334 00000100:00100000:3.0:1784044124.112333:0:6508:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b38420aa680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580942592:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1784044124.121876:0:13232:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1784044124.122384:0:6508:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1784044124.122412:0:6508:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1784044124.122424:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b39759f8800/0x89871fc3aba180a4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba180ab expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044124.122452:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9b39759f8800/0x89871fc3aba180a4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba180ab expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784044124.122463:0:6508:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1784044124.122465:0:6508:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9b396f3cf800 from 7 10000000:01000000:3.0:1784044124.122468:0:6508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1784044124.122508:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b39759f8000/0x89871fc3aba180b2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044124.122527:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9b39759f8000/0x89871fc3aba180b2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044124.122538:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9b39759f8000/0x89871fc3aba180b2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044124.122565:0:6508:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b38420aa680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580942720:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784044124.123264:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044124.123322:0:6508:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b397ab38900 going to sleep for 11 seconds 00000100:00100000:2.0:1784044124.123504:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580942720 00000100:00100000:2.0:1784044124.123511:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580942720 00000100:00100000:2.0:1784044124.124446:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 335 00000100:00100000:2.0:1784044124.124459:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3965ef9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+22:6508:x1870705580942720:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784044124.124476:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784044124.124500:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b3843799200/0x89871fc3aba180b9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x89871fc3aba180b2 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044124.124652:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b3843799200/0x89871fc3aba180b9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x89871fc3aba180b2 expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044124.124665:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b3843799200/0x89871fc3aba180b9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x89871fc3aba180b2 expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044124.124674:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3843799200, rc 0) 00000100:00100000:2.0:1784044124.124737:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3965ef9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+23:6508:x1870705580942720:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 280us (1474us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044124.124743:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 335 00000100:00100000:3.0:1784044124.125212:0:6508:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b38420aa680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580942720:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784044124.125234:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9b39759f8000/0x89871fc3aba180b2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba180b9 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044124.125244:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9b39759f8000/0x89871fc3aba180b2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x89871fc3aba180b9 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044124.126230:0:6508:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b38420aa680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580942848:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784044124.126411:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044124.126504:0:6508:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b397ab38900 going to sleep for 11 seconds 00000100:00100000:2.0:1784044124.135167:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580942848 00000100:00100000:2.0:1784044124.135346:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580942848 00000100:00100000:2.0:1784044124.135465:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 336 00000100:00100000:2.0:1784044124.135476:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3965ef8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+23:6508:x1870705580942848:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784044124.135670:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3965ef8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+23:6508:x1870705580942848:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 195us (9258us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044124.135678:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 336 00000100:00100000:0.0:1784044124.135763:0:6508:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b38420aa680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580942848:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784044124.135820:0:6508:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843c54a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580942976:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784044124.135875:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044124.150789:0:6508:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3942e1af00 going to sleep for 11 seconds 00000100:00100000:3.0:1784044124.152751:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580942976 00000100:00100000:3.0:1784044124.152766:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580942976 00000100:00100000:3.0:1784044124.152829:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 337 00000100:00100000:3.0:1784044124.152839:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3965efb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+23:6508:x1870705580942976:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784044124.153007:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3965efb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+23:6508:x1870705580942976:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 169us (17130us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044124.153015:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 337 00000100:00100000:2.0:1784044124.165360:0:6508:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843c54a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580942976:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1784044124.173829:0:13233:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1784044124.173913:0:6508:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1784044124.173934:0:6508:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1784044124.173948:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b39759f8000/0x89871fc3aba180b2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba180b9 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044124.173960:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9b39759f8000/0x89871fc3aba180b2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba180b9 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784044124.173971:0:6508:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1784044124.173974:0:6508:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9b397418c800 from 7 10000000:01000000:3.0:1784044124.173977:0:6508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1784044124.174019:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b39759f9200/0x89871fc3aba180c0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044124.174028:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9b39759f9200/0x89871fc3aba180c0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044124.174039:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9b39759f9200/0x89871fc3aba180c0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044124.174076:0:6508:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b38420ab100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580943104:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784044124.174171:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044124.174239:0:6508:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b397ab386c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784044124.174262:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580943104 00000100:00100000:3.0:1784044124.174268:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580943104 00000100:00100000:3.0:1784044124.174314:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 338 00000100:00100000:3.0:1784044124.174324:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3965efa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+23:6508:x1870705580943104:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784044124.174340:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784044124.174355:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b39759f9e00/0x89871fc3aba180c7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x89871fc3aba180c0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044124.174378:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b39759f9e00/0x89871fc3aba180c7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x89871fc3aba180c0 expref: 24 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044124.174389:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b39759f9e00/0x89871fc3aba180c7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x89871fc3aba180c0 expref: 24 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044124.174397:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b39759f9e00, rc 0) 00000100:00100000:3.0:1784044124.174435:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3965efa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+24:6508:x1870705580943104:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 111us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044124.174441:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 338 00000100:00100000:3.0:1784044124.174491:0:6508:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b38420ab100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580943104:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784044124.174505:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9b39759f9200/0x89871fc3aba180c0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba180c7 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044124.174513:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9b39759f9200/0x89871fc3aba180c0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x89871fc3aba180c7 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044124.174560:0:6508:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b38420ab100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580943232:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784044124.174592:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044124.174605:0:6508:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b397ab386c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784044124.174616:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580943232 00000100:00100000:3.0:1784044124.174619:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580943232 00000100:00100000:3.0:1784044124.174640:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 339 00000100:00100000:3.0:1784044124.174647:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3950377450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+24:6508:x1870705580943232:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784044124.174745:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3950377450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+24:6508:x1870705580943232:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 98us (152us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044124.174752:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 339 00000100:00100000:3.0:1784044124.174784:0:6508:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b38420ab100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580943232:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784044124.174808:0:6508:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b38420ab100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580943360:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784044124.174846:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044124.174859:0:6508:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b397ab386c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784044124.174870:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580943360 00000100:00100000:3.0:1784044124.174873:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580943360 00000100:00100000:3.0:1784044124.174894:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 340 00000100:00100000:3.0:1784044124.174901:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3950374050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+24:6508:x1870705580943360:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784044124.174969:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3950374050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+24:6508:x1870705580943360:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 69us (122us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044124.174975:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 340 00000100:00100000:3.0:1784044124.175013:0:6508:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b38420ab100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580943360:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1784044124.186074:0:13234:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1784044124.187596:0:6508:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1784044124.187632:0:6508:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1784044124.187645:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b39759f9200/0x89871fc3aba180c0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba180c7 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044124.187677:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9b39759f9200/0x89871fc3aba180c0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba180c7 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044124.243363:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3945932d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3639:1870705580943488:0@lo:400:kworker.0 00000100:00100000:2.0:1784044124.243440:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044124.243488:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843e38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1870705580944000:0@lo:400:kworker.0 00000100:00100000:2.0:1784044124.243512:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044124.243535:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843e39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3639:1870705580944512:0@lo:400:kworker.0 00000100:00100000:2.0:1784044124.243554:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044124.243588:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1784044124.243594:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397bbbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1870705580943872:0@lo:400:kworker.0 00000100:00100000:2.0:1784044124.243616:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044124.243633:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843e3ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3639:1870705580944384:0@lo:400:kworker.0 00000100:00100000:2.0:1784044124.243651:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044124.243665:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843e3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1870705580944896:0@lo:400:kworker.0 00000100:00100000:2.0:1784044124.243683:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044124.243716:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3945930a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1870705580943616:0@lo:400:kworker.0 00000100:00100000:2.0:1784044124.243737:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044124.243752:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843e3b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1870705580944128:0@lo:400:kworker.0 00000100:00100000:2.0:1784044124.243771:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044124.243783:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843e3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3640:1870705580944640:0@lo:400:kworker.0 00000100:00100000:2.0:1784044124.243799:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044124.243814:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1784044124.243819:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3945932a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1870705580943744:0@lo:400:kworker.0 00000100:00100000:2.0:1784044124.243836:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044124.243844:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843e39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3640:1870705580944256:0@lo:400:kworker.0 00000100:00100000:2.0:1784044124.243870:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044124.243881:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843e38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1870705580944768:0@lo:400:kworker.0 00000100:00100000:2.0:1784044124.243899:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044124.243929:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580943488 00000100:00100000:2.0:1784044124.243936:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580943488 00000100:00100000:2.0:1784044124.243969:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580944512 00000100:00100000:2.0:1784044124.243972:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580944512 00000100:00100000:2.0:1784044124.243993:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580944384 00000100:00100000:2.0:1784044124.243995:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580944384 00000100:00100000:2.0:1784044124.244014:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580944640 00000100:00100000:2.0:1784044124.244017:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580944640 00000100:00100000:2.0:1784044124.244028:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580943744 00000100:00100000:2.0:1784044124.244030:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580943744 00000100:00100000:2.0:1784044124.244038:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580944256 00000100:00100000:2.0:1784044124.244040:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580944256 00000100:00100000:2.0:1784044124.244071:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:2.0:1784044124.244079:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843e39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1870705580943488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784044124.244137:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843e39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1870705580943488:12345-0@lo:400:kworker.0 Request processed in 58us (697us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044124.244143:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:2.0:1784044124.244158:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:2.0:1784044124.244164:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843e38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1870705580944512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784044124.244209:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843e38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1870705580944512:12345-0@lo:400:kworker.0 Request processed in 45us (654us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044124.244214:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:2.0:1784044124.244225:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:2.0:1784044124.244230:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843e3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1870705580944384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784044124.244254:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843e3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1870705580944384:12345-0@lo:400:kworker.0 Request processed in 24us (602us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044124.244259:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:2.0:1784044124.244272:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:2.0:1784044124.244277:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843e39180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1870705580944640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784044124.244302:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843e39180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1870705580944640:12345-0@lo:400:kworker.0 Request processed in 25us (501us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044124.244307:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:2.0:1784044124.244319:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:2.0:1784044124.244330:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843e38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1870705580943744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784044124.244355:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843e38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1870705580943744:12345-0@lo:400:kworker.0 Request processed in 26us (518us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044124.244361:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:2.0:1784044124.244371:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:2.0:1784044124.244377:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843734e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1870705580944256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784044124.244400:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843734e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1870705580944256:12345-0@lo:400:kworker.0 Request processed in 23us (530us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044124.244405:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:2.0:1784044124.244420:0:9822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580944000 00000100:00100000:2.0:1784044124.244424:0:9822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580944000 00000100:00100000:2.0:1784044124.244439:0:9822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580944896 00000100:00100000:2.0:1784044124.244442:0:9822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580944896 00000100:00100000:2.0:1784044124.244454:0:9822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580944128 00000100:00100000:2.0:1784044124.244456:0:9822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580944128 00000100:00100000:2.0:1784044124.244465:0:9822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580944768 00000100:00100000:2.0:1784044124.244467:0:9822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580944768 00000100:00100000:2.0:1784044124.244478:0:9822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1784044124.244483:0:9822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843e3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3639:x1870705580944000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784044124.244509:0:9822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843e3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3639:x1870705580944000:12345-0@lo:400:kworker.0 Request processed in 26us (996us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044124.244515:0:9822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1784044124.244541:0:9822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1784044124.244546:0:9822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843e3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3639:x1870705580944896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784044124.244569:0:9822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843e3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3639:x1870705580944896:12345-0@lo:400:kworker.0 Request processed in 23us (885us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044124.244575:0:9822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1784044124.244590:0:9822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1784044124.244595:0:9822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843e38700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3640:x1870705580944128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784044124.244620:0:9822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843e38700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3640:x1870705580944128:12345-0@lo:400:kworker.0 Request processed in 25us (849us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044124.244625:0:9822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1784044124.244634:0:9822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1784044124.244640:0:9822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843737480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3640:x1870705580944768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784044124.244662:0:9822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843737480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3640:x1870705580944768:12345-0@lo:400:kworker.0 Request processed in 22us (762us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044124.244667:0:9822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1784044124.244690:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580943872 00000100:00100000:2.0:1784044124.244694:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580943872 00000100:00100000:2.0:1784044124.244715:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580943616 00000100:00100000:2.0:1784044124.244718:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580943616 00000100:00100000:2.0:1784044124.244730:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1784044124.244735:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843e3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1870705580943872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784044124.244763:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843e3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1870705580943872:12345-0@lo:400:kworker.0 Request processed in 28us (1146us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044124.244769:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1784044124.244780:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1784044124.244785:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843e39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1870705580943616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784044124.244812:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843e39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1870705580943616:12345-0@lo:400:kworker.0 Request processed in 26us (1074us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044124.244818:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00080000:2.0:1784044124.244854:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1784044124.244859:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1784044124.244861:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784044124.244982:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3945932a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1870705580943744:0@lo:400:kworker.0 00000100:00100000:2.0:1784044124.244994:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843e39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3640:1870705580944256:0@lo:400:kworker.0 00010000:00080000:2.0:1784044124.245005:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b3843e38380 x1870705580944768/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784044140 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784044124.245015:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843e38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1870705580944768:0@lo:400:kworker.0 00000100:00100000:2.0:1784044124.245023:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3945930a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1870705580943616:0@lo:400:kworker.0 00010000:00080000:2.0:1784044124.245031:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b3843e3b800 x1870705580944128/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784044140 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784044124.245039:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843e3b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1870705580944128:0@lo:400:kworker.0 00010000:00080000:2.0:1784044124.245047:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b3843e3b100 x1870705580944640/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044140 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784044124.245054:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843e3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3640:1870705580944640:0@lo:400:kworker.0 00000100:00100000:2.0:1784044124.245092:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397bbbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1870705580943872:0@lo:400:kworker.0 00010000:00080000:2.0:1784044124.245103:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b3843e3ad80 x1870705580944384/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044140 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784044124.245111:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843e3ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3639:1870705580944384:0@lo:400:kworker.0 00010000:00080000:2.0:1784044124.245133:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b3843e3a680 x1870705580944896/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784044140 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784044124.245141:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843e3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1870705580944896:0@lo:400:kworker.0 00000100:00100000:2.0:1784044124.245151:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3945932d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3639:1870705580943488:0@lo:400:kworker.0 00010000:00080000:2.0:1784044124.245161:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b3843e38000 x1870705580944000/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784044140 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784044124.245193:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843e38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1870705580944000:0@lo:400:kworker.0 00000100:00100000:2.0:1784044124.245206:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843e39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3639:1870705580944512:0@lo:400:kworker.0 00000100:00100000:3.0:1784044124.246474:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784044124.246492:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843c55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1870705580945024:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784044124.246546:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044124.246599:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580945024 00000100:00100000:1.0:1784044124.246605:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580945024 00000100:00100000:1.0:1784044124.246652:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1784044124.246660:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38420ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1870705580945024:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1784044124.246685:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784044124.246728:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38420ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1870705580945024:12345-0@lo:13:osp-pre-1-0.0 Request processed in 69us (181us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044124.246736:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00010000:00080000:1.0:1784044124.246767:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b3843c55180 x1870705580945024/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784044140 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784044124.246784:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843c55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1870705580945024:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784044124.250527:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1784044124.250553:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843dbdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1870705580945152:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1784044124.250698:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044124.255107:0:10713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580945152 00000100:00100000:0.0:1784044124.255131:0:10713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580945152 00000100:00100000:0.0:1784044124.255213:0:10713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1784044124.255224:0:10713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843736300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1870705580945152:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1784044124.255251:0:10713:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784044124.257104:0:10713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843736300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1870705580945152:12345-0@lo:13:osp-pre-1-1.0 Request processed in 1872us (6396us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044124.257129:0:10713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00010000:00080000:2.0:1784044124.264272:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b3843dbdf80 x1870705580945152/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784044140 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784044124.264294:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843dbdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1870705580945152:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1784044124.824884:0:10330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784044125.838792:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784044126.863843:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784044126.952727:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1784044126.952778:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1784044126.952824:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1784044126.952848:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1784044126.952874:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044126.953013:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565127552 00000100:00100000:2.0:1784044126.953024:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565127552 00000100:00100000:3.0:1784044126.953064:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565127808 00000100:00100000:3.0:1784044126.953078:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565127808 00000100:00100000:2.0:1784044126.953119:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565127680 00000100:00100000:2.0:1784044126.953126:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565127680 00000100:00100000:3.0:1784044126.953150:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565127936 00000100:00100000:3.0:1784044126.953157:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565127936 00000100:00100000:2.0:1784044126.953169:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 214 00000100:00100000:2.0:1784044126.953229:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843dbdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+6:2410:x1870705565127552:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:2.0:1784044126.953314:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843dbdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+6:2410:x1870705565127552:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 88us (597us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044126.953325:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 214 00000100:00080000:1.0:1784044126.954309:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1784044126.954316:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784044126.960003:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 215 00000100:00100000:3.0:1784044126.960037:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843cfca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68dfcea6-5d83-4dbb-8fa3-e35542d621e5+5:2410:x1870705565127808:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:3.0:1784044126.960160:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843cfca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68dfcea6-5d83-4dbb-8fa3-e35542d621e5+5:2410:x1870705565127808:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 140us (7380us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044126.960202:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 215 00000100:00100000:3.0:1784044126.960984:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 216 00000100:00100000:3.0:1784044126.961003:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843cfd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+5:2410:x1870705565127680:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:3.0:1784044126.961056:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843cfd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+5:2410:x1870705565127680:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 61us (8206us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044126.961064:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 216 00000100:00100000:3.0:1784044126.961084:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 217 00000100:00100000:3.0:1784044126.961102:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843cfd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68dfcea6-5d83-4dbb-8fa3-e35542d621e5+5:2410:x1870705565127936:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:3.0:1784044126.961132:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843cfd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68dfcea6-5d83-4dbb-8fa3-e35542d621e5+5:2410:x1870705565127936:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 40us (8256us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044126.961673:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 217 00000100:00100000:3.0:1784044126.961713:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565127424 00000100:00100000:3.0:1784044126.961722:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565127424 00000100:00100000:3.0:1784044126.963025:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 341 00000100:00100000:3.0:1784044126.963043:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3950375450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4a09ad9-a185-4679-99bb-b6a07b865440+13:2410:x1870705565127424:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:3.0:1784044126.963128:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3950375450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4a09ad9-a185-4679-99bb-b6a07b865440+13:2410:x1870705565127424:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 91us (10302us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044126.963136:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 341 00000100:00100000:2.0:1784044127.311265:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b38420ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1870705580945280:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1784044127.311671:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044127.311896:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580945280 00000100:00100000:3.0:1784044127.311908:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580945280 00000100:00100000:3.0:1784044127.312000:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1784044127.312014:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843737b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1870705580945280:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1784044127.312071:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1784044127.312148:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843737b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1870705580945280:12345-0@lo:41:osp-pre-0-1.0 Request processed in 135us (477us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044127.312157:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1784044127.312572:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b38420ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1870705580945280:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1784044127.888375:0:10331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1784044128.175934:0:13380:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg240-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:1.0:1784044128.341365:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843cff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1870705580945408:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784044128.341462:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044128.341558:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580945408 00000100:00100000:1.0:1784044128.341568:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580945408 00000100:00100000:1.0:1784044128.341637:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1784044128.341647:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843cfc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1870705580945408:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1784044128.341687:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784044128.341737:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843cfc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1870705580945408:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044128.341745:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00080000:1.0:1784044128.341770:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1784044128.341804:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b3843cff800 x1870705580945408/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784044144 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784044128.341827:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843cff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1870705580945408:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784044128.343456:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1784044128.343478:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843cff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1870705580945664:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1784044128.343548:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044128.343595:0:7768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580945664 00000100:00100000:1.0:1784044128.343602:0:7768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580945664 00000100:00100000:1.0:1784044128.343657:0:7768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1784044128.343688:0:7768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843cfc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1870705580945664:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1784044128.343731:0:7768:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1784044128.343791:0:7768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843cfc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1870705580945664:12345-0@lo:41:osp-pre-1-0.0 Request processed in 102us (240us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044128.343799:0:7768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1784044128.343831:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843735f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1870705580945536:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1784044128.343880:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044128.343925:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580945536 00000100:00100000:1.0:1784044128.343929:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580945536 00000100:00100000:1.0:1784044128.343973:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1784044128.343980:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843cffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1870705580945536:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1784044128.343996:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784044128.344039:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843cffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1870705580945536:12345-0@lo:13:osp-pre-0-1.0 Request processed in 59us (158us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044128.344046:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00080000:1.0:1784044128.344068:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1784044128.344107:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b3843735f80 x1870705580945536/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784044144 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784044128.344129:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843735f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1870705580945536:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1784044128.344167:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843cff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1870705580945664:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1784044128.909413:0:10330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784044129.360095:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843c54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:3641:1870705580945792:0@lo:400:kworker.0 00000100:00100000:0.0:1784044129.360227:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044129.360288:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843c56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1870705580946304:0@lo:400:kworker.0 00000100:00100000:0.0:1784044129.360333:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044129.360355:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843c55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3641:1870705580946816:0@lo:400:kworker.0 00000100:00100000:0.0:1784044129.360382:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044129.360417:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1870705580947328:0@lo:400:kworker.0 00000100:00100000:0.0:1784044129.360442:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044129.360472:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1784044129.360478:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843c55500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3641:1870705580946176:0@lo:400:kworker.0 00000100:00100000:0.0:1784044129.360500:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044129.360518:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843c54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3641:1870705580946688:0@lo:400:kworker.0 00000100:00100000:0.0:1784044129.360540:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044129.360558:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843c55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1870705580947200:0@lo:400:kworker.0 00000100:00100000:0.0:1784044129.360578:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044129.360611:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843c56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1870705580945920:0@lo:400:kworker.0 00000100:00100000:0.0:1784044129.360636:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044129.360653:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843c55f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1870705580946432:0@lo:400:kworker.0 00000100:00100000:0.0:1784044129.360672:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044129.360691:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843c54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3638:1870705580946944:0@lo:400:kworker.0 00000100:00100000:0.0:1784044129.360712:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044129.360724:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1784044129.360728:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843c54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1870705580946048:0@lo:400:kworker.0 00000100:00100000:0.0:1784044129.361298:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044129.361908:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843c55880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1870705580946560:0@lo:400:kworker.0 00000100:00100000:0.0:1784044129.361947:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044129.361976:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843c54700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3638:1870705580947072:0@lo:400:kworker.0 00000100:00100000:0.0:1784044129.361998:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044129.362085:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580945792 00000100:00100000:0.0:1784044129.362096:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580945792 00000100:00100000:0.0:1784044129.362169:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 342 00000100:00100000:0.0:1784044129.362220:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3950376450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+24:3641:x1870705580945792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784044129.362293:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3950376450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+24:3641:x1870705580945792:12345-0@lo:400:kworker.0 Request processed in 74us (2067us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044129.362302:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 342 00000100:00100000:0.0:1784044129.362359:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580946304 00000100:00100000:0.0:1784044129.362363:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580946304 00000100:00100000:0.0:1784044129.362393:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580946048 00000100:00100000:0.0:1784044129.362396:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580946048 00000100:00100000:0.0:1784044129.362410:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1784044129.362415:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843c88e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1870705580946304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784044129.362452:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843c88e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1870705580946304:12345-0@lo:400:kworker.0 Request processed in 36us (2119us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044129.362459:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1784044129.362471:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1784044129.362477:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38436a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1870705580946048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784044129.362508:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38436a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1870705580946048:12345-0@lo:400:kworker.0 Request processed in 31us (1212us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044129.362514:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1784044129.362535:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580946816 00000100:00100000:0.0:1784044129.362539:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580946816 00000100:00100000:0.0:1784044129.362575:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580946176 00000100:00100000:0.0:1784044129.362578:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580946176 00000100:00100000:0.0:1784044129.362588:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580946688 00000100:00100000:0.0:1784044129.362590:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580946688 00000100:00100000:0.0:1784044129.362604:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580945920 00000100:00100000:0.0:1784044129.362607:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580945920 00000100:00100000:0.0:1784044129.362620:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580946944 00000100:00100000:0.0:1784044129.362623:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580946944 00000100:00100000:0.0:1784044129.362635:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580947072 00000100:00100000:0.0:1784044129.362642:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580947072 00000100:00100000:0.0:1784044129.362657:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:0.0:1784044129.362662:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843c8aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1870705580946816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784044129.362696:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843c8aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1870705580946816:12345-0@lo:400:kworker.0 Request processed in 33us (2313us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044129.362703:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:0.0:1784044129.362727:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:0.0:1784044129.362733:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843ce4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1870705580946176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044129.364413:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580947328 00000100:00100000:1.0:1784044129.364424:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580947328 00000100:00100000:1.0:1784044129.364472:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580947200 00000100:00100000:1.0:1784044129.364475:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580947200 00000100:00100000:1.0:1784044129.364492:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580946432 00000100:00100000:1.0:1784044129.364494:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580946432 00000100:00100000:1.0:1784044129.364526:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580946560 00000100:00100000:1.0:1784044129.364530:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580946560 00000100:00100000:1.0:1784044129.364549:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1784044129.364556:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843ce5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1870705580947328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044129.364642:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843ce5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1870705580947328:12345-0@lo:400:kworker.0 Request processed in 86us (4198us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044129.364649:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1784044129.364667:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1784044129.364674:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38436a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1870705580947200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044129.364703:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38436a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1870705580947200:12345-0@lo:400:kworker.0 Request processed in 29us (4123us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044129.364709:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1784044129.364732:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1784044129.364739:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38436a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1870705580946432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784044129.365518:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843ce4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1870705580946176:12345-0@lo:400:kworker.0 Request processed in 2781us (5012us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044129.365530:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:0.0:1784044129.365557:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:0.0:1784044129.365564:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843ce5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1870705580946688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784044129.365599:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843ce5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1870705580946688:12345-0@lo:400:kworker.0 Request processed in 36us (5057us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044129.365605:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:0.0:1784044129.365618:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:0.0:1784044129.365625:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38436a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1870705580945920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784044129.365654:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38436a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1870705580945920:12345-0@lo:400:kworker.0 Request processed in 30us (5017us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044129.365659:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:0.0:1784044129.365671:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:0.0:1784044129.365679:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38436a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1870705580946944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784044129.365708:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38436a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1870705580946944:12345-0@lo:400:kworker.0 Request processed in 31us (4994us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044129.365925:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38436a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1870705580946432:12345-0@lo:400:kworker.0 Request processed in 1186us (5251us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044129.365932:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1784044129.365945:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1784044129.365952:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38436a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1870705580946560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044129.365983:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38436a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1870705580946560:12345-0@lo:400:kworker.0 Request processed in 31us (4035us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044129.365988:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1784044129.366022:0:9501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:1.0:1784044129.366030:0:9501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38436a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1870705580947072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044129.366065:0:9501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38436a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1870705580947072:12345-0@lo:400:kworker.0 Request processed in 36us (4066us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044129.366107:0:9501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:1.0:1784044129.366220:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843cff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1870705580947456:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1784044129.366278:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044129.367194:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00080000:0.0:1784044129.367854:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784044129.367862:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1784044129.367865:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1784044129.367936:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397aa54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1870705580947584:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784044129.368002:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044129.368086:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580947456 00000100:00100000:0.0:1784044129.368094:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580947456 00000100:00100000:0.0:1784044129.368142:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580947584 00000100:00100000:0.0:1784044129.368146:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580947584 00000100:00100000:0.0:1784044129.368162:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1784044129.368171:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843e0f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1870705580947456:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1784044129.368230:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784044129.368277:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843e0f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1870705580947456:12345-0@lo:13:osp-pre-1-1.0 Request processed in 107us (1999us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044129.368284:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1784044129.368300:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1784044129.368320:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397aa57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1870705580947584:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1784044129.368354:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00010000:00080000:1.0:1784044129.368442:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b3843cff800 x1870705580947456/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784044145 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784044129.368468:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843cff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1870705580947456:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1784044129.368485:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843c54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1870705580946048:0@lo:400:kworker.0 00010000:00080000:1.0:1784044129.368497:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b3843c55880 x1870705580946560/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784044145 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784044129.368506:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843c55880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1870705580946560:0@lo:400:kworker.0 00010000:00080000:1.0:1784044129.368519:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b3843c54700 x1870705580947072/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044145 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784044129.368528:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843c54700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3638:1870705580947072:0@lo:400:kworker.0 00000100:00100000:1.0:1784044129.368545:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843c56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1870705580945920:0@lo:400:kworker.0 00010000:00080000:1.0:1784044129.368557:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b3843c55f80 x1870705580946432/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784044145 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784044129.368564:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843c55f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1870705580946432:0@lo:400:kworker.0 00000100:00100000:1.0:1784044129.368583:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843c54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3638:1870705580946944:0@lo:400:kworker.0 00000100:00100000:1.0:1784044129.368650:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843c55500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3641:1870705580946176:0@lo:400:kworker.0 00000100:00100000:1.0:1784044129.368667:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843c54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3641:1870705580946688:0@lo:400:kworker.0 00010000:00080000:1.0:1784044129.368693:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b3843c55c00 x1870705580947200/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784044145 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784044129.368703:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843c55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1870705580947200:0@lo:400:kworker.0 00000100:00100000:1.0:1784044129.368715:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843c54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:3641:1870705580945792:0@lo:400:kworker.0 00000100:00100000:1.0:1784044129.368730:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843c56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1870705580946304:0@lo:400:kworker.0 00010000:00080000:1.0:1784044129.368757:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b3843c55180 x1870705580946816/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044145 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784044129.368767:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843c55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3641:1870705580946816:0@lo:400:kworker.0 00010000:00080000:1.0:1784044129.368779:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b3843d2c380 x1870705580947328/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784044145 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784044129.368787:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1870705580947328:0@lo:400:kworker.0 00000100:00100000:0.0:1784044129.375912:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397aa57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1870705580947584:12345-0@lo:13:osp-pre-1-0.0 Request processed in 7587us (7891us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044129.375931:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00010000:00080000:2.0:1784044129.376149:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b397aa54e00 x1870705580947584/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784044145 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784044129.376251:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397aa54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1870705580947584:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1784044129.933444:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784044130.957544:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784044131.981946:0:10331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784044132.072707:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044132.072786:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044132.072819:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044132.072856:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044132.072881:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1784044132.074494:0:9501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565128320 00000100:00100000:1.0:1784044132.074508:0:9501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565128320 00000100:00100000:1.0:1784044132.074578:0:9501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565128576 00000100:00100000:1.0:1784044132.074581:0:9501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565128576 00000100:00100000:1.0:1784044132.074598:0:9501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565128192 00000100:00100000:1.0:1784044132.074600:0:9501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565128192 00000100:00100000:1.0:1784044132.074611:0:9501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565128448 00000100:00100000:1.0:1784044132.074613:0:9501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565128448 00000100:00100000:1.0:1784044132.074631:0:9501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 224 00000100:00100000:1.0:1784044132.074641:0:9501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843734700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a93fdf3c-d42f-420a-95ea-b0cbfe954363+5:2407:x1870705565128320:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:1.0:1784044132.074720:0:9501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843734700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a93fdf3c-d42f-420a-95ea-b0cbfe954363+5:2407:x1870705565128320:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 80us (1933us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044132.074742:0:9501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 224 00000100:00100000:1.0:1784044132.074760:0:9501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 225 00000100:00100000:1.0:1784044132.074765:0:9501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843735180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68dfcea6-5d83-4dbb-8fa3-e35542d621e5+5:2407:x1870705565128576:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:1.0:1784044132.074788:0:9501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843735180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68dfcea6-5d83-4dbb-8fa3-e35542d621e5+5:2407:x1870705565128576:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 23us (1970us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044132.074794:0:9501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 225 00000100:00100000:1.0:1784044132.074803:0:9501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 226 00000100:00100000:1.0:1784044132.074809:0:9501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843734a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a93fdf3c-d42f-420a-95ea-b0cbfe954363+6:2407:x1870705565128192:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:1.0:1784044132.074827:0:9501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843734a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a93fdf3c-d42f-420a-95ea-b0cbfe954363+6:2407:x1870705565128192:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 19us (1971us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044132.074833:0:9501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 226 00000100:00100000:1.0:1784044132.074842:0:9501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 227 00000100:00100000:1.0:1784044132.074848:0:9501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843734000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68dfcea6-5d83-4dbb-8fa3-e35542d621e5+5:2407:x1870705565128448:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:1.0:1784044132.074869:0:9501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843734000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68dfcea6-5d83-4dbb-8fa3-e35542d621e5+5:2407:x1870705565128448:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 21us (1988us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044132.074876:0:9501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 227 00000100:00080000:2.0:1784044132.075530:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1784044132.075535:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1784044132.076673:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565128064 00000100:00100000:3.0:1784044132.076682:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565128064 00000100:00100000:3.0:1784044132.076728:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 343 00000100:00100000:3.0:1784044132.076736:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3950377c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4a09ad9-a185-4679-99bb-b6a07b865440+13:2407:x1870705565128064:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:3.0:1784044132.076801:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3950377c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4a09ad9-a185-4679-99bb-b6a07b865440+13:2407:x1870705565128064:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 65us (4105us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044132.076808:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 343 00000100:00100000:1.0:1784044132.429941:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1784044132.429965:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b38420ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1870705580947712:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1784044132.430031:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044132.430160:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580947712 00000100:00100000:3.0:1784044132.430206:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580947712 00000100:00100000:3.0:1784044132.430249:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1784044132.430258:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843e0c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1870705580947712:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1784044132.430294:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1784044132.430344:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843e0c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1870705580947712:12345-0@lo:41:osp-pre-0-1.0 Request processed in 87us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044132.430352:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1784044132.430396:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b38420ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1870705580947712:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1784044133.005432:0:10330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784044133.453859:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784044133.453876:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843e0e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1870705580947840:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784044133.453937:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044133.454054:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397aa57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1870705580947968:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1784044133.454085:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044133.454237:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843737800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1870705580948096:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1784044133.454270:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044133.454305:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580948096 00000100:00100000:2.0:1784044133.454313:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580948096 00000100:00100000:2.0:1784044133.454357:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1784044133.454365:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843735880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1870705580948096:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1784044133.454400:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1784044133.454445:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843735880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1870705580948096:12345-0@lo:41:osp-pre-1-0.0 Request processed in 80us (173us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044133.454453:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1784044133.454495:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843737800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1870705580948096:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1784044133.455137:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580947840 00000100:00100000:0.0:1784044133.455154:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580947840 00000100:00100000:0.0:1784044133.455259:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580947968 00000100:00100000:0.0:1784044133.455263:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580947968 00000100:00100000:3.0:1784044133.455338:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1784044133.455348:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397aa54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1870705580947840:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1784044133.455372:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784044133.455416:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397aa54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1870705580947840:12345-0@lo:13:osp-pre-0-0.0 Request processed in 70us (1478us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044133.455423:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00010000:00080000:3.0:1784044133.455510:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b3843e0e680 x1870705580947840/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784044149 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784044133.455525:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843e0e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1870705580947840:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1784044133.456297:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784044133.456491:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1784044133.456500:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843e0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1870705580947968:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1784044133.456516:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00010000:00080000:1.0:1784044133.456655:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b397aa57800 x1870705580947968/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784044149 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784044133.456687:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397aa57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1870705580947968:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1784044133.456743:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843e0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1870705580947968:12345-0@lo:13:osp-pre-0-1.0 Request processed in 244us (2656us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044133.456750:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00010000:00010000:2.0:1784044134.030847:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784044134.478435:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397aa54700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3639:1870705580948608:0@lo:400:kworker.0 00000100:00100000:0.0:1784044134.478503:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044134.478551:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3842707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3639:1870705580949120:0@lo:400:kworker.0 00000100:00100000:0.0:1784044134.478569:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044134.478587:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3842707b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1870705580949632:0@lo:400:kworker.0 00000100:00100000:0.0:1784044134.478606:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044134.478628:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1784044134.478633:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397aa55880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1870705580948480:0@lo:400:kworker.0 00000100:00100000:0.0:1784044134.478652:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044134.478664:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397aa54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1870705580948992:0@lo:400:kworker.0 00000100:00100000:0.0:1784044134.478680:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044134.478692:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3842704700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3639:1870705580949504:0@lo:400:kworker.0 00000100:00100000:0.0:1784044134.478708:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044134.478733:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580948608 00000100:00100000:0.0:1784044134.478739:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580948608 00000100:00100000:0.0:1784044134.478790:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580949120 00000100:00100000:0.0:1784044134.478793:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580949120 00000100:00100000:0.0:1784044134.478812:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580949504 00000100:00100000:0.0:1784044134.478827:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580949504 00000100:00100000:3.0:1784044134.478925:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397aa55500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:3640:1870705580948224:0@lo:400:kworker.0 00000100:00100000:3.0:1784044134.478957:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044134.478977:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397aa55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1870705580948736:0@lo:400:kworker.0 00000100:00100000:3.0:1784044134.478995:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044134.479010:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3842704a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1870705580949248:0@lo:400:kworker.0 00000100:00100000:3.0:1784044134.479039:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044134.479055:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3842705880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1870705580949760:0@lo:400:kworker.0 00000100:00100000:3.0:1784044134.479078:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044134.479093:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1784044134.479108:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397aa54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1870705580948352:0@lo:400:kworker.0 00000100:00100000:3.0:1784044134.479129:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044134.479139:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397aa57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1870705580948864:0@lo:400:kworker.0 00000100:00100000:3.0:1784044134.479156:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044134.479169:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3842707800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3640:1870705580949376:0@lo:400:kworker.0 00000100:00100000:3.0:1784044134.479209:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044134.479232:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580948480 00000100:00100000:3.0:1784044134.479235:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580948480 00000100:00100000:3.0:1784044134.479261:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580948736 00000100:00100000:3.0:1784044134.479264:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580948736 00000100:00100000:3.0:1784044134.479280:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1784044134.479289:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39503bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1870705580948480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044134.479346:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39503bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1870705580948480:12345-0@lo:400:kworker.0 Request processed in 59us (692us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044134.479354:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1784044134.479370:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1784044134.479376:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38420ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1870705580948736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044134.479404:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38420ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1870705580948736:12345-0@lo:400:kworker.0 Request processed in 28us (408us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044134.479409:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1784044134.479447:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397aa55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1870705580948736:0@lo:400:kworker.0 00000100:00100000:3.0:1784044134.479469:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397aa55880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1870705580948480:0@lo:400:kworker.0 00000100:00100000:3.0:1784044134.479518:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580949248 00000100:00100000:3.0:1784044134.479527:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580949248 00000100:00100000:3.0:1784044134.479546:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580948352 00000100:00100000:3.0:1784044134.479548:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580948352 00000100:00100000:3.0:1784044134.479557:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580949376 00000100:00100000:3.0:1784044134.479558:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580949376 00000100:00100000:3.0:1784044134.479570:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:3.0:1784044134.479575:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3842705500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1870705580948608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044134.479607:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3842705500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1870705580948608:12345-0@lo:400:kworker.0 Request processed in 32us (1104us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044134.479613:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:3.0:1784044134.479624:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:3.0:1784044134.479629:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3842704380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1870705580949120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044134.479651:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3842704380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1870705580949120:12345-0@lo:400:kworker.0 Request processed in 22us (1081us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044134.479656:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:3.0:1784044134.479665:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:3.0:1784044134.479670:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38420aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1870705580949248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044134.479695:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38420aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1870705580949248:12345-0@lo:400:kworker.0 Request processed in 25us (655us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044134.479700:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:3.0:1784044134.479710:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:3.0:1784044134.479716:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38420aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1870705580948352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044134.479738:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38420aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1870705580948352:12345-0@lo:400:kworker.0 Request processed in 23us (609us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044134.479744:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:3.0:1784044134.479753:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:3.0:1784044134.479758:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38427b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1870705580949376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044134.479790:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38427b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1870705580949376:12345-0@lo:400:kworker.0 Request processed in 32us (581us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044134.479797:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:3.0:1784044134.479820:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397aa54700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3639:1870705580948608:0@lo:400:kworker.0 00000100:00100000:3.0:1784044134.479953:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3842707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3639:1870705580949120:0@lo:400:kworker.0 00000100:00100000:3.0:1784044134.479982:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397aa54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1870705580948352:0@lo:400:kworker.0 00000100:00100000:3.0:1784044134.479990:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3842707800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3640:1870705580949376:0@lo:400:kworker.0 00010000:00080000:3.0:1784044134.480002:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b3842704a80 x1870705580949248/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044150 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784044134.480012:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3842704a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1870705580949248:0@lo:400:kworker.0 00000100:00080000:3.0:1784044134.480047:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1784044134.480051:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784044134.481379:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:0.0:1784044134.481388:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39503bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1870705580949504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784044134.481461:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39503bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1870705580949504:12345-0@lo:400:kworker.0 Request processed in 73us (2752us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044134.481469:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00010000:00080000:0.0:1784044134.482313:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b3842704700 x1870705580949504/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044150 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784044134.482331:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3842704700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3639:1870705580949504:0@lo:400:kworker.0 00000100:00100000:0.0:1784044134.482356:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784044134.482369:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39503bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1870705580949888:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784044134.482406:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044134.484267:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580949632 00000100:00100000:0.0:1784044134.484280:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580949632 00000100:00100000:0.0:1784044134.484396:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580948992 00000100:00100000:0.0:1784044134.484399:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580948992 00000100:00100000:0.0:1784044134.484410:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580949760 00000100:00100000:0.0:1784044134.484413:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580949760 00000100:00100000:0.0:1784044134.484423:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580948864 00000100:00100000:0.0:1784044134.484425:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580948864 00000100:00100000:0.0:1784044134.484439:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1784044134.484447:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3842707100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1870705580949632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044134.484774:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1784044134.484786:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39503be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1870705580948992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044134.484863:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39503be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1870705580948992:12345-0@lo:400:kworker.0 Request processed in 81us (6181us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044134.484870:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1784044134.484890:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1784044134.484896:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38420aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1870705580949760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044134.484933:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38420aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1870705580949760:12345-0@lo:400:kworker.0 Request processed in 37us (5853us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044134.484939:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1784044134.484951:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1784044134.484957:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38420a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1870705580948864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044134.484986:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38420a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1870705580948864:12345-0@lo:400:kworker.0 Request processed in 29us (5829us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044134.484992:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1784044134.485011:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580948224 00000100:00100000:1.0:1784044134.485015:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580948224 00000100:00100000:0.0:1784044134.485207:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3842707100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1870705580949632:12345-0@lo:400:kworker.0 Request processed in 760us (6598us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044134.485215:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1784044134.486622:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39503bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1870705580950016:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1784044134.486677:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044134.486737:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580949888 00000100:00100000:0.0:1784044134.486742:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580949888 00000100:00100000:0.0:1784044134.486791:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580950016 00000100:00100000:0.0:1784044134.486794:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580950016 00000100:00100000:0.0:1784044134.486808:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1784044134.486814:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39503bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1870705580949888:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1784044134.488928:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784044134.489010:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39503bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1870705580949888:12345-0@lo:13:osp-pre-1-0.0 Request processed in 2193us (6600us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044134.489029:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1784044134.489063:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1784044134.489074:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39503be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1870705580950016:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1784044134.489093:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784044134.489372:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39503be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1870705580950016:12345-0@lo:13:osp-pre-1-1.0 Request processed in 300us (2694us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044134.489378:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00010000:00080000:0.0:1784044134.489429:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b39503bea00 x1870705580950016/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784044150 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784044134.489449:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39503bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1870705580950016:0@lo:13:osp-pre-1-1.0 00010000:00080000:0.0:1784044134.491440:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b397aa54e00 x1870705580948992/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784044150 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784044134.491456:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397aa54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1870705580948992:0@lo:400:kworker.0 00010000:00080000:0.0:1784044134.491468:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b3842707b80 x1870705580949632/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784044150 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784044134.491476:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3842707b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1870705580949632:0@lo:400:kworker.0 00010000:00080000:0.0:1784044134.493258:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b39503bf800 x1870705580949888/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784044150 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784044134.493291:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39503bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1870705580949888:0@lo:13:osp-pre-1-0.0 00010000:00080000:0.0:1784044134.493305:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b397aa57800 x1870705580948864/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784044150 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784044134.493315:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397aa57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1870705580948864:0@lo:400:kworker.0 00010000:00080000:0.0:1784044134.493325:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b3842705880 x1870705580949760/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784044150 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784044134.493333:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3842705880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1870705580949760:0@lo:400:kworker.0 00000100:00100000:0.0:1784044134.494294:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 344 00000100:00100000:0.0:1784044134.494307:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3950375c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+24:3640:x1870705580948224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784044134.494397:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3950375c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+24:3640:x1870705580948224:12345-0@lo:400:kworker.0 Request processed in 93us (15438us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044134.494405:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 344 00000100:00100000:0.0:1784044134.494450:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397aa55500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:3640:1870705580948224:0@lo:400:kworker.0 00000100:00080000:2.0:1784044134.500838:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1784044134.500852:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000001:02000400:2.0:1784044134.964999:0:13529:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 11:48:52 (1784044132) === 00010000:00010000:3.0:1784044135.053836:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784044135.947218:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044135.947326:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1784044135.948060:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565128832 00000100:00100000:1.0:1784044135.948072:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565128832 00000100:00100000:1.0:1784044135.948149:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 2 00000100:00100000:1.0:1784044135.948161:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843736d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+6:10511:x1870705565128832:12345-192.168.202.40@tcp:700:mkdir.0 00000100:00100000:1.0:1784044135.948289:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843736d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+6:10511:x1870705565128832:12345-192.168.202.40@tcp:700:mkdir.0 Request processed in 130us (961us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044135.948313:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 2 00000100:00080000:2.0:1784044135.949244:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784044135.949845:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565128704 00000100:00100000:0.0:1784044135.949855:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565128704 00000100:00100000:0.0:1784044135.949907:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 22 00000100:00100000:0.0:1784044135.949916:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843737800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+6:2408:x1870705565128704:12345-192.168.202.40@tcp:41:mkdir.0 00000004:00000024:0.0:1784044135.949950:0:6512:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1784044135.950048:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843737800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+6:2408:x1870705565128704:12345-192.168.202.40@tcp:41:mkdir.0 Request processed in 133us (2873us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044135.950056:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 22 00000100:00100000:2.0:1784044135.951852:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044135.954674:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565129088 00000100:00100000:0.0:1784044135.954688:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565129088 00000100:00100000:0.0:1784044135.954770:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 23 00000100:00100000:0.0:1784044135.954781:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843735500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+6:10511:x1870705565129088:12345-192.168.202.40@tcp:36:mkdir.0 00010000:00010000:0.0:1784044135.954846:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784044135.954922:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3940031800/0x89871fc3aba17f70 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca655f expref: 6 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044135.954948:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b384361bd00) 00010000:00010000:0.0:1784044135.954973:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784044135.955093:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7000/0x89871fc3aba180ce lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044135.955107:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7000/0x89871fc3aba180ce lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044135.955117:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7000/0x89871fc3aba180ce lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044135.955142:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7a00/0x89871fc3aba180d5 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044135.955149:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7a00/0x89871fc3aba180d5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044135.955155:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7a00/0x89871fc3aba180d5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044135.955763:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6c00/0x89871fc3aba180dc lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044135.955783:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6c00/0x89871fc3aba180dc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044135.955790:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6c00/0x89871fc3aba180dc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784044135.955805:0:6513:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000004012462b reply state 0000000032df4dab transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6c00/0x89871fc3aba180dc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044135.955816:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6c00/0x89871fc3aba180dc lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044135.955822:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9b39758c1c00) 00010000:00010000:0.0:1784044135.955824:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1784044135.955826:0:6513:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1784044135.955831:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1784044135.955837:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7000/0x89871fc3aba180ce lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044135.955843:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7000/0x89871fc3aba180ce lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044135.955849:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7000/0x89871fc3aba180ce lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044135.955854:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38410b7000 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:0.0:1784044135.955858:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7000/0x89871fc3aba180ce lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044135.955865:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7000/0x89871fc3aba180ce lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044135.955882:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b39758c1500) 00010000:00010000:0.0:1784044135.955884:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784044135.955887:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7000/0x89871fc3aba180ce lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044135.955893:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7000/0x89871fc3aba180ce lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784044135.955908:0:6513:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000004012462b reply state 0000000032df4dab transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7a00/0x89871fc3aba180d5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044135.955916:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7a00/0x89871fc3aba180d5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044135.955921:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9b39758c1300) 00010000:00010000:0.0:1784044135.955923:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1784044135.955925:0:6513:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:0.0:1784044135.956037:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843735500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+7:10511:x1870705565129088:12345-192.168.202.40@tcp:36:mkdir.0 Request processed in 1256us (4194us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1784044135.956044:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 23 00000100:00100000:2.0:1784044135.992579:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044135.992687:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565129216 00000100:00100000:0.0:1784044135.992698:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565129216 00000100:00100000:0.0:1784044135.992761:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 24 00000100:00100000:0.0:1784044135.992773:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843737100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+7:10512:x1870705565129216:12345-192.168.202.40@tcp:101:chmod.0 00010000:00010000:0.0:1784044135.992799:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784044135.992823:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7000/0x89871fc3aba180e3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcd3dffad52ca65f2 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044135.992896:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6600/0x89871fc3aba180ea lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044135.992925:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6600/0x89871fc3aba180ea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044135.992938:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6600/0x89871fc3aba180ea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784044135.992986:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1784044135.992990:0:6512:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1784044135.993039:0:6512:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6600/0x89871fc3aba180ea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044135.993068:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7000/0x89871fc3aba180e3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca65f2 expref: 9 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044135.993086:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6600/0x89871fc3aba180ea lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca65f2 expref: 8 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044135.993094:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b39758c1500) 00010000:00010000:0.0:1784044135.993098:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1784044135.993101:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b38410b6600, rc 0) 00000100:00100000:0.0:1784044135.993171:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843737100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+8:10512:x1870705565129216:12345-192.168.202.40@tcp:101:chmod.0 Request processed in 400us (604us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044135.993224:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 24 00000100:00100000:3.0:1784044135.998150:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044135.999714:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565129472 00000100:00100000:0.0:1784044135.999730:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565129472 00000100:00100000:0.0:1784044135.999807:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 25 00000100:00100000:0.0:1784044135.999818:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38427b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+8:10512:x1870705565129472:12345-192.168.202.40@tcp:36:chmod.0 00010000:00010000:0.0:1784044135.999879:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784044135.999921:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6600/0x89871fc3aba180ea lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca65f2 expref: 8 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044135.999941:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b39758c1500) 00010000:00010000:0.0:1784044135.999953:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784044135.999983:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7000/0x89871fc3aba180f1 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044135.999997:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7000/0x89871fc3aba180f1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044136.000019:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7000/0x89871fc3aba180f1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784044136.000325:0:6513:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ec4892b1 reply state 00000000a424b107 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7000/0x89871fc3aba180f1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044136.000340:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7000/0x89871fc3aba180f1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044136.000347:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b39758c1100) 00010000:00010000:0.0:1784044136.000349:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1784044136.000352:0:6513:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1784044136.000361:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1784044136.000452:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38427b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+9:10512:x1870705565129472:12345-192.168.202.40@tcp:36:chmod.0 Request processed in 634us (2310us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1784044136.000459:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 25 00010000:00010000:2.0:1784044136.080093:0:10331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784044136.095880:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044136.098350:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565129600 00000100:00100000:0.0:1784044136.098366:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565129600 00000100:00100000:0.0:1784044136.098434:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 26 00000100:00100000:0.0:1784044136.098442:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843734380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+9:10513:x1870705565129600:12345-192.168.202.40@tcp:101:chown.0 00010000:00010000:0.0:1784044136.098481:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784044136.098500:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6600/0x89871fc3aba180f8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcd3dffad52ca65f9 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044136.098559:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7c00/0x89871fc3aba180ff lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044136.098573:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7c00/0x89871fc3aba180ff lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044136.098584:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7c00/0x89871fc3aba180ff lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784044136.098634:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1784044136.098638:0:6512:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1784044136.098670:0:6512:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7c00/0x89871fc3aba180ff lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044136.098691:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6600/0x89871fc3aba180f8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca65f9 expref: 11 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044136.098719:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7c00/0x89871fc3aba180ff lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca65f9 expref: 10 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044136.098729:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b39758c1100) 00010000:00010000:0.0:1784044136.098732:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1784044136.098736:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b38410b7c00, rc 0) 00000100:00100000:0.0:1784044136.098832:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843734380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+10:10513:x1870705565129600:12345-192.168.202.40@tcp:101:chown.0 Request processed in 388us (2965us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044136.098840:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 26 00000100:00100000:2.0:1784044136.103556:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044136.103639:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565129728 00000100:00100000:0.0:1784044136.103649:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565129728 00000100:00100000:0.0:1784044136.103721:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 27 00000100:00100000:0.0:1784044136.103733:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843736680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+10:10513:x1870705565129728:12345-192.168.202.40@tcp:101:chown.0 00010000:00010000:0.0:1784044136.103755:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784044136.103776:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6a00/0x89871fc3aba18106 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcd3dffad52ca6600 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044136.103844:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7400/0x89871fc3aba1810d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044136.103859:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7400/0x89871fc3aba1810d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044136.103871:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7400/0x89871fc3aba1810d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044136.103882:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6400/0x89871fc3aba18114 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044136.103889:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6400/0x89871fc3aba18114 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044136.103895:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6400/0x89871fc3aba18114 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044136.103977:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7600/0x89871fc3aba1811b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044136.103986:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7600/0x89871fc3aba1811b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044136.104024:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7600/0x89871fc3aba1811b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784044136.104074:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1784044136.104078:0:6513:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1784044136.104099:0:6513:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7600/0x89871fc3aba1811b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044136.104111:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7400/0x89871fc3aba1810d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044136.104117:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7400/0x89871fc3aba1810d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044136.104123:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7400/0x89871fc3aba1810d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044136.104129:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38410b7400 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:0.0:1784044136.104133:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7400/0x89871fc3aba1810d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044136.104141:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7400/0x89871fc3aba1810d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044136.104154:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b39758c1100) 00010000:00010000:0.0:1784044136.104157:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784044136.104161:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7400/0x89871fc3aba1810d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044136.104166:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7400/0x89871fc3aba1810d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044136.104246:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6400/0x89871fc3aba18114 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044136.104252:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6400/0x89871fc3aba18114 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044136.104258:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6400/0x89871fc3aba18114 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044136.104367:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38410b6400 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:0.0:1784044136.104370:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6400/0x89871fc3aba18114 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044136.104376:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6400/0x89871fc3aba18114 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044136.104386:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9b39758c1300) 00010000:00010000:0.0:1784044136.104388:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784044136.104390:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6400/0x89871fc3aba18114 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044136.104395:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6400/0x89871fc3aba18114 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044136.104424:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6a00/0x89871fc3aba18106 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6600 expref: 12 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044136.104435:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7600/0x89871fc3aba1811b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6600 expref: 11 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044136.104452:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9b39758c1c00) 00010000:00010000:0.0:1784044136.104455:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1784044136.104457:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b38410b7600, rc 0) 00000100:00100000:0.0:1784044136.104528:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843736680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+11:10513:x1870705565129728:12345-192.168.202.40@tcp:101:chown.0 Request processed in 797us (981us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044136.104537:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 27 00000100:00100000:1.0:1784044136.119440:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044136.119584:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565129856 00000100:00100000:3.0:1784044136.119594:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565129856 00000100:00100000:3.0:1784044136.119662:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 6 00000100:00100000:3.0:1784044136.119673:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843e0ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+11:10513:x1870705565129856:12345-192.168.202.40@tcp:900:chown.0 00000100:00100000:3.0:1784044136.119772:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843e0ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+11:10513:x1870705565129856:12345-192.168.202.40@tcp:900:chown.0 Request processed in 100us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044136.119780:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 6 00000100:00100000:1.0:1784044136.122531:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044136.122656:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565130112 00000100:00100000:0.0:1784044136.122667:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565130112 00000100:00100000:0.0:1784044136.122725:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 28 00000100:00100000:0.0:1784044136.122736:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843e0ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+11:10513:x1870705565130112:12345-192.168.202.40@tcp:36:chown.0 00010000:00010000:0.0:1784044136.122802:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784044136.122830:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7600/0x89871fc3aba1811b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6600 expref: 11 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044136.122852:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9b39758c1c00) 00010000:00010000:0.0:1784044136.122858:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784044136.122887:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6a00/0x89871fc3aba18122 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044136.122903:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6a00/0x89871fc3aba18122 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044136.122914:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6a00/0x89871fc3aba18122 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1784044136.125491:0:6490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967301 is committed 00000004:00010000:1.0:1784044136.125647:0:6512:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000033e046db reply state 0000000040027e1f transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6a00/0x89871fc3aba18122 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044136.125670:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6a00/0x89871fc3aba18122 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044136.125680:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9b39758c1c00) 00010000:00010000:1.0:1784044136.125683:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1784044136.125687:0:6512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1784044136.125699:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00080000:1.0:1784044136.125807:0:6512:0:(ldlm_lib.c:3454:target_send_reply()) Schedule reply immediately 00010000:00010000:0.0:1784044136.126057:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7a00/0x89871fc3aba180d5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044136.126082:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7a00/0x89871fc3aba180d5 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044136.126089:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7a00/0x89871fc3aba180d5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044136.126095:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38410b7a00 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:0.0:1784044136.126100:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7a00/0x89871fc3aba180d5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044136.126108:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7a00/0x89871fc3aba180d5 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044136.126120:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9b39758c1300) 00010000:00010000:0.0:1784044136.126123:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784044136.126126:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7a00/0x89871fc3aba180d5 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044136.126132:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7a00/0x89871fc3aba180d5 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044136.126151:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6c00/0x89871fc3aba180dc lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044136.126157:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6c00/0x89871fc3aba180dc lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044136.126163:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6c00/0x89871fc3aba180dc lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044136.126168:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38410b6c00 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:0.0:1784044136.126200:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6c00/0x89871fc3aba180dc lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044136.126207:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6c00/0x89871fc3aba180dc lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044136.126215:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9b39758c1c00) 00010000:00010000:0.0:1784044136.126218:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784044136.126221:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6c00/0x89871fc3aba180dc lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044136.126226:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6c00/0x89871fc3aba180dc lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044136.126239:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7000/0x89871fc3aba180f1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044136.126244:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7000/0x89871fc3aba180f1 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044136.126249:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7000/0x89871fc3aba180f1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044136.126254:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38410b7000 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:0.0:1784044136.126256:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7000/0x89871fc3aba180f1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044136.126261:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7000/0x89871fc3aba180f1 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044136.126268:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b39758c1100) 00010000:00010000:0.0:1784044136.126270:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1784044136.126280:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7000/0x89871fc3aba180f1 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044136.126298:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7000/0x89871fc3aba180f1 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044136.126591:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843e0ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+7:10513:x1870705565130112:12345-192.168.202.40@tcp:36:chown.0 Request processed in 3852us (4065us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1784044136.126601:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 28 00010000:00010000:2.0:1784044136.139154:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6a00/0x89871fc3aba18122 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044136.139194:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6a00/0x89871fc3aba18122 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044136.139203:0:3625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6a00/0x89871fc3aba18122 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044136.139212:0:3625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38410b6a00 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:2.0:1784044136.139217:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6a00/0x89871fc3aba18122 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044136.139225:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6a00/0x89871fc3aba18122 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044136.139249:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9b39758c1c00) 00010000:00010000:2.0:1784044136.139253:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1784044136.139258:0:3625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6a00/0x89871fc3aba18122 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044136.139265:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6a00/0x89871fc3aba18122 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044136.165377:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1784044136.165520:0:9501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565130240 00000100:00100000:1.0:1784044136.165533:0:9501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565130240 00000100:00100000:1.0:1784044136.165597:0:9501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 29 00000100:00100000:1.0:1784044136.165609:0:9501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843735c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a93fdf3c-d42f-420a-95ea-b0cbfe954363+6:10514:x1870705565130240:12345-192.168.202.40@tcp:101:touch.500 00010000:00010000:1.0:1784044136.165632:0:9501:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784044136.165652:0:9501:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc600/0x89871fc3aba18129 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcd3dffad52ca6607 expref: -99 pid: 9501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1784044136.167606:0:9501:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 1900us 00010000:00010000:3.0:1784044136.203703:0:9501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b39759f8e00/0x89871fc3aba18130 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044136.203756:0:9501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b39759f8e00/0x89871fc3aba18130 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044136.203770:0:9501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b39759f8e00/0x89871fc3aba18130 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044136.203792:0:9501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b39759f8600/0x89871fc3aba18137 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044136.203800:0:9501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b39759f8600/0x89871fc3aba18137 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044136.203807:0:9501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b39759f8600/0x89871fc3aba18137 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044136.203955:0:9501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b39759f8200/0x89871fc3aba1813e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044136.203964:0:9501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b39759f8200/0x89871fc3aba1813e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044136.203972:0:9501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b39759f8200/0x89871fc3aba1813e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784044136.204018:0:9501:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1784044136.204022:0:9501:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1784044136.204057:0:9501:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b39759f8200/0x89871fc3aba1813e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044136.204069:0:9501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b39759f8e00/0x89871fc3aba18130 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044136.204083:0:9501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b39759f8e00/0x89871fc3aba18130 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044136.204089:0:9501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b39759f8e00/0x89871fc3aba18130 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044136.204095:0:9501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b39759f8e00 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:3.0:1784044136.204099:0:9501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b39759f8e00/0x89871fc3aba18130 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044136.204107:0:9501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b39759f8e00/0x89871fc3aba18130 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044136.204122:0:9501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b39758c1100) 00010000:00010000:3.0:1784044136.204125:0:9501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784044136.204132:0:9501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b39759f8e00/0x89871fc3aba18130 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044136.204138:0:9501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b39759f8e00/0x89871fc3aba18130 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044136.204151:0:9501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b39759f8600/0x89871fc3aba18137 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044136.204157:0:9501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b39759f8600/0x89871fc3aba18137 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044136.204164:0:9501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b39759f8600/0x89871fc3aba18137 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044136.204170:0:9501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b39759f8600 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:3.0:1784044136.204215:0:9501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b39759f8600/0x89871fc3aba18137 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044136.204221:0:9501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b39759f8600/0x89871fc3aba18137 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044136.204230:0:9501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9b39494b6800) 00010000:00010000:3.0:1784044136.204233:0:9501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784044136.204235:0:9501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b39759f8600/0x89871fc3aba18137 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044136.204241:0:9501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b39759f8600/0x89871fc3aba18137 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044136.204287:0:9501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc600/0x89871fc3aba18129 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6607 expref: 8 pid: 9501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044136.204303:0:9501:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b39759f8200/0x89871fc3aba1813e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6607 expref: 7 pid: 9501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044136.204310:0:9501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9b39494b6600) 00010000:00010000:3.0:1784044136.204313:0:9501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1784044136.204315:0:9501:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b39759f8200, rc 0) 00000100:00100000:3.0:1784044136.204411:0:9501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843735c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a93fdf3c-d42f-420a-95ea-b0cbfe954363+7:10514:x1870705565130240:12345-192.168.202.40@tcp:101:touch.500 Request processed in 38802us (39041us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044136.204422:0:9501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 29 00000100:00100000:3.0:1784044136.211013:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1784044136.211110:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565130496 00000100:00100000:1.0:1784044136.211121:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565130496 00000100:00100000:1.0:1784044136.211232:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 30 00000100:00100000:1.0:1784044136.211245:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38427b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+7:10514:x1870705565130496:12345-192.168.202.40@tcp:101:touch.500 00010000:00010000:1.0:1784044136.211269:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784044136.211292:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fcc00/0x89871fc3aba18145 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcd3dffad52ca660e expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044136.211427:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fda00/0x89871fc3aba1814c lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044136.211443:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fda00/0x89871fc3aba1814c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044136.211456:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fda00/0x89871fc3aba1814c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044136.211483:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd000/0x89871fc3aba18153 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x6f4d6809 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044136.211490:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd000/0x89871fc3aba18153 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x6f4d6809 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044136.211496:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd000/0x89871fc3aba18153 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x6f4d6809 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1784044136.211907:0:6511:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x2:0x0], index 0: 0 00010000:00010000:1.0:1784044136.212128:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd600/0x89871fc3aba1815a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044136.212138:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd600/0x89871fc3aba1815a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044136.212146:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd600/0x89871fc3aba1815a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044136.212212:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fda00/0x89871fc3aba1814c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044136.212220:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fda00/0x89871fc3aba1814c lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044136.212227:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fda00/0x89871fc3aba1814c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044136.212233:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38426fda00 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:1.0:1784044136.212238:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fda00/0x89871fc3aba1814c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044136.212245:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fda00/0x89871fc3aba1814c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044136.212258:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9b39494b6600) 00010000:00010000:1.0:1784044136.212262:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784044136.212267:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fda00/0x89871fc3aba1814c lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044136.212273:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fda00/0x89871fc3aba1814c lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784044136.212284:0:6511:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000930a7847 reply state 000000003a0e60d5 transno 4294967302 ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd000/0x89871fc3aba18153 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x6f4d6809 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044136.212295:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd000/0x89871fc3aba18153 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x6f4d6809 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044136.212301:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x6f4d6809 (ffff9b3842776800) 00010000:00010000:1.0:1784044136.212310:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784044136.212313:0:6511:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1784044136.212348:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fcc00/0x89871fc3aba18145 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca660e expref: 10 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044136.212363:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd600/0x89871fc3aba1815a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca660e expref: 9 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044136.212370:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9b3842776e00) 00010000:00010000:1.0:1784044136.212372:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784044136.212375:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b38426fd600, rc 0) 00000100:00100000:1.0:1784044136.212435:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38427b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+10:10514:x1870705565130496:12345-192.168.202.40@tcp:101:touch.500 Request processed in 1193us (1443us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1784044136.212442:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 30 00000100:00100000:2.0:1784044136.217214:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1784044136.217343:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565130752 00000100:00100000:1.0:1784044136.217354:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565130752 00000100:00100000:1.0:1784044136.217417:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 31 00000100:00100000:1.0:1784044136.217427:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843736a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+10:10514:x1870705565130752:12345-192.168.202.40@tcp:36:touch.500 00010000:00010000:1.0:1784044136.217510:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784044136.217543:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd600/0x89871fc3aba1815a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca660e expref: 10 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044136.217565:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9b3842776e00) 00010000:00010000:1.0:1784044136.217579:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784044136.217640:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd800/0x89871fc3aba18168 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044136.217654:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd800/0x89871fc3aba18168 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044136.217681:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd800/0x89871fc3aba18168 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784044136.217803:0:6513:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000030a1433a reply state 00000000b7d14570 transno 4294967303 ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd800/0x89871fc3aba18168 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044136.217817:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd800/0x89871fc3aba18168 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044136.217823:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9b3842776f00) 00010000:00010000:1.0:1784044136.217826:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784044136.217829:0:6513:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1784044136.217918:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843736a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+11:10514:x1870705565130752:12345-192.168.202.40@tcp:36:touch.500 Request processed in 491us (757us total) trans 4294967303 rc 0/0 00000100:00100000:1.0:1784044136.217927:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 31 00000100:00100000:2.0:1784044136.222256:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1784044136.222475:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565130880 00000100:00100000:1.0:1784044136.222485:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565130880 00000100:00100000:1.0:1784044136.222536:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 32 00000100:00100000:1.0:1784044136.222546:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843735f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+11:10514:x1870705565130880:12345-192.168.202.40@tcp:101:touch.500 00010000:00010000:1.0:1784044136.222571:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784044136.222593:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fce00/0x89871fc3aba1816f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcd3dffad52ca6615 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044136.222660:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fce00/0x89871fc3aba1816f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6615 expref: 12 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044136.222675:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fce00/0x89871fc3aba1816f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6615 expref: 12 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044136.222713:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9b3842776f00) 00010000:00010000:1.0:1784044136.222716:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1784044136.222720:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b38426fce00, rc 0) 00000100:00100000:1.0:1784044136.222799:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843735f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+12:10514:x1870705565130880:12345-192.168.202.40@tcp:101:touch.500 Request processed in 254us (555us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044136.222808:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 32 00000100:00100000:2.0:1784044136.228159:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1784044136.228364:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565131008 00000100:00100000:1.0:1784044136.228375:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565131008 00000100:00100000:1.0:1784044136.228424:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 26 00000100:00100000:1.0:1784044136.228433:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397bbbc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2406:x1870705565131008:12345-192.168.202.40@tcp:8:touch.500 00010000:00080000:1.0:1784044136.228479:0:8428:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from a93fdf3c-d42f-420a-95ea-b0cbfe954363@192.168.202.40@tcp t0 exp 0000000000000000 cur 329 last 0 00000020:00000080:1.0:1784044136.228510:0:8428:0:(genops.c:1406:class_connect()) connect: client a93fdf3c-d42f-420a-95ea-b0cbfe954363, cookie 0x89871fc3aba18176 00002000:00100000:1.0:1784044136.228523:0:8428:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli a93fdf3c-d42f-420a-95ea-b0cbfe954363/ffff9b384345d000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136a2 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1784044136.228542:0:8428:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type b7, return b7 00002000:00080000:1.0:1784044136.228650:0:8428:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1784044136.228694:0:8428:0:(import.c:65:import_set_state_nolock()) ffff9b3843e80000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1784044136.228781:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397bbbc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+6:2406:x1870705565131008:12345-192.168.202.40@tcp:8:touch.500 Request processed in 346us (633us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044136.228789:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 26 00000100:00100000:3.0:1784044136.232210:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044136.232989:0:9822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565131136 00000100:00100000:0.0:1784044136.233000:0:9822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565131136 00000100:00100000:0.0:1784044136.233148:0:9822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 27 00000100:00100000:0.0:1784044136.233160:0:9822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38427b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a93fdf3c-d42f-420a-95ea-b0cbfe954363+6:0:x1870705565131136:12345-192.168.202.40@tcp:2:touch.500 00000100:00080000:2.0:1784044136.233728:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:3.0:1784044136.244029:0:8421:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00000001:00100000:3.0:1784044136.244048:0:8421:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of a93fdf3c-d42f-420a-95ea-b0cbfe954363 00000100:00100000:0.0:1784044136.244978:0:9822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38427b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a93fdf3c-d42f-420a-95ea-b0cbfe954363+5:0:x1870705565131136:12345-192.168.202.40@tcp:2:touch.500 Request processed in 11808us (12766us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1784044136.244992:0:9822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 27 00000100:00100000:2.0:1784044136.248323:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044136.248599:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565131392 00000100:00100000:3.0:1784044136.248610:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565131392 00000100:00100000:3.0:1784044136.248713:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 2 00000100:00100000:3.0:1784044136.248725:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843e39500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+12:10514:x1870705565131392:12345-192.168.202.40@tcp:35:touch.500 00000100:00100000:3.0:1784044136.249227:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843e39500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+13:10514:x1870705565131392:12345-192.168.202.40@tcp:35:touch.500 Request processed in 502us (916us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1784044136.249236:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 2 00000100:00100000:2.0:1784044136.267101:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1784044136.267249:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565131520 00000100:00100000:1.0:1784044136.267260:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565131520 00000100:00100000:1.0:1784044136.267348:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 33 00000100:00100000:1.0:1784044136.267359:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843e38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+13:10515:x1870705565131520:12345-192.168.202.40@tcp:101:rm.0 00010000:00010000:1.0:1784044136.267386:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784044136.267422:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd600/0x89871fc3aba1817d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcd3dffad52ca661c expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044136.267506:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fcc00/0x89871fc3aba18184 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044136.267523:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fcc00/0x89871fc3aba18184 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044136.267536:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fcc00/0x89871fc3aba18184 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784044136.267589:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1784044136.267593:0:6513:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1784044136.267644:0:6513:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fcc00/0x89871fc3aba18184 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044136.267676:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd600/0x89871fc3aba1817d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca661c expref: 15 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044136.267694:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fcc00/0x89871fc3aba18184 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca661c expref: 14 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044136.267702:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9b39494b6600) 00010000:00010000:1.0:1784044136.267705:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1784044136.267708:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b38426fcc00, rc 0) 00000100:00100000:1.0:1784044136.267782:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843e38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+14:10515:x1870705565131520:12345-192.168.202.40@tcp:101:rm.0 Request processed in 424us (690us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044136.267789:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 33 00000100:00100000:2.0:1784044136.273091:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1784044136.273219:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565131776 00000100:00100000:1.0:1784044136.273243:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565131776 00000100:00100000:1.0:1784044136.274158:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 34 00000100:00100000:1.0:1784044136.274199:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843e3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+14:10515:x1870705565131776:12345-192.168.202.40@tcp:101:rm.0 00010000:00010000:1.0:1784044136.274221:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784044136.274243:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd600/0x89871fc3aba1818b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcd3dffad52ca6623 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784044136.274373:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1784044136.274700:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd600/0x89871fc3aba1818b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6623 expref: 16 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044136.274717:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b39758c1100) 00010000:00010000:1.0:1784044136.274720:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1784044136.274726:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd600/0x89871fc3aba1818b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6623 expref: 16 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044136.274739:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b38426fd600, rc 0) 00000100:00100000:1.0:1784044136.274865:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843e3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+15:10515:x1870705565131776:12345-192.168.202.40@tcp:101:rm.0 Request processed in 697us (1784us total) trans 4294967305 rc 301/301 00000100:00100000:1.0:1784044136.274875:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 34 00000100:00100000:2.0:1784044136.287040:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044136.287338:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565131904 00000100:00100000:0.0:1784044136.287350:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565131904 00000100:00100000:0.0:1784044136.287416:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 3 00000100:00100000:0.0:1784044136.287426:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843e3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+15:10515:x1870705565131904:12345-192.168.202.40@tcp:37:rm.0 00000100:00100000:1.0:1784044136.304130:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843e3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+15:10515:x1870705565131904:12345-192.168.202.40@tcp:37:rm.0 Request processed in 16683us (17078us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044136.304152:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 3 00000100:00100000:2.0:1784044136.319057:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044136.319151:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565132160 00000100:00100000:3.0:1784044136.319161:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565132160 00000100:00100000:3.0:1784044136.319251:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4 00000100:00100000:3.0:1784044136.319262:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3974227050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+15:10515:x1870705565132160:12345-192.168.202.40@tcp:35:rm.0 00000100:00100000:3.0:1784044136.319511:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3974227050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+16:10515:x1870705565132160:12345-192.168.202.40@tcp:35:rm.0 Request processed in 250us (462us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1784044136.319519:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4 00000100:00100000:2.0:1784044136.327755:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1784044136.327899:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565132416 00000100:00100000:1.0:1784044136.327909:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565132416 00000100:00100000:1.0:1784044136.327970:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 35 00000100:00100000:1.0:1784044136.327981:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843e3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+16:10515:x1870705565132416:12345-192.168.202.40@tcp:101:rm.0 00010000:00010000:1.0:1784044136.328051:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784044136.328076:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd600/0x89871fc3aba18199 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcd3dffad52ca662a expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044136.328242:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fda00/0x89871fc3aba181a0 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044136.328258:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fda00/0x89871fc3aba181a0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044136.328270:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fda00/0x89871fc3aba181a0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784044136.328280:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1784044136.328393:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd600/0x89871fc3aba18199 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca662a expref: 19 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044136.328411:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fda00/0x89871fc3aba181a0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca662a expref: 18 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044136.328420:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9b39494b6600) 00010000:00010000:1.0:1784044136.328423:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1784044136.328426:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b38426fda00, rc 0) 00000100:00100000:1.0:1784044136.328500:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843e3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+18:10515:x1870705565132416:12345-192.168.202.40@tcp:101:rm.0 Request processed in 521us (769us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1784044136.328513:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 35 00000100:00100000:2.0:1784044136.334808:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1784044136.334885:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565132544 00000100:00100000:1.0:1784044136.334895:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565132544 00000100:00100000:1.0:1784044136.334964:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 36 00000100:00100000:1.0:1784044136.334989:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843e3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+18:10515:x1870705565132544:12345-192.168.202.40@tcp:41:rm.0 00000004:00000024:1.0:1784044136.335064:0:6511:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 7847059456 avail 7384014848 00000100:00100000:1.0:1784044136.335142:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843e3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+18:10515:x1870705565132544:12345-192.168.202.40@tcp:41:rm.0 Request processed in 155us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044136.335150:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 36 00000100:00100000:2.0:1784044136.342793:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1784044136.343050:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565132672 00000100:00100000:1.0:1784044136.343070:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565132672 00000100:00100000:1.0:1784044136.343132:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 37 00000100:00100000:1.0:1784044136.343143:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843e38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+18:10515:x1870705565132672:12345-192.168.202.40@tcp:101:rm.0 00010000:00010000:1.0:1784044136.343164:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784044136.343221:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd600/0x89871fc3aba181ae lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcd3dffad52ca6631 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044136.343293:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd200/0x89871fc3aba181b5 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044136.343308:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd200/0x89871fc3aba181b5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044136.343319:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd200/0x89871fc3aba181b5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044136.343331:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc800/0x89871fc3aba181bc lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x6f4d6809 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044136.343338:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc800/0x89871fc3aba181bc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x6f4d6809 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044136.343345:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc800/0x89871fc3aba181bc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x6f4d6809 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044136.343457:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc000/0x89871fc3aba181c3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044136.343467:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc000/0x89871fc3aba181c3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044136.343474:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc000/0x89871fc3aba181c3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784044136.343616:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x2:0x0]: returning size 0 00000004:00200000:1.0:1784044136.343621:0:6513:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1784044136.343641:0:6513:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc000/0x89871fc3aba181c3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044136.343653:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc000/0x89871fc3aba181c3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044136.343662:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd200/0x89871fc3aba181b5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044136.343668:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd200/0x89871fc3aba181b5 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044136.343675:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd200/0x89871fc3aba181b5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044136.343681:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38426fd200 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:1.0:1784044136.343685:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd200/0x89871fc3aba181b5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044136.343693:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd200/0x89871fc3aba181b5 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044136.343712:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9b39494b6600) 00010000:00010000:1.0:1784044136.343715:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784044136.343720:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd200/0x89871fc3aba181b5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044136.343726:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd200/0x89871fc3aba181b5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044136.343738:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc800/0x89871fc3aba181bc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x6f4d6809 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044136.343872:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc800/0x89871fc3aba181bc lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x6f4d6809 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044136.343879:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc800/0x89871fc3aba181bc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x6f4d6809 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044136.343884:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38426fc800 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:1.0:1784044136.343887:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc800/0x89871fc3aba181bc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x6f4d6809 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044136.343893:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc800/0x89871fc3aba181bc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x6f4d6809 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044136.343901:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x6f4d6809 (ffff9b3842776800) 00010000:00010000:1.0:1784044136.343903:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784044136.343906:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc800/0x89871fc3aba181bc lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x6f4d6809 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044136.343911:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc800/0x89871fc3aba181bc lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x6f4d6809 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044136.343950:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd600/0x89871fc3aba181ae lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6631 expref: 20 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044136.343964:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc000/0x89871fc3aba181c3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6631 expref: 19 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044136.343972:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9b3842776f00) 00010000:00010000:1.0:1784044136.343974:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784044136.343976:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b38426fc000, rc 0) 00000100:00100000:1.0:1784044136.344152:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843e38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+19:10515:x1870705565132672:12345-192.168.202.40@tcp:101:rm.0 Request processed in 1009us (1367us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044136.344160:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 37 00000100:00100000:2.0:1784044136.361085:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1784044136.361393:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565132928 00000100:00100000:1.0:1784044136.361403:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565132928 00000100:00100000:1.0:1784044136.361472:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 38 00000100:00100000:1.0:1784044136.361482:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843e39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+19:10515:x1870705565132928:12345-192.168.202.40@tcp:36:rm.0 00010000:00010000:1.0:1784044136.361549:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1784044136.361576:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc000/0x89871fc3aba181c3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6631 expref: 19 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044136.361595:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fce00/0x89871fc3aba1816f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6615 expref: 18 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044136.361604:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9b3842776f00) 00010000:00010000:1.0:1784044136.361613:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fcc00/0x89871fc3aba18184 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca661c expref: 17 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044136.361652:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9b39494b6600) 00010000:00010000:1.0:1784044136.361656:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784044136.361680:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd600/0x89871fc3aba181ca lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044136.361693:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd600/0x89871fc3aba181ca lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044136.361702:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd600/0x89871fc3aba181ca lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044136.361712:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc800/0x89871fc3aba181d1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x6f4d6809 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044136.361719:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc800/0x89871fc3aba181d1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x6f4d6809 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044136.361725:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc800/0x89871fc3aba181d1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x6f4d6809 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044136.361819:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd200/0x89871fc3aba181d8 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044136.361828:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd200/0x89871fc3aba181d8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044136.361836:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd200/0x89871fc3aba181d8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1784044136.362073:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:1.0:1784044136.362083:0:6511:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 329532908339ns, next at 330532905826ns, rc = 0 00010000:00010000:1.0:1784044136.362494:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc200/0x89871fc3aba181df lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044136.362593:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc200/0x89871fc3aba181df lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044136.362601:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc200/0x89871fc3aba181df lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044136.362608:0:6511:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc200/0x89871fc3aba181df lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044136.362614:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc200/0x89871fc3aba181df lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044136.362621:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc200/0x89871fc3aba181df lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044136.362646:0:6511:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784044136.362663:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd200/0x89871fc3aba181d8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044136.362670:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd200/0x89871fc3aba181d8 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044136.362677:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd200/0x89871fc3aba181d8 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044136.362682:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38426fd200 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:1.0:1784044136.362686:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd200/0x89871fc3aba181d8 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044136.362694:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd200/0x89871fc3aba181d8 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044136.362711:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9b3842776f00) 00010000:00010000:1.0:1784044136.362714:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1784044136.362718:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd200/0x89871fc3aba181d8 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044136.362724:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd200/0x89871fc3aba181d8 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044136.362739:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd600/0x89871fc3aba181ca lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044136.363029:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd600/0x89871fc3aba181ca lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044136.363035:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd600/0x89871fc3aba181ca lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044136.363040:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38426fd600 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:1.0:1784044136.363043:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd600/0x89871fc3aba181ca lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044136.363048:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd600/0x89871fc3aba181ca lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044136.363058:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9b39494b6600) 00010000:00010000:1.0:1784044136.363061:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784044136.363064:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd600/0x89871fc3aba181ca lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044136.363070:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd600/0x89871fc3aba181ca lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784044136.363090:0:6511:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000005e3e6bcf reply state 00000000013528aa transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc800/0x89871fc3aba181d1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x6f4d6809 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044136.363101:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc800/0x89871fc3aba181d1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x6f4d6809 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044136.363327:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x6f4d6809 (ffff9b3842776800) 00010000:00010000:1.0:1784044136.363330:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784044136.363372:0:6511:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1784044136.363513:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843e39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+18:10515:x1870705565132928:12345-192.168.202.40@tcp:36:rm.0 Request processed in 2021us (2427us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1784044136.363522:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 38 00010000:00010000:3.0:1784044136.363762:0:10330:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784044136.363769:0:10330:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc200/0x89871fc3aba181df lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044136.363776:0:10330:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38426fc200 already unused, calling callback (ffffffffc0b56230) 00010000:00010000:3.0:1784044136.363780:0:10330:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc200/0x89871fc3aba181df lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044136.363786:0:10330:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc200/0x89871fc3aba181df lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044136.363794:0:10330:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9b3842776f00) 00010000:00010000:3.0:1784044136.363797:0:10330:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1784044136.363800:0:10330:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc200/0x89871fc3aba181df lrc: 1/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044136.363815:0:10330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc200/0x89871fc3aba181df lrc: 0/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044136.363827:0:10330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784044136.363829:0:10330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784044136.363830:0:10330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784044136.382001:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044136.382088:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565133184 00000100:00100000:3.0:1784044136.382097:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565133184 00000100:00100000:3.0:1784044136.382160:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 5 00000100:00100000:3.0:1784044136.382170:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843e39500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+18:10515:x1870705565133184:12345-192.168.202.40@tcp:35:rm.0 00000100:00100000:3.0:1784044136.382433:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843e39500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+19:10515:x1870705565133184:12345-192.168.202.40@tcp:35:rm.0 Request processed in 263us (441us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1784044136.382441:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 5 00000100:00100000:0.0:1784044136.385717:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1784044136.385876:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565133440 00000100:00100000:1.0:1784044136.385886:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565133440 00000100:00100000:1.0:1784044136.385944:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 39 00000100:00100000:1.0:1784044136.385954:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39503bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+19:10515:x1870705565133440:12345-192.168.202.40@tcp:36:rm.0 00010000:00010000:1.0:1784044136.386015:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1784044136.386041:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fda00/0x89871fc3aba181a0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca662a expref: 19 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044136.386061:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b39759f8200/0x89871fc3aba1813e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6607 expref: 18 pid: 9501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044136.386072:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9b39494b6600) 00010000:00010000:1.0:1784044136.386086:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7c00/0x89871fc3aba180ff lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca65f9 expref: 17 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044136.386114:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b39758c1100) 00010000:00010000:1.0:1784044136.386120:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784044136.386155:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd600/0x89871fc3aba181e6 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044136.386167:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd600/0x89871fc3aba181e6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044136.386209:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd600/0x89871fc3aba181e6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044136.386222:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd200/0x89871fc3aba181ed lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044136.386230:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd200/0x89871fc3aba181ed lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044136.386236:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd200/0x89871fc3aba181ed lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044136.386315:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fcc00/0x89871fc3aba181f4 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044136.386322:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fcc00/0x89871fc3aba181f4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044136.386328:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fcc00/0x89871fc3aba181f4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784044136.386577:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1784044136.386593:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fcc00/0x89871fc3aba181f4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044136.386607:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fcc00/0x89871fc3aba181f4 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044136.386613:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fcc00/0x89871fc3aba181f4 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044136.386620:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38426fcc00 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:1.0:1784044136.386625:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fcc00/0x89871fc3aba181f4 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044136.386632:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fcc00/0x89871fc3aba181f4 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044136.386640:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9b3842776100) 00010000:00010000:1.0:1784044136.386643:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1784044136.386646:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fcc00/0x89871fc3aba181f4 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044136.386653:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fcc00/0x89871fc3aba181f4 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044136.386669:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd600/0x89871fc3aba181e6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044136.386675:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd600/0x89871fc3aba181e6 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044136.386681:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd600/0x89871fc3aba181e6 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044136.386687:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38426fd600 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:1.0:1784044136.386694:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd600/0x89871fc3aba181e6 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044136.386701:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd600/0x89871fc3aba181e6 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044136.386708:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b3842776e00) 00010000:00010000:1.0:1784044136.386710:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784044136.386713:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd600/0x89871fc3aba181e6 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044136.386718:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd600/0x89871fc3aba181e6 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784044136.386728:0:6513:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000077f84d32 reply state 0000000041f57a61 transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd200/0x89871fc3aba181ed lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044136.386738:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd200/0x89871fc3aba181ed lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044136.386744:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9b3842776700) 00010000:00010000:1.0:1784044136.386746:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784044136.386749:0:6513:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1784044136.386818:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39503bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+18:10515:x1870705565133440:12345-192.168.202.40@tcp:36:rm.0 Request processed in 865us (1109us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1784044136.386825:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 39 00010000:00010000:2.0:1784044137.101720:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784044137.203410:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044137.203456:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044137.203486:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044137.203521:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044137.203544:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044137.203584:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1784044137.203615:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565133952 00000100:00100000:2.0:1784044137.203625:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565133824 00000100:00100000:1.0:1784044137.203626:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565133952 00000100:00100000:2.0:1784044137.203628:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565133824 00000100:00080000:2.0:1784044137.203655:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1784044137.203683:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565134080 00000100:00100000:2.0:1784044137.203686:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565134080 00000100:00100000:1.0:1784044137.203690:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 85 00000100:00080000:2.0:1784044137.203698:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784044137.203700:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397ba9c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+5:2409:x1870705565133952:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:2.0:1784044137.203724:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565133696 00000100:00100000:2.0:1784044137.203727:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565133696 00000100:00080000:2.0:1784044137.203751:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784044137.203765:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565134208 00000100:00100000:2.0:1784044137.203767:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565134208 00000100:00080000:2.0:1784044137.203778:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1784044137.203784:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397ba9c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+5:2409:x1870705565133952:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 85us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044137.203793:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 234 00000100:00100000:1.0:1784044137.203797:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 85 00000100:00100000:2.0:1784044137.203799:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843e3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+5:2409:x1870705565133824:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:2.0:1784044137.203827:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843e3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+5:2409:x1870705565133824:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 29us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044137.203833:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 234 00000100:00100000:2.0:1784044137.203844:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 235 00000100:00100000:2.0:1784044137.203849:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3945932d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68dfcea6-5d83-4dbb-8fa3-e35542d621e5+5:2409:x1870705565134080:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:2.0:1784044137.203866:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3945932d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68dfcea6-5d83-4dbb-8fa3-e35542d621e5+5:2409:x1870705565134080:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 17us (380us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044137.203871:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 235 00000100:00100000:2.0:1784044137.203880:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 236 00000100:00100000:2.0:1784044137.203884:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3945930a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+18:2409:x1870705565133696:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:2.0:1784044137.203905:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3945930a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+18:2409:x1870705565133696:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 21us (384us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044137.203911:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 236 00000100:00100000:2.0:1784044137.203919:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 237 00000100:00100000:2.0:1784044137.203924:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3945932a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68dfcea6-5d83-4dbb-8fa3-e35542d621e5+5:2409:x1870705565134208:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:2.0:1784044137.203940:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3945932a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68dfcea6-5d83-4dbb-8fa3-e35542d621e5+5:2409:x1870705565134208:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 16us (356us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044137.203952:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 237 00000100:00100000:0.0:1784044137.204262:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565133568 00000100:00100000:0.0:1784044137.204267:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565133568 00000100:00100000:0.0:1784044137.204312:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 345 00000100:00100000:0.0:1784044137.204318:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3950374c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4a09ad9-a185-4679-99bb-b6a07b865440+13:2409:x1870705565133568:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:0.0:1784044137.204347:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3950374c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4a09ad9-a185-4679-99bb-b6a07b865440+13:2409:x1870705565133568:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 29us (956us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044137.204353:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 345 00000100:00100000:1.0:1784044137.549897:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39503bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1870705580950144:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1784044137.550044:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044137.550145:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580950144 00000100:00100000:2.0:1784044137.550153:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580950144 00000100:00100000:2.0:1784044137.550221:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1784044137.550230:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843e0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1870705580950144:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1784044137.550263:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1784044137.550318:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843e0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1870705580950144:12345-0@lo:41:osp-pre-0-1.0 Request processed in 89us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044137.550327:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1784044137.550370:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39503bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1870705580950144:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1784044138.134547:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1784044138.573649:0:8450:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 331744472628ns, next at 332744470049ns, rc = 0 00000100:00100000:0.0:1784044138.575243:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b38427b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1870705580950272:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784044138.575335:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044138.575631:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580950272 00000100:00100000:0.0:1784044138.575640:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580950272 00000100:00100000:0.0:1784044138.575702:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1784044138.575712:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39503bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1870705580950272:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1784044138.575743:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784044138.575786:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39503bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1870705580950272:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (450us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044138.575793:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00010000:00080000:0.0:1784044138.575834:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b38427b4a80 x1870705580950272/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784044154 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784044138.575853:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b38427b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1870705580950272:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1784044138.575910:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784044138.576421:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b38427b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1870705580950400:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1784044138.576470:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044138.576595:0:7768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580950400 00000100:00100000:3.0:1784044138.576601:0:7768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580950400 00000100:00100000:3.0:1784044138.576639:0:7768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1784044138.576645:0:7768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3945930000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1870705580950400:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1784044138.576668:0:7768:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1784044138.576703:0:7768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3945930000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1870705580950400:12345-0@lo:41:osp-pre-1-0.0 Request processed in 58us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044138.576709:0:7768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1784044138.577068:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b38427b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1870705580950400:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1784044138.578612:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784044138.578633:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39503be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1870705580950528:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1784044138.578694:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044138.578756:0:10713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580950528 00000100:00100000:0.0:1784044138.578761:0:10713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580950528 00000100:00100000:0.0:1784044138.578811:0:10713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1784044138.578818:0:10713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397a8a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1870705580950528:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1784044138.578835:0:10713:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784044138.578873:0:10713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397a8a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1870705580950528:12345-0@lo:13:osp-pre-0-1.0 Request processed in 55us (178us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044138.578880:0:10713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00080000:0.0:1784044138.578897:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1784044138.578932:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b39503be680 x1870705580950528/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784044154 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784044138.578948:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39503be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1870705580950528:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1784044139.149363:0:10331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784044139.597623:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784044139.597650:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843c89180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1870705580950656:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784044139.597721:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044139.597786:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580950656 00000100:00100000:2.0:1784044139.597793:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580950656 00000100:00100000:2.0:1784044139.597841:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1784044139.597851:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843c8bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1870705580950656:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1784044139.597891:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784044139.597934:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843c8bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1870705580950656:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (213us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044139.597942:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00080000:2.0:1784044139.597971:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1784044139.598017:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b3843c89180 x1870705580950656/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784044155 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784044139.598035:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843c89180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1870705580950656:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784044139.600967:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843c89180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:3640:1870705580950784:0@lo:400:kworker.0 00000100:00100000:2.0:1784044139.601048:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044139.601087:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397f9dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1870705580951296:0@lo:400:kworker.0 00000100:00100000:2.0:1784044139.601112:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044139.601132:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b384316dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1870705580951808:0@lo:400:kworker.0 00000100:00100000:2.0:1784044139.601155:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044139.601210:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1784044139.601216:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397f9e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1870705580950912:0@lo:400:kworker.0 00000100:00100000:2.0:1784044139.601240:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044139.601276:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397f9dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1870705580951424:0@lo:400:kworker.0 00000100:00100000:2.0:1784044139.601308:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044139.601336:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b384316ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3640:1870705580951936:0@lo:400:kworker.0 00000100:00100000:2.0:1784044139.601359:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044139.601424:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580950784 00000100:00100000:2.0:1784044139.601431:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580950784 00000100:00100000:2.0:1784044139.601626:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 346 00000100:00100000:2.0:1784044139.601634:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3950376c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+24:3640:x1870705580950784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784044139.601687:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3950376c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+24:3640:x1870705580950784:12345-0@lo:400:kworker.0 Request processed in 53us (638us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044139.601695:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 346 00000100:00100000:2.0:1784044139.601730:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580951296 00000100:00100000:2.0:1784044139.601748:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580951296 00000100:00100000:2.0:1784044139.601775:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1784044139.601781:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843cab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1870705580951296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784044139.601815:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843cab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1870705580951296:12345-0@lo:400:kworker.0 Request processed in 34us (701us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044139.601821:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1784044139.601840:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580951808 00000100:00100000:2.0:1784044139.601843:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580951808 00000100:00100000:2.0:1784044139.601874:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580950912 00000100:00100000:2.0:1784044139.601877:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580950912 00000100:00100000:2.0:1784044139.601890:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580951936 00000100:00100000:2.0:1784044139.601892:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580951936 00000100:00100000:2.0:1784044139.601907:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:2.0:1784044139.601912:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843cabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1870705580951808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784044139.601943:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843cabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1870705580951808:12345-0@lo:400:kworker.0 Request processed in 31us (787us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044139.601949:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:2.0:1784044139.601960:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:2.0:1784044139.601964:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843dbed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1870705580950912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784044139.602002:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843dbed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1870705580950912:12345-0@lo:400:kworker.0 Request processed in 37us (761us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044139.602008:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:2.0:1784044139.602019:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:2.0:1784044139.602025:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843ce6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1870705580951936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784044139.602050:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843ce6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1870705580951936:12345-0@lo:400:kworker.0 Request processed in 25us (691us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044139.602055:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:2.0:1784044139.602083:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580951424 00000100:00100000:2.0:1784044139.602087:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580951424 00000100:00100000:2.0:1784044139.602113:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1784044139.602118:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843ce6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1870705580951424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784044139.602150:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843ce6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1870705580951424:12345-0@lo:400:kworker.0 Request processed in 31us (841us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044139.602156:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1784044139.602732:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397f9dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3639:1870705580951168:0@lo:400:kworker.0 00000100:00100000:3.0:1784044139.602769:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044139.602792:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b384316d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3639:1870705580951680:0@lo:400:kworker.0 00000100:00100000:3.0:1784044139.602823:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044139.602840:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843ca9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1870705580952192:0@lo:400:kworker.0 00000100:00100000:3.0:1784044139.602862:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044139.602884:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1784044139.602890:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397f9dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1870705580951040:0@lo:400:kworker.0 00000100:00100000:3.0:1784044139.602913:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044139.602931:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b384316c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1870705580951552:0@lo:400:kworker.0 00000100:00100000:3.0:1784044139.602950:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044139.602964:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843caa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3639:1870705580952064:0@lo:400:kworker.0 00000100:00100000:3.0:1784044139.602998:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044139.603029:0:7768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580951040 00000100:00100000:3.0:1784044139.603034:0:7768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580951040 00000100:00100000:3.0:1784044139.603066:0:7768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1784044139.603072:0:7768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38427b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1870705580951040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044139.603112:0:7768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38427b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1870705580951040:12345-0@lo:400:kworker.0 Request processed in 39us (198us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044139.603118:0:7768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1784044139.603138:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580951168 00000100:00100000:3.0:1784044139.603141:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580951168 00000100:00100000:3.0:1784044139.603157:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580951680 00000100:00100000:3.0:1784044139.603159:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580951680 00000100:00100000:3.0:1784044139.603200:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580952064 00000100:00100000:3.0:1784044139.603204:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580952064 00000100:00100000:3.0:1784044139.603222:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:3.0:1784044139.603228:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38427b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1870705580951168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044139.603258:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38427b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1870705580951168:12345-0@lo:400:kworker.0 Request processed in 29us (488us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044139.603274:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:3.0:1784044139.603287:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:3.0:1784044139.603292:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38427b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1870705580951680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044139.603322:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38427b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1870705580951680:12345-0@lo:400:kworker.0 Request processed in 29us (498us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044139.603328:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:3.0:1784044139.603338:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:3.0:1784044139.603343:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38427b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1870705580952064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044139.603367:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38427b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1870705580952064:12345-0@lo:400:kworker.0 Request processed in 24us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044139.603372:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:3.0:1784044139.603389:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580952192 00000100:00100000:3.0:1784044139.603392:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580952192 00000100:00100000:3.0:1784044139.603415:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580951552 00000100:00100000:3.0:1784044139.603419:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580951552 00000100:00100000:3.0:1784044139.603501:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1784044139.603510:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38427b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1870705580952192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044139.603541:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38427b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1870705580952192:12345-0@lo:400:kworker.0 Request processed in 33us (678us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044139.603547:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1784044139.603559:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1784044139.603565:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38427b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1870705580951552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044139.603590:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38427b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1870705580951552:12345-0@lo:400:kworker.0 Request processed in 25us (639us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044139.603595:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1784044139.603694:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397f9dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1870705580951040:0@lo:400:kworker.0 00010000:00080000:3.0:1784044139.603707:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b384316c380 x1870705580951552/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784044155 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784044139.603717:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b384316c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1870705580951552:0@lo:400:kworker.0 00010000:00080000:3.0:1784044139.603727:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b3843caa680 x1870705580952064/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044155 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784044139.603735:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843caa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3639:1870705580952064:0@lo:400:kworker.0 00000100:00100000:3.0:1784044139.603744:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397f9dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3639:1870705580951168:0@lo:400:kworker.0 00000100:00100000:3.0:1784044139.603752:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b384316d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3639:1870705580951680:0@lo:400:kworker.0 00010000:00080000:3.0:1784044139.603759:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b3843ca9180 x1870705580952192/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784044155 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784044139.603767:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843ca9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1870705580952192:0@lo:400:kworker.0 00000100:00080000:2.0:1784044139.606572:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1784044139.606581:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1784044139.606584:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1784044139.606702:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397f9e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1870705580950912:0@lo:400:kworker.0 00010000:00080000:2.0:1784044139.606722:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b397f9dc000 x1870705580951424/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784044155 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784044139.606732:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397f9dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1870705580951424:0@lo:400:kworker.0 00000100:00100000:2.0:1784044139.606744:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b384316ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3640:1870705580951936:0@lo:400:kworker.0 00000100:00100000:2.0:1784044139.606755:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843c89180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:3640:1870705580950784:0@lo:400:kworker.0 00000100:00100000:2.0:1784044139.606765:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397f9dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1870705580951296:0@lo:400:kworker.0 00010000:00080000:2.0:1784044139.606776:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b384316dc00 x1870705580951808/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044155 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784044139.606785:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b384316dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1870705580951808:0@lo:400:kworker.0 00000100:00100000:2.0:1784044139.608141:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843ce5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1870705580952320:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1784044139.608240:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044139.624666:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580952320 00000100:00100000:0.0:1784044139.624680:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580952320 00000100:00100000:0.0:1784044139.624748:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1784044139.624759:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843c89180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1870705580952320:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1784044139.624785:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784044139.625071:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843c89180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1870705580952320:12345-0@lo:13:osp-pre-1-1.0 Request processed in 314us (16830us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044139.625080:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00010000:00080000:0.0:1784044139.625138:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b3843ce5500 x1870705580952320/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784044155 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784044139.625159:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843ce5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1870705580952320:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1784044140.173349:0:10330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784044141.200035:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1784044141.669071:0:6490:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000001:00080000:1.0:1784044141.669110:0:6490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967310 is committed 00000004:00080000:1.0:1784044141.669119:0:6490:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00010000:00010000:1.0:1784044141.669205:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd000/0x89871fc3aba18153 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x6f4d6809 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044141.669217:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd000/0x89871fc3aba18153 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x6f4d6809 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044141.669225:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd000/0x89871fc3aba18153 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x6f4d6809 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044141.669230:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38426fd000 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:1.0:1784044141.669235:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd000/0x89871fc3aba18153 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x6f4d6809 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044141.669244:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd000/0x89871fc3aba18153 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x6f4d6809 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044141.669261:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x6f4d6809 (ffff9b3842776800) 00010000:00010000:1.0:1784044141.669264:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784044141.669269:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd000/0x89871fc3aba18153 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x6f4d6809 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044141.669289:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd000/0x89871fc3aba18153 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x6f4d6809 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044141.669321:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd800/0x89871fc3aba18168 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044141.669327:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd800/0x89871fc3aba18168 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044141.669332:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd800/0x89871fc3aba18168 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044141.669337:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38426fd800 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:1.0:1784044141.669340:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd800/0x89871fc3aba18168 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044141.669345:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd800/0x89871fc3aba18168 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044141.669353:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9b3842776f00) 00010000:00010000:1.0:1784044141.669355:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784044141.669358:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd800/0x89871fc3aba18168 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044141.669364:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd800/0x89871fc3aba18168 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044141.669380:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc800/0x89871fc3aba181d1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x6f4d6809 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044141.669386:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc800/0x89871fc3aba181d1 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x6f4d6809 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044141.669396:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc800/0x89871fc3aba181d1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x6f4d6809 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044141.669402:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38426fc800 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:1.0:1784044141.669404:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc800/0x89871fc3aba181d1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x6f4d6809 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044141.669410:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc800/0x89871fc3aba181d1 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x6f4d6809 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044141.669429:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x6f4d6809 (ffff9b3842776800) 00010000:00010000:1.0:1784044141.669431:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784044141.669434:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc800/0x89871fc3aba181d1 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x6f4d6809 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044141.669439:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc800/0x89871fc3aba181d1 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x6f4d6809 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044141.669452:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd200/0x89871fc3aba181ed lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044141.669458:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd200/0x89871fc3aba181ed lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044141.669462:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd200/0x89871fc3aba181ed lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044141.669468:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38426fd200 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:1.0:1784044141.669471:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd200/0x89871fc3aba181ed lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044141.669486:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd200/0x89871fc3aba181ed lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044141.669495:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9b3842776700) 00010000:00010000:1.0:1784044141.669497:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784044141.669500:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd200/0x89871fc3aba181ed lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044141.669505:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd200/0x89871fc3aba181ed lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044141.676470:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b38427b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1870705580952448:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1784044141.676551:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044141.683351:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580952448 00000100:00100000:3.0:1784044141.683367:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580952448 00000100:00100000:3.0:1784044141.687247:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1784044141.687267:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397f9e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1870705580952448:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1784044141.687308:0:8428:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2 count 1 00002000:00010000:3.0:1784044141.687347:0:8428:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 0, mtime: 0x6a565a67, atime: 0x6a565a67, ctime: 0x6a565a67, blocks: 0x0 00010000:00010000:3.0:1784044141.687355:0:8428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007d3663e5/0x89871fc3aba181fb lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044141.687373:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=334s v=(0 0) 00010000:00010000:3.0:1784044141.687389:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784044141.687396:0:8428:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007d3663e5/0x89871fc3aba181fb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044141.687426:0:8428:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007d3663e5/0x89871fc3aba181fb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044141.687437:0:8428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007d3663e5/0x89871fc3aba181fb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044141.687445:0:8428:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007d3663e5/0x89871fc3aba181fb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044141.687472:0:8428:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1784044141.687705:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397f9e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3641:x1870705580952448:12345-0@lo:6:osp-syn-0-0.0 Request processed in 432us (11140us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1784044141.687714:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000004:00080000:3.0:1784044141.687785:0:3641:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b38427b7800/2, rc 0, transno 4294967301 00000100:00100000:3.0:1784044141.687792:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b38427b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1870705580952448:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1784044141.689056:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784044141.689067:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007d3663e5/0x89871fc3aba181fb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044141.689080:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b39759f8600 already unused, calling callback (ffffffffc0b56230) 00010000:00010000:3.0:1784044141.689085:0:6500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007d3663e5/0x89871fc3aba181fb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044141.689114:0:6500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007d3663e5/0x89871fc3aba181fb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044141.689133:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007d3663e5/0x89871fc3aba181fb lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044141.689140:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007d3663e5/0x89871fc3aba181fb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044141.689161:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784044141.689163:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784044141.689165:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1784044141.689283:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:02000400:0.0:1784044141.796505:0:13677:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00010000:00010000:0.0:1784044142.221963:0:10331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784044142.310448:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044142.311855:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044142.311890:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044142.318067:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044142.318098:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044142.320858:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565134464 00000100:00100000:2.0:1784044142.320879:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565134464 00000100:00100000:2.0:1784044142.320985:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565134976 00000100:00100000:2.0:1784044142.320989:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565134976 00000100:00100000:2.0:1784044142.321015:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 244 00000100:00100000:2.0:1784044142.321027:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38427b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+5:2410:x1870705565134464:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:2.0:1784044142.321143:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38427b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+5:2410:x1870705565134464:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 118us (10706us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044142.321153:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 244 00000100:00100000:2.0:1784044142.321195:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 245 00000100:00100000:2.0:1784044142.321203:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843ca9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68dfcea6-5d83-4dbb-8fa3-e35542d621e5+5:2410:x1870705565134976:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:2.0:1784044142.321236:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843ca9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68dfcea6-5d83-4dbb-8fa3-e35542d621e5+5:2410:x1870705565134976:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 33us (9345us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044142.321243:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 245 00000100:00080000:2.0:1784044142.321272:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1784044142.321277:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784044142.321434:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565134720 00000100:00100000:2.0:1784044142.321439:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565134720 00000100:00100000:2.0:1784044142.321471:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 89 00000100:00100000:2.0:1784044142.321478:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38427b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+5:2410:x1870705565134720:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:2.0:1784044142.321510:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38427b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+5:2410:x1870705565134720:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 33us (9664us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044142.321517:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 89 00000100:00080000:2.0:1784044142.321549:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784044142.324253:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044142.325476:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565134592 00000100:00100000:2.0:1784044142.325489:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565134592 00000100:00100000:2.0:1784044142.325570:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565134848 00000100:00100000:2.0:1784044142.325574:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565134848 00000100:00100000:2.0:1784044142.325595:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 246 00000100:00100000:2.0:1784044142.325605:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843caa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+5:2410:x1870705565134592:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:2.0:1784044142.325682:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843caa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+5:2410:x1870705565134592:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 79us (7583us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044142.325699:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 246 00000100:00100000:2.0:1784044142.325717:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 247 00000100:00100000:2.0:1784044142.325724:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b384316dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68dfcea6-5d83-4dbb-8fa3-e35542d621e5+5:2410:x1870705565134848:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:2.0:1784044142.325751:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b384316dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68dfcea6-5d83-4dbb-8fa3-e35542d621e5+5:2410:x1870705565134848:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 27us (1507us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044142.325757:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 247 00000100:00080000:3.0:1784044142.325908:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1784044142.325913:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1784044142.327480:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565134336 00000100:00100000:1.0:1784044142.327491:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565134336 00000100:00100000:1.0:1784044142.327535:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 347 00000100:00100000:1.0:1784044142.327545:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3950375850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4a09ad9-a185-4679-99bb-b6a07b865440+13:2410:x1870705565134336:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:1.0:1784044142.327769:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3950375850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4a09ad9-a185-4679-99bb-b6a07b865440+13:2410:x1870705565134336:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 224us (9707us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044142.327777:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 347 00000100:00100000:2.0:1784044142.670886:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397a8a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1870705580952576:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1784044142.671019:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044142.671115:0:7768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580952576 00000100:00100000:3.0:1784044142.671123:0:7768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580952576 00000100:00100000:3.0:1784044142.671190:0:7768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1784044142.671201:0:7768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843737480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1870705580952576:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1784044142.671233:0:7768:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1784044142.677715:0:7768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843737480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1870705580952576:12345-0@lo:41:osp-pre-0-1.0 Request processed in 6505us (6685us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044142.677737:0:7768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1784044142.680921:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397a8a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1870705580952576:0@lo:41:osp-pre-0-1.0 00000020:00000080:0.0:1784044143.101900:0:13725:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff23eb50d0 20000000:00000080:0.0:1784044143.101917:0:13725:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9b397f9c8800 uarg=0000000000000000 20000000:01000000:0.0:1784044143.102014:0:13725:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:0.0:1784044143.102021:0:13725:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:0.0:1784044143.102025:0:13725:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:0.0:1784044143.117108:0:13726:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:2.0:1784044143.119473:0:13725:0:(mgs_llog.c:4116:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:3.0:1784044143.131280:0:13725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:3.0:1784044143.131316:0:13725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:3.0:1784044143.131333:0:13725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:3.0:1784044143.131348:0:13725:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1784044143.131373:0:13725:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b39759f8600/0x89871fc3aba18202 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044143.131394:0:13725:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b3843798200/0x89871fc3aba18088 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca65e4 expref: 12 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044143.134352:0:13725:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b3843798800/0x89871fc3aba1808f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca65eb expref: 12 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044143.134369:0:13725:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b39759f9400/0x89871fc3aba1809d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x89871fc3aba18096 expref: 23 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044143.134377:0:13725:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b39759f9800/0x89871fc3aba180ab lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x89871fc3aba180a4 expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044143.134386:0:13725:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b3843799200/0x89871fc3aba180b9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x89871fc3aba180b2 expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044143.134393:0:13725:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b39759f9e00/0x89871fc3aba180c7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x89871fc3aba180c0 expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044143.134459:0:13725:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b39759f8600/0x89871fc3aba18202 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044143.134509:0:13725:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b39759f9e00/0x89871fc3aba180c7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x89871fc3aba180c0 expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044143.134600:0:13725:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b39759f9e00/0x89871fc3aba180c7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x89871fc3aba180c0 expref: 23 pid: 6505 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044143.134617:0:13725:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b384316ea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13725:1870705580952704:0@lo:104: 00000100:00100000:3.0:1784044143.134979:0:13725:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1784044143.135052:0:13725:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b3843799200/0x89871fc3aba180b9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x89871fc3aba180b2 expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044143.135061:0:13725:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b3843799200/0x89871fc3aba180b9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x89871fc3aba180b2 expref: 23 pid: 6505 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044143.135071:0:13725:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b384316c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13725:1870705580952832:0@lo:104: 00000100:00100000:3.0:1784044143.135096:0:13725:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1784044143.135130:0:13725:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b39759f9800/0x89871fc3aba180ab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x89871fc3aba180a4 expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044143.135138:0:13725:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b39759f9800/0x89871fc3aba180ab lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x89871fc3aba180a4 expref: 23 pid: 6505 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044143.135147:0:13725:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397f9dc000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13725:1870705580952960:0@lo:104: 00000100:00100000:3.0:1784044143.135168:0:13725:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1784044143.135216:0:13725:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b39759f9400/0x89871fc3aba1809d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x89871fc3aba18096 expref: 23 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044143.135225:0:13725:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b39759f9400/0x89871fc3aba1809d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x89871fc3aba18096 expref: 23 pid: 6504 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044143.135234:0:13725:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397f9dd500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13725:1870705580953088:0@lo:104: 00000100:00100000:3.0:1784044143.135266:0:13725:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1784044143.135286:0:13725:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b3843798800/0x89871fc3aba1808f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca65eb expref: 12 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044143.135298:0:13725:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b3843798800/0x89871fc3aba1808f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca65eb expref: 12 pid: 6504 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044143.135308:0:13725:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b38420a8000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13725:1870705580953216:192.168.202.40@tcp:104: 00000100:00100000:1.0:1784044143.137835:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580952704 00000100:00100000:1.0:1784044143.137846:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580952704 00000100:00100000:1.0:1784044143.137898:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580952832 00000100:00100000:1.0:1784044143.137901:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580952832 00000100:00100000:1.0:1784044143.137912:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580952960 00000100:00100000:1.0:1784044143.137915:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580952960 00000100:00100000:1.0:1784044143.137922:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580953088 00000100:00100000:1.0:1784044143.137924:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580953088 00000100:00100000:1.0:1784044143.137952:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1784044143.137961:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b384316d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+6:13725:x1870705580952704:12345-0@lo:104: 00010000:00010000:1.0:1784044143.137994:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.140@tcp lock: ffff9b39759f9200/0x89871fc3aba180c0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x89871fc3aba180c7 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044143.138078:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1784044143.138083:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b384316d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+6:13725:x1870705580952704:12345-0@lo:104: Request processed in 124us (3106us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044143.138090:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1784044143.138109:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1784044143.138115:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397f9dc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+5:13725:x1870705580952832:12345-0@lo:104: 00010000:00010000:1.0:1784044143.138123:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.140@tcp lock: ffff9b39759f8000/0x89871fc3aba180b2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x89871fc3aba180b9 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044143.138156:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1784044143.138161:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397f9dc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+5:13725:x1870705580952832:12345-0@lo:104: Request processed in 47us (3065us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044143.138167:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1784044143.138203:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1784044143.138209:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397f9dc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+4:13725:x1870705580952960:12345-0@lo:104: 00010000:00010000:1.0:1784044143.138216:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.140@tcp lock: ffff9b39759f8800/0x89871fc3aba180a4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x89871fc3aba180ab expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044143.138251:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1784044143.138256:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397f9dc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+4:13725:x1870705580952960:12345-0@lo:104: Request processed in 48us (3087us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044143.138261:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1784044143.138272:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1784044143.138278:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38420aa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+3:13725:x1870705580953088:12345-0@lo:104: 00010000:00010000:1.0:1784044143.138292:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.140@tcp lock: ffff9b3843798e00/0x89871fc3aba18096 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x89871fc3aba1809d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044143.138324:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1784044143.138329:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38420aa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+3:13725:x1870705580953088:12345-0@lo:104: Request processed in 51us (3063us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044143.138335:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00010000:1.0:1784044143.138352:0:10330:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1784044143.138358:0:10330:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: ffff9b39759f9200/0x89871fc3aba180c0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x89871fc3aba180c7 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044143.138365:0:10330:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b39759f9200 already unused, calling callback (ffffffffc113cc20) 10000000:00010000:1.0:1784044143.138370:0:10330:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: ffff9b39759f9200/0x89871fc3aba180c0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x89871fc3aba180c7 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044143.138378:0:10330:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9b39759f9200/0x89871fc3aba180c0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x89871fc3aba180c7 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784044143.138385:0:10330:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9b39759f9200/0x89871fc3aba180c0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x89871fc3aba180c7 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784044143.138390:0:10330:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1784044143.138442:0:10330:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.140@tcp lock: ffff9b39759f9200/0x89871fc3aba180c0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x89871fc3aba180c7 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044143.138449:0:10330:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784044143.138470:0:10330:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: ffff9b39759f9200/0x89871fc3aba180c0 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x89871fc3aba180c7 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044143.138478:0:10330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9b39759f9200/0x89871fc3aba180c0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x89871fc3aba180c7 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044143.138497:0:10330:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1784044143.138501:0:10330:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: ffff9b39759f8000/0x89871fc3aba180b2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x89871fc3aba180b9 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044143.138507:0:10330:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b39759f8000 already unused, calling callback (ffffffffc113cc20) 10000000:00010000:1.0:1784044143.138510:0:10330:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: ffff9b39759f8000/0x89871fc3aba180b2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x89871fc3aba180b9 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044143.138594:0:10330:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9b39759f8000/0x89871fc3aba180b2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x89871fc3aba180b9 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784044143.138601:0:10330:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9b39759f8000/0x89871fc3aba180b2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x89871fc3aba180b9 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784044143.138606:0:10330:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1784044143.138621:0:10330:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.140@tcp lock: ffff9b39759f8000/0x89871fc3aba180b2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x89871fc3aba180b9 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044143.138627:0:10330:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784044143.138642:0:10330:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: ffff9b39759f8000/0x89871fc3aba180b2 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x89871fc3aba180b9 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044143.138649:0:10330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9b39759f8000/0x89871fc3aba180b2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x89871fc3aba180b9 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044143.138658:0:10330:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1784044143.138662:0:10330:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: ffff9b39759f8800/0x89871fc3aba180a4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x89871fc3aba180ab expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044143.138678:0:10330:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b39759f8800 already unused, calling callback (ffffffffc113cc20) 10000000:00010000:1.0:1784044143.138806:0:10330:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: ffff9b39759f8800/0x89871fc3aba180a4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x89871fc3aba180ab expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044143.138813:0:10330:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9b39759f8800/0x89871fc3aba180a4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x89871fc3aba180ab expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784044143.138818:0:10330:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9b39759f8800/0x89871fc3aba180a4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x89871fc3aba180ab expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784044143.138823:0:10330:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1784044143.138838:0:10330:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.140@tcp lock: ffff9b39759f8800/0x89871fc3aba180a4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x89871fc3aba180ab expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044143.138843:0:10330:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784044143.138851:0:10330:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: ffff9b39759f8800/0x89871fc3aba180a4 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x89871fc3aba180ab expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044143.138856:0:10330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9b39759f8800/0x89871fc3aba180a4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x89871fc3aba180ab expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044143.138865:0:10330:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784044143.138868:0:10330:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: ffff9b3843798e00/0x89871fc3aba18096 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x89871fc3aba1809d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044143.138873:0:10330:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3843798e00 already unused, calling callback (ffffffffc113cc20) 10000000:00010000:1.0:1784044143.138876:0:10330:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: ffff9b3843798e00/0x89871fc3aba18096 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x89871fc3aba1809d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044143.138891:0:10330:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9b3843798e00/0x89871fc3aba18096 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x89871fc3aba1809d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784044143.138897:0:10330:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9b3843798e00/0x89871fc3aba18096 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x89871fc3aba1809d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784044143.138902:0:10330:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1784044143.138914:0:10330:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.140@tcp lock: ffff9b3843798e00/0x89871fc3aba18096 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x89871fc3aba1809d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044143.138919:0:10330:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784044143.138924:0:10330:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: ffff9b3843798e00/0x89871fc3aba18096 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x89871fc3aba1809d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044143.138930:0:10330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9b3843798e00/0x89871fc3aba18096 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x89871fc3aba1809d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044143.138955:0:10330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784044143.138957:0:10330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784044143.138959:0:10330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784044143.138967:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784044143.138973:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784044143.138988:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843e0e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:3639:1870705580953344:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784044143.139027:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044143.139095:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1784044143.139101:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843e0c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:3639:1870705580953728:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784044143.139120:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044143.139149:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843e0fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:3640:1870705580953472:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784044143.139200:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044143.139216:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784044143.139222:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843e0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:3640:1870705580953600:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784044143.139241:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044143.139268:0:13182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580953344 00000100:00100000:1.0:1784044143.139273:0:13182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580953344 00010000:00010000:1.0:1784044143.139293:0:13182:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b39759f9e00/0x89871fc3aba180c7 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x89871fc3aba180c0 expref: 24 pid: 6505 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044143.139308:0:13182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580953728 00000100:00100000:1.0:1784044143.139310:0:13182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580953728 00010000:00010000:1.0:1784044143.139318:0:13182:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b39759f9400/0x89871fc3aba1809d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x89871fc3aba18096 expref: 25 pid: 6504 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044143.139327:0:13182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580953472 00000100:00100000:1.0:1784044143.139329:0:13182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580953472 00010000:00010000:1.0:1784044143.139339:0:13182:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b3843799200/0x89871fc3aba180b9 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x89871fc3aba180b2 expref: 26 pid: 6505 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044143.139348:0:13182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580953600 00000100:00100000:1.0:1784044143.139350:0:13182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580953600 00010000:00010000:1.0:1784044143.139358:0:13182:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b39759f9800/0x89871fc3aba180ab lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x89871fc3aba180a4 expref: 27 pid: 6505 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044143.139367:0:13182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1784044143.139372:0:13182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843e0d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+27:3639:x1870705580953344:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784044143.139382:0:13182:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784044143.139387:0:13182:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b39759f9e00/0x89871fc3aba180c7 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x89871fc3aba180c0 expref: 27 pid: 6505 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044143.139631:0:10331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784044143.139646:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1784044143.139655:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843e0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+27:3639:x1870705580953728:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784044143.139665:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784044143.139670:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b39759f9400/0x89871fc3aba1809d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x89871fc3aba18096 expref: 27 pid: 6504 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044143.139691:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b39759f9400/0x89871fc3aba1809d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x89871fc3aba18096 expref: 27 pid: 6504 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044143.139715:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784044143.139749:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843e0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+27:3639:x1870705580953728:12345-0@lo:103:ldlm_bl.0 Request processed in 97us (627us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044143.139757:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1784044143.139774:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1784044143.139780:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843e0c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+26:3640:x1870705580953472:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784044143.139787:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784044143.139791:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b3843799200/0x89871fc3aba180b9 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x89871fc3aba180b2 expref: 26 pid: 6505 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044143.139799:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b3843799200/0x89871fc3aba180b9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x89871fc3aba180b2 expref: 26 pid: 6505 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044143.139808:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784044143.139832:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843e0c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+26:3640:x1870705580953472:12345-0@lo:103:ldlm_bl.0 Request processed in 53us (631us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044143.139838:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1784044143.139850:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1784044143.139856:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843e0f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+25:3640:x1870705580953600:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784044143.139862:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784044143.139866:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b39759f9800/0x89871fc3aba180ab lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x89871fc3aba180a4 expref: 25 pid: 6505 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044143.139874:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b39759f9800/0x89871fc3aba180ab lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x89871fc3aba180a4 expref: 25 pid: 6505 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044143.139882:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784044143.139908:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843e0f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+25:3640:x1870705580953600:12345-0@lo:103:ldlm_bl.0 Request processed in 52us (666us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044143.139914:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1784044143.139957:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843e0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:3640:1870705580953600:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784044143.139967:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843e0fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:3640:1870705580953472:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784044143.139993:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843e0c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:3639:1870705580953728:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784044143.141130:0:13725:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b3843798200/0x89871fc3aba18088 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca65e4 expref: 12 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044143.141145:0:13725:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b3843798200/0x89871fc3aba18088 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x70000400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca65e4 expref: 12 pid: 6504 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044143.141160:0:13725:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b38420a9180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13725:1870705580953856:192.168.202.40@tcp:104: 00000100:00100000:3.0:1784044143.141235:0:13725:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3843617480 going to sleep for 11 seconds 00000100:00100000:3.0:1784044143.141253:0:13725:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b384316ea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13725:1870705580952704:0@lo:104: 00010000:00010000:3.0:1784044143.141263:0:13725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b3843799200/0x89871fc3aba180b9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x89871fc3aba180b2 expref: 24 pid: 6505 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044143.141274:0:13725:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b384316c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13725:1870705580952832:0@lo:104: 00010000:00010000:3.0:1784044143.141282:0:13725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b39759f9800/0x89871fc3aba180ab lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x89871fc3aba180a4 expref: 23 pid: 6505 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044143.141290:0:13725:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397f9dc000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13725:1870705580952960:0@lo:104: 00010000:00010000:3.0:1784044143.141297:0:13725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b39759f9400/0x89871fc3aba1809d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x89871fc3aba18096 expref: 22 pid: 6504 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044143.141304:0:13725:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397f9dd500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13725:1870705580953088:0@lo:104: 00010000:00010000:1.0:1784044143.143154:0:13182:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b39759f9e00/0x89871fc3aba180c7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x89871fc3aba180c0 expref: 21 pid: 6505 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044143.143196:0:13182:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b39759f9e00/0x89871fc3aba180c7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x89871fc3aba180c0 expref: 21 pid: 6505 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044143.143214:0:13182:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784044143.143283:0:13182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843e0d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+20:3639:x1870705580953344:12345-0@lo:103:ldlm_bl.0 Request processed in 3908us (4254us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044143.152208:0:13182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1784044143.154088:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843e0e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:3639:1870705580953344:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784044143.162487:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044143.162586:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1784044143.162821:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565135104 00000100:00100000:1.0:1784044143.162832:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565135104 00010000:00010000:1.0:1784044143.162876:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b3843798800/0x89871fc3aba1808f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca65eb expref: 13 pid: 6504 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044143.162920:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565135232 00000100:00100000:1.0:1784044143.162924:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565135232 00010000:00010000:1.0:1784044143.162938:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b3843798200/0x89871fc3aba18088 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca65e4 expref: 14 pid: 6504 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044143.162974:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 50 00000100:00100000:1.0:1784044143.162984:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843e3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c4a09ad9-a185-4679-99bb-b6a07b865440+14:2409:x1870705565135104:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784044143.163001:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784044143.163008:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b3843798800/0x89871fc3aba1808f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca65eb expref: 14 pid: 6504 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044143.163022:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b3843798800/0x89871fc3aba1808f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca65eb expref: 14 pid: 6504 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044143.163065:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784044143.163120:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843e3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c4a09ad9-a185-4679-99bb-b6a07b865440+14:2409:x1870705565135104:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 137us (644us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044143.163127:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 50 00000100:00100000:1.0:1784044143.163147:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 51 00000100:00100000:1.0:1784044143.163153:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843e3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c4a09ad9-a185-4679-99bb-b6a07b865440+13:2409:x1870705565135232:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784044143.163160:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784044143.163164:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b3843798200/0x89871fc3aba18088 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca65e4 expref: 13 pid: 6504 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044143.163194:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b3843798200/0x89871fc3aba18088 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca65e4 expref: 13 pid: 6504 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044143.163208:0:6496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b39759f8600/0x89871fc3aba18202 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 13725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044143.163217:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b39759f8600/0x89871fc3aba18202 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 13725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044143.163232:0:6496:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b39759f8600/0x89871fc3aba18202 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044143.163239:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b39759f8600/0x89871fc3aba18202 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044143.163246:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b39759f8600/0x89871fc3aba18202 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044143.163253:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b39759f8600/0x89871fc3aba18202 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044143.163266:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b39759f8600 already unused, calling callback (ffffffffc0b56230) 00010000:00010000:1.0:1784044143.163270:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b39759f8600/0x89871fc3aba18202 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044143.163279:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b39759f8600/0x89871fc3aba18202 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044143.163289:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b39759f8600/0x89871fc3aba18202 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044143.163299:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784044143.163318:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843e3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c4a09ad9-a185-4679-99bb-b6a07b865440+13:2409:x1870705565135232:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 165us (732us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044143.163325:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 51 00010000:00010000:3.0:1784044143.164392:0:13725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b3843798800/0x89871fc3aba1808f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca65eb expref: 12 pid: 6504 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044143.164425:0:13725:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b38420a8000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13725:1870705580953216:192.168.202.40@tcp:104: 00010000:00010000:3.0:1784044143.164439:0:13725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b3843798200/0x89871fc3aba18088 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca65e4 expref: 11 pid: 6504 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044143.164448:0:13725:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b38420a9180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13725:1870705580953856:192.168.202.40@tcp:104: 00010000:00010000:3.0:1784044143.164484:0:13725:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b39759f8600/0x89871fc3aba18202 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044143.164495:0:13725:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b39759f8600/0x89871fc3aba18202 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044143.164502:0:13725:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b39759f8600/0x89871fc3aba18202 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044143.164509:0:13725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b39759f8600/0x89871fc3aba18202 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044143.246015:0:10330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784044143.693827:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784044143.693850:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397a8a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1870705580953984:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1784044143.693963:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044143.694282:0:10713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580953984 00000100:00100000:2.0:1784044143.694291:0:10713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580953984 00000100:00100000:2.0:1784044143.694346:0:10713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1784044143.694356:0:10713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397a8a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1870705580953984:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1784044143.694411:0:10713:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784044143.694455:0:10713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397a8a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1870705580953984:12345-0@lo:13:osp-pre-0-1.0 Request processed in 101us (492us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044143.694462:0:10713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00080000:2.0:1784044143.694483:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784044143.694790:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784044143.694801:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397a8a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1870705580954112:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1784044143.694832:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044143.694861:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580954112 00000100:00100000:0.0:1784044143.694865:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580954112 00000100:00100000:0.0:1784044143.694893:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1784044143.694899:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397a8a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1870705580954112:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1784044143.694923:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1784044143.694970:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397a8a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1870705580954112:12345-0@lo:41:osp-pre-1-0.0 Request processed in 70us (137us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044143.694978:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1784044143.695019:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397a8a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1870705580954112:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1784044143.695049:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397a8a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1870705580953984:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1784044143.695568:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784044143.695578:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843e0d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1870705580954240:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784044143.695648:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044143.696022:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580954240 00000100:00100000:1.0:1784044143.696028:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580954240 00000100:00100000:1.0:1784044143.696073:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1784044143.696081:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843e38700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3640:x1870705580954240:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1784044143.696096:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784044143.696131:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843e38700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3640:x1870705580954240:12345-0@lo:13:osp-pre-0-0.0 Request processed in 50us (481us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044143.696138:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00080000:1.0:1784044143.696156:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784044143.696535:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843e0d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1870705580954240:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1784044144.269925:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1784044144.269971:0:6508:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1784044144.269975:0:6508:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9b384244a000 from 7 10000000:01000000:1.0:1784044144.269981:0:6508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1784044144.270024:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b38426fc800/0x89871fc3aba18209 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044144.270046:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9b38426fc800/0x89871fc3aba18209 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044144.270058:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9b38426fc800/0x89871fc3aba18209 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044144.270082:0:6508:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843e0ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580954368:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784044144.270150:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044144.270227:0:6508:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3843695d80 going to sleep for 11 seconds 00000100:00100000:2.0:1784044144.270305:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580954368 00000100:00100000:2.0:1784044144.270312:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580954368 00000100:00100000:2.0:1784044144.270413:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 348 00000100:00100000:2.0:1784044144.270423:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3950374450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+20:6508:x1870705580954368:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784044144.270435:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784044144.270448:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b3843799e00/0x89871fc3aba18210 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x89871fc3aba18209 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044144.270471:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b3843799e00/0x89871fc3aba18210 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x89871fc3aba18209 expref: 21 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044144.270480:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b3843799e00/0x89871fc3aba18210 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x89871fc3aba18209 expref: 21 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044144.270488:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3843799e00, rc 0) 00000100:00100000:2.0:1784044144.270531:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3950374450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+21:6508:x1870705580954368:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 110us (380us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044144.270537:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 348 00000100:00100000:3.0:1784044144.270620:0:6508:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843e0ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580954368:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784044144.270635:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9b38426fc800/0x89871fc3aba18209 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba18210 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044144.270646:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9b38426fc800/0x89871fc3aba18209 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x89871fc3aba18210 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044144.270712:0:6508:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b38420a9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580954496:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784044144.270749:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044144.273213:0:6508:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3843617300 going to sleep for 11 seconds 00000100:00100000:1.0:1784044144.273254:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580954496 00000100:00100000:1.0:1784044144.273262:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580954496 00000100:00100000:1.0:1784044144.273308:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 349 00000100:00100000:1.0:1784044144.273317:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3950376850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+21:6508:x1870705580954496:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784044144.273478:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3950376850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+21:6508:x1870705580954496:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 162us (2728us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044144.273486:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 349 00000100:00100000:3.0:1784044144.275570:0:6508:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b38420a9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580954496:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784044144.275631:0:6508:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b38420a9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580954624:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784044144.275699:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044144.275740:0:6508:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3843617300 going to sleep for 11 seconds 00000100:00100000:1.0:1784044144.275799:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580954624 00000100:00100000:1.0:1784044144.275807:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580954624 00000100:00100000:1.0:1784044144.275886:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 350 00000100:00100000:1.0:1784044144.275895:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3950374850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+21:6508:x1870705580954624:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784044144.276010:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3950374850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+21:6508:x1870705580954624:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 116us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044144.276015:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 350 00000100:00100000:3.0:1784044144.276077:0:6508:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b38420a9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580954624:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784044144.276757:0:13757:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b38420a9180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:13757:1870705580954752:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784044144.276794:0:13757:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044144.276818:0:13757:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b38436173c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784044144.276898:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580954752 00000100:00100000:0.0:1784044144.276902:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580954752 00000100:00100000:0.0:1784044144.276945:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 351 00000100:00100000:0.0:1784044144.276961:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3950377850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+21:13757:x1870705580954752:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784044144.277063:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3950377850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+21:13757:x1870705580954752:12345-0@lo:502:llog_process_th.0 Request processed in 103us (267us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044144.277070:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 351 00000100:00100000:3.0:1784044144.277209:0:13757:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b38420a9180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:13757:1870705580954752:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1784044144.277233:0:13757:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784044144.277242:0:13757:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784044144.277244:0:13757:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1784044144.277251:0:13757:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9b384244a000 00000020:00000080:3.0:1784044144.277253:0:13757:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1784044144.277318:0:13757:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b38420a9180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:13757:1870705580954880:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784044144.277349:0:13757:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044144.277362:0:13757:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b38436173c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784044144.279414:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580954880 00000100:00100000:2.0:1784044144.279424:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580954880 00000100:00100000:2.0:1784044144.279476:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 352 00000100:00100000:2.0:1784044144.279484:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3950375050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+21:13757:x1870705580954880:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784044144.279624:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3950375050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+21:13757:x1870705580954880:12345-0@lo:502:llog_process_th.0 Request processed in 139us (2272us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044144.279631:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 352 00000100:00100000:3.0:1784044144.279821:0:13757:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b38420a9180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:13757:1870705580954880:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1784044144.279855:0:13757:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784044144.279863:0:13757:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784044144.279865:0:13757:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1784044144.279870:0:13757:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1784044144.280823:0:6508:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:2.0:1784044144.280857:0:6508:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1784044144.280867:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b38426fc800/0x89871fc3aba18209 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba18210 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044144.280879:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9b38426fc800/0x89871fc3aba18209 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba18210 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784044144.280889:0:6508:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1784044144.280892:0:6508:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9b3975aa3000 from 7 10000000:01000000:2.0:1784044144.280894:0:6508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1784044144.280925:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b3843798000/0x89871fc3aba18217 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044144.280945:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9b3843798000/0x89871fc3aba18217 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044144.280955:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9b3843798000/0x89871fc3aba18217 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044144.280977:0:6508:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b38436a3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580955008:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1784044144.281019:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044144.281061:0:6508:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3843df79c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784044144.281079:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580955008 00000100:00100000:2.0:1784044144.281084:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580955008 00000100:00100000:2.0:1784044144.281111:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 353 00000100:00100000:2.0:1784044144.281118:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3950377050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+21:6508:x1870705580955008:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784044144.281127:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784044144.281139:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b3843798400/0x89871fc3aba1821e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x89871fc3aba18217 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044144.281158:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b3843798400/0x89871fc3aba1821e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x89871fc3aba18217 expref: 22 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044144.281168:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b3843798400/0x89871fc3aba1821e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x89871fc3aba18217 expref: 22 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044144.281196:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3843798400, rc 0) 00000100:00100000:2.0:1784044144.281224:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3950377050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+22:6508:x1870705580955008:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 107us (205us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044144.281229:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 353 00000100:00100000:2.0:1784044144.281262:0:6508:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b38436a3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580955008:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784044144.281275:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9b3843798000/0x89871fc3aba18217 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba1821e expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044144.281283:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9b3843798000/0x89871fc3aba18217 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x89871fc3aba1821e expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044144.281328:0:6508:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b38436a3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580955136:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784044144.281352:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044144.281372:0:6508:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b38436ea6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784044144.281384:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580955136 00000100:00100000:2.0:1784044144.281387:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580955136 00000100:00100000:2.0:1784044144.281477:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 354 00000100:00100000:2.0:1784044144.281483:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3950376050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+22:6508:x1870705580955136:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784044144.281574:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3950376050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+22:6508:x1870705580955136:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 90us (220us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044144.281580:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 354 00000100:00100000:2.0:1784044144.281608:0:6508:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b38436a3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580955136:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784044144.281631:0:6508:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b38436a3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580955264:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784044144.281667:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044144.281680:0:6508:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b38436ea6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784044144.281691:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580955264 00000100:00100000:2.0:1784044144.281693:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580955264 00000100:00100000:2.0:1784044144.281709:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 355 00000100:00100000:2.0:1784044144.281714:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3950370c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+22:6508:x1870705580955264:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784044144.282628:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3950370c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+22:6508:x1870705580955264:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 910us (957us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044144.282637:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 355 00000100:00100000:0.0:1784044144.282786:0:6508:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b38436a3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580955264:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784044144.283103:0:13759:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b38436a3100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:13759:1870705580955392:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784044144.283140:0:13759:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044144.283171:0:13759:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b38436ea000 going to sleep for 11 seconds 00000100:00100000:1.0:1784044144.283365:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580955392 00000100:00100000:1.0:1784044144.283372:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580955392 00000100:00100000:1.0:1784044144.283417:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 356 00000100:00100000:1.0:1784044144.283434:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3950371850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+22:13759:x1870705580955392:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784044144.283552:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3950371850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+22:13759:x1870705580955392:12345-0@lo:502:llog_process_th.0 Request processed in 119us (410us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044144.283560:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 356 00000100:00100000:2.0:1784044144.283833:0:13759:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b38436a3100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:13759:1870705580955392:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1784044144.283859:0:13759:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784044144.283869:0:13759:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784044144.283876:0:13759:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1784044144.283882:0:13759:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9b3975aa3000 00000020:00000080:2.0:1784044144.283885:0:13759:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1784044144.283973:0:13759:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b38436a3100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:13759:1870705580955520:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784044144.284008:0:13759:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044144.284034:0:13759:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b38436ea000 going to sleep for 11 seconds 00000100:00100000:1.0:1784044144.284047:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580955520 00000100:00100000:1.0:1784044144.284053:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580955520 00000100:00100000:1.0:1784044144.284084:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 357 00000100:00100000:1.0:1784044144.284093:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3950372850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+22:13759:x1870705580955520:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784044144.284164:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3950372850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+22:13759:x1870705580955520:12345-0@lo:502:llog_process_th.0 Request processed in 72us (154us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044144.284336:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 357 00000100:00100000:2.0:1784044144.284830:0:13759:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b38436a3100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:13759:1870705580955520:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1784044144.284856:0:13759:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784044144.284861:0:13759:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784044144.284863:0:13759:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1784044144.284868:0:13759:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:1.0:1784044144.284959:0:6508:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:1.0:1784044144.284986:0:6508:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1784044144.284997:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b3843798000/0x89871fc3aba18217 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba1821e expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044144.285009:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9b3843798000/0x89871fc3aba18217 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba1821e expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784044144.285020:0:6508:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1784044144.285023:0:6508:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9b396f3cf800 from 7 10000000:01000000:1.0:1784044144.285026:0:6508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1784044144.285052:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b38426fca00/0x89871fc3aba18225 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044144.285060:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9b38426fca00/0x89871fc3aba18225 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044144.285069:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9b38426fca00/0x89871fc3aba18225 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044144.285091:0:6508:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843e0d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580955648:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784044144.285130:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044144.285162:0:6508:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3941254780 going to sleep for 11 seconds 00000100:00100000:2.0:1784044144.285219:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580955648 00000100:00100000:2.0:1784044144.285225:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580955648 00000100:00100000:2.0:1784044144.285256:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 358 00000100:00100000:2.0:1784044144.285264:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3950370450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+22:6508:x1870705580955648:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784044144.285274:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784044144.285288:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b3843798200/0x89871fc3aba1822c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x89871fc3aba18225 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044144.285311:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b3843798200/0x89871fc3aba1822c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x89871fc3aba18225 expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044144.285323:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b3843798200/0x89871fc3aba1822c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x89871fc3aba18225 expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044144.285332:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3843798200, rc 0) 00000100:00100000:2.0:1784044144.285369:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3950370450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+23:6508:x1870705580955648:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 105us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044144.285376:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 358 00000100:00100000:1.0:1784044144.285390:0:6508:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843e0d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580955648:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784044144.285405:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9b38426fca00/0x89871fc3aba18225 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba1822c expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044144.285413:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9b38426fca00/0x89871fc3aba18225 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x89871fc3aba1822c expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044144.285461:0:6508:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843e0d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580955776:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784044144.285485:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044144.285515:0:6508:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3941254780 going to sleep for 11 seconds 00000100:00100000:2.0:1784044144.285815:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580955776 00000100:00100000:2.0:1784044144.285819:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580955776 00000100:00100000:2.0:1784044144.285838:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 359 00000100:00100000:2.0:1784044144.285844:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3950370850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+23:6508:x1870705580955776:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784044144.285956:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3950370850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+23:6508:x1870705580955776:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 112us (470us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044144.285963:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 359 00000100:00100000:1.0:1784044144.285987:0:6508:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843e0d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580955776:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784044144.286018:0:6508:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843e0d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580955904:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784044144.286055:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044144.286075:0:6508:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3941254780 going to sleep for 11 seconds 00000100:00100000:2.0:1784044144.286292:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580955904 00000100:00100000:2.0:1784044144.286296:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580955904 00000100:00100000:2.0:1784044144.286328:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 360 00000100:00100000:2.0:1784044144.286335:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3950373850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+23:6508:x1870705580955904:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784044144.286426:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3950373850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+23:6508:x1870705580955904:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 91us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044144.286434:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 360 00000100:00100000:1.0:1784044144.286452:0:6508:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843e0d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580955904:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784044144.287594:0:13760:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b38420a9180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:13760:1870705580956032:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784044144.287649:0:13760:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044144.287676:0:13760:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3843617600 going to sleep for 11 seconds 00000100:00100000:2.0:1784044144.287801:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580956032 00000100:00100000:2.0:1784044144.287807:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580956032 00000100:00100000:2.0:1784044144.287850:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 361 00000100:00100000:2.0:1784044144.287859:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3950371050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+23:13760:x1870705580956032:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784044144.287959:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3950371050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+23:13760:x1870705580956032:12345-0@lo:502:llog_process_th.0 Request processed in 101us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044144.287966:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 361 00000100:00100000:3.0:1784044144.288105:0:13760:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b38420a9180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:13760:1870705580956032:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1784044144.288130:0:13760:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784044144.288140:0:13760:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784044144.288142:0:13760:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1784044144.288150:0:13760:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9b396f3cf800 00000020:00000080:3.0:1784044144.288153:0:13760:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1784044144.288252:0:13760:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b38420a9180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:13760:1870705580956160:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784044144.288286:0:13760:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044144.288298:0:13760:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3843617600 going to sleep for 11 seconds 00000100:00100000:2.0:1784044144.288597:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580956160 00000100:00100000:2.0:1784044144.288601:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580956160 00000100:00100000:2.0:1784044144.288670:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 362 00000100:00100000:2.0:1784044144.288677:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3950373050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+23:13760:x1870705580956160:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784044144.288759:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3950373050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+23:13760:x1870705580956160:12345-0@lo:502:llog_process_th.0 Request processed in 82us (471us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044144.288771:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 362 00000100:00100000:3.0:1784044144.288993:0:13760:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b38420a9180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:13760:1870705580956160:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1784044144.289015:0:13760:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784044144.289020:0:13760:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784044144.289021:0:13760:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1784044144.289025:0:13760:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1784044144.289228:0:6508:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:0.0:1784044144.289250:0:6508:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1784044144.289259:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b38426fca00/0x89871fc3aba18225 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba1822c expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044144.289270:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9b38426fca00/0x89871fc3aba18225 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba1822c expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784044144.289280:0:6508:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1784044144.289283:0:6508:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9b397418c800 from 7 10000000:01000000:0.0:1784044144.289287:0:6508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1784044144.289312:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b38410b7200/0x89871fc3aba18233 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044144.289320:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9b38410b7200/0x89871fc3aba18233 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044144.289330:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9b38410b7200/0x89871fc3aba18233 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044144.289346:0:6508:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397a8a7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580956288:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1784044144.289381:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044144.289466:0:6508:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b384341b9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784044144.289589:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580956288 00000100:00100000:3.0:1784044144.289594:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580956288 00000100:00100000:3.0:1784044144.289621:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363 00000100:00100000:3.0:1784044144.289628:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3950372050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+23:6508:x1870705580956288:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784044144.289637:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784044144.289649:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b39759f8600/0x89871fc3aba1823a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x89871fc3aba18233 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044144.289671:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b39759f8600/0x89871fc3aba1823a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x89871fc3aba18233 expref: 24 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044144.289681:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b39759f8600/0x89871fc3aba1823a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x89871fc3aba18233 expref: 24 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044144.289696:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b39759f8600, rc 0) 00000100:00100000:3.0:1784044144.289786:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3950372050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+24:6508:x1870705580956288:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 97us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044144.289793:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363 00000100:00100000:0.0:1784044144.289890:0:6508:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397a8a7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580956288:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784044144.289903:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9b38410b7200/0x89871fc3aba18233 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba1823a expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044144.289911:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9b38410b7200/0x89871fc3aba18233 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x89871fc3aba1823a expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044144.289971:0:6508:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397a8a7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580956416:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784044144.290002:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044144.290016:0:6508:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b384341b9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784044144.290070:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580956416 00000100:00100000:2.0:1784044144.290074:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580956416 00000100:00100000:2.0:1784044144.290100:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 364 00000100:00100000:2.0:1784044144.290105:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3950373450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+24:6508:x1870705580956416:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784044144.290199:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3950373450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+24:6508:x1870705580956416:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 94us (197us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044144.290205:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 364 00000100:00100000:2.0:1784044144.290228:0:6508:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397a8a7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580956416:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784044144.290249:0:6508:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b38436a3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580956544:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784044144.290277:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044144.290287:0:6508:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b38436ea6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784044144.290299:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580956544 00000100:00100000:2.0:1784044144.290303:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580956544 00000100:00100000:2.0:1784044144.290322:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 365 00000100:00100000:2.0:1784044144.290328:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3950371450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+24:6508:x1870705580956544:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784044144.290500:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3950371450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+24:6508:x1870705580956544:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 171us (220us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044144.290507:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 365 00000100:00100000:2.0:1784044144.290541:0:6508:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b38436a3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580956544:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784044144.290911:0:13762:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b38436a3100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:13762:1870705580956672:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784044144.290958:0:13762:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044144.291015:0:13762:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b38436ea0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784044144.291102:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580956672 00000100:00100000:0.0:1784044144.291106:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580956672 00000100:00100000:0.0:1784044144.291137:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 366 00000100:00100000:0.0:1784044144.291145:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3950370050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+24:13762:x1870705580956672:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784044144.291236:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3950370050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+24:13762:x1870705580956672:12345-0@lo:502:llog_process_th.0 Request processed in 92us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044144.291243:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 366 00000100:00100000:2.0:1784044144.291336:0:13762:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b38436a3100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:13762:1870705580956672:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1784044144.291366:0:13762:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784044144.291374:0:13762:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784044144.291377:0:13762:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1784044144.291383:0:13762:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9b397418c800 00000020:00000080:2.0:1784044144.291386:0:13762:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1784044144.291460:0:13762:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b38436a3100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:13762:1870705580956800:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784044144.291499:0:13762:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044144.291516:0:13762:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3843df79c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784044144.291834:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580956800 00000100:00100000:0.0:1784044144.291839:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580956800 00000100:00100000:0.0:1784044144.291873:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 367 00000100:00100000:0.0:1784044144.291880:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3950372450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+24:13762:x1870705580956800:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784044144.291958:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3950372450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+24:13762:x1870705580956800:12345-0@lo:502:llog_process_th.0 Request processed in 79us (459us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044144.291964:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 367 00000100:00100000:2.0:1784044144.292095:0:13762:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b38436a3100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:13762:1870705580956800:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1784044144.292114:0:13762:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784044144.292120:0:13762:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784044144.292121:0:13762:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1784044144.292125:0:13762:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1784044144.292282:0:6508:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:0.0:1784044144.292307:0:6508:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1784044144.292315:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b38410b7200/0x89871fc3aba18233 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba1823a expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044144.292333:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9b38410b7200/0x89871fc3aba18233 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba1823a expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1784044144.299321:0:13763:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:00000080:2.0:1784044144.461143:0:13785:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff62ce1040 20000000:00000080:2.0:1784044144.461160:0:13785:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9b38430b4800 uarg=0000000000000000 20000000:01000000:2.0:1784044144.461230:0:13785:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:2.0:1784044144.461236:0:13785:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:2.0:1784044144.461241:0:13785:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0001.hsm_control=enabled del=0 00000040:00080000:2.0:1784044144.463709:0:13786:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 20000000:02000000:3.0:1784044144.464020:0:13785:0:(mgs_llog.c:4116:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0001.hsm_control=enabled in log params 00000040:00080000:3.0:1784044144.464109:0:13785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10112 00000040:00080000:3.0:1784044144.464131:0:13785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 128 off10240 00000040:00080000:3.0:1784044144.464139:0:13785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 224 off10464 10000000:01000000:3.0:1784044144.464147:0:13785:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1784044144.464162:0:13785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b39759f9400/0x89871fc3aba18241 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044144.464279:0:13785:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b3843799e00/0x89871fc3aba18210 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x89871fc3aba18209 expref: 23 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044144.464288:0:13785:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b3843798400/0x89871fc3aba1821e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x89871fc3aba18217 expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044144.464295:0:13785:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b3843798200/0x89871fc3aba1822c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x89871fc3aba18225 expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044144.464302:0:13785:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b39759f8600/0x89871fc3aba1823a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x89871fc3aba18233 expref: 23 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044144.464308:0:13785:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b39759f9400/0x89871fc3aba18241 lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044144.464353:0:13785:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b39759f8600/0x89871fc3aba1823a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x89871fc3aba18233 expref: 23 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044144.464378:0:13785:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b39759f8600/0x89871fc3aba1823a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x89871fc3aba18233 expref: 23 pid: 6504 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044144.464460:0:13785:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b38420a9180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13785:1870705580956928:0@lo:104: 00000100:00100000:3.0:1784044144.464516:0:13785:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044144.464566:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580956928 00010000:00010000:3.0:1784044144.464568:0:13785:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b3843798200/0x89871fc3aba1822c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x89871fc3aba18225 expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044144.464573:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580956928 00000100:00100000:1.0:1784044144.464676:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1784044144.464688:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38420a8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+3:13785:x1870705580956928:12345-0@lo:104: 00010000:00010000:1.0:1784044144.464702:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.140@tcp lock: ffff9b38410b7200/0x89871fc3aba18233 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x89871fc3aba1823a expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044144.464771:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1784044144.464777:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38420a8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+3:13785:x1870705580956928:12345-0@lo:104: Request processed in 92us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044144.464785:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00010000:0.0:1784044144.464890:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784044144.464898:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: ffff9b38410b7200/0x89871fc3aba18233 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x89871fc3aba1823a expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044144.464905:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38410b7200 already unused, calling callback (ffffffffc113cc20) 10000000:00010000:0.0:1784044144.464910:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: ffff9b38410b7200/0x89871fc3aba18233 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x89871fc3aba1823a expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044144.464918:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9b38410b7200/0x89871fc3aba18233 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x89871fc3aba1823a expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784044144.464925:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9b38410b7200/0x89871fc3aba18233 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x89871fc3aba1823a expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784044144.464941:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1784044144.464974:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.140@tcp lock: ffff9b38410b7200/0x89871fc3aba18233 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x89871fc3aba1823a expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044144.464982:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784044144.465001:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: ffff9b38410b7200/0x89871fc3aba18233 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x89871fc3aba1823a expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044144.465009:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9b38410b7200/0x89871fc3aba18233 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x89871fc3aba1823a expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044144.465022:0:13785:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b3843798200/0x89871fc3aba1822c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x89871fc3aba18225 expref: 23 pid: 6505 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044144.465022:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784044144.465029:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784044144.465031:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784044144.465032:0:13785:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397f9dd500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13785:1870705580957056:0@lo:104: 00000100:00100000:0.0:1784044144.465050:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397a8a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:3638:1870705580957184:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784044144.465056:0:13785:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044144.465083:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044144.465120:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580957184 00000100:00100000:0.0:1784044144.465125:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580957184 00010000:00010000:0.0:1784044144.465144:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b39759f8600/0x89871fc3aba1823a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x89871fc3aba18233 expref: 24 pid: 6504 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044144.465167:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1784044144.465191:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3944091450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+24:3638:x1870705580957184:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784044144.465201:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784044144.465206:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b39759f8600/0x89871fc3aba1823a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x89871fc3aba18233 expref: 24 pid: 6504 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044144.465217:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b39759f8600/0x89871fc3aba1823a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x89871fc3aba18233 expref: 24 pid: 6504 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044144.465233:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784044144.465265:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3944091450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+24:3638:x1870705580957184:12345-0@lo:103:ldlm_bl.0 Request processed in 88us (176us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044144.465272:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1784044144.465357:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397a8a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:3638:1870705580957184:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784044144.465849:0:13785:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b3843798400/0x89871fc3aba1821e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x89871fc3aba18217 expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044144.465858:0:13785:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b3843798400/0x89871fc3aba1821e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x89871fc3aba18217 expref: 23 pid: 6506 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044144.465866:0:13785:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b384316c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13785:1870705580957312:0@lo:104: 00000100:00100000:3.0:1784044144.465891:0:13785:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044144.467211:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580957056 00000100:00100000:2.0:1784044144.467223:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580957056 00000100:00100000:2.0:1784044144.467275:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1784044144.467284:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397f9dc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+3:13785:x1870705580957056:12345-0@lo:104: 00010000:00010000:2.0:1784044144.467298:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.140@tcp lock: ffff9b38426fca00/0x89871fc3aba18225 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x89871fc3aba1822c expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044144.467373:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1784044144.467379:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397f9dc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+3:13785:x1870705580957056:12345-0@lo:104: Request processed in 96us (2321us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044144.467543:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00010000:0.0:1784044144.467687:0:10331:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784044144.467695:0:10331:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: ffff9b38426fca00/0x89871fc3aba18225 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x89871fc3aba1822c expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044144.467704:0:10331:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38426fca00 already unused, calling callback (ffffffffc113cc20) 10000000:00010000:0.0:1784044144.467709:0:10331:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: ffff9b38426fca00/0x89871fc3aba18225 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x89871fc3aba1822c expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044144.467732:0:10331:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9b38426fca00/0x89871fc3aba18225 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x89871fc3aba1822c expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784044144.467739:0:10331:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9b38426fca00/0x89871fc3aba18225 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x89871fc3aba1822c expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784044144.467745:0:10331:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1784044144.467784:0:10331:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.140@tcp lock: ffff9b38426fca00/0x89871fc3aba18225 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x89871fc3aba1822c expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044144.467790:0:10331:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784044144.467808:0:10331:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: ffff9b38426fca00/0x89871fc3aba18225 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x89871fc3aba1822c expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044144.467816:0:10331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9b38426fca00/0x89871fc3aba18225 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x89871fc3aba1822c expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044144.467829:0:10331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784044144.467831:0:10331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784044144.467832:0:10331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784044144.467846:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397a8a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:3639:1870705580957440:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784044144.467883:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044144.467924:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580957440 00000100:00100000:0.0:1784044144.467928:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580957440 00010000:00010000:0.0:1784044144.467955:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b3843798200/0x89871fc3aba1822c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x89871fc3aba18225 expref: 24 pid: 6505 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044144.467977:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1784044144.467982:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397a8a7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+24:3639:x1870705580957440:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784044144.467998:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784044144.468004:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b3843798200/0x89871fc3aba1822c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x89871fc3aba18225 expref: 24 pid: 6505 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044144.468014:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b3843798200/0x89871fc3aba1822c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x89871fc3aba18225 expref: 24 pid: 6505 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044144.468030:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784044144.468057:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397a8a7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+24:3639:x1870705580957440:12345-0@lo:103:ldlm_bl.0 Request processed in 75us (173us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044144.468063:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1784044144.468104:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397a8a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:3639:1870705580957440:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784044144.468862:0:13785:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b3843799e00/0x89871fc3aba18210 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x89871fc3aba18209 expref: 23 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044144.468873:0:13785:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b3843799e00/0x89871fc3aba18210 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x89871fc3aba18209 expref: 23 pid: 6504 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044144.468883:0:13785:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b384316ea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13785:1870705580957568:0@lo:104: 00000100:00100000:3.0:1784044144.468919:0:13785:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3843617240 going to sleep for 11 seconds 00010000:00010000:3.0:1784044144.468946:0:13785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b39759f8600/0x89871fc3aba1823a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x89871fc3aba18233 expref: 23 pid: 6504 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044144.468956:0:13785:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b38420a9180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13785:1870705580956928:0@lo:104: 00010000:00010000:3.0:1784044144.468968:0:13785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b3843798200/0x89871fc3aba1822c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x89871fc3aba18225 expref: 22 pid: 6505 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044144.468975:0:13785:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397f9dd500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13785:1870705580957056:0@lo:104: 00000100:00100000:2.0:1784044144.469023:0:6494:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1784044144.469042:0:6494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044144.469052:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580957312 00000100:00100000:2.0:1784044144.469056:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580957312 00000100:00100000:2.0:1784044144.469077:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580957568 00000100:00100000:2.0:1784044144.469079:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580957568 00000100:00100000:2.0:1784044144.469164:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1784044144.469169:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38430b6050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+4:13785:x1870705580957312:12345-0@lo:104: 00010000:00010000:2.0:1784044144.469256:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.140@tcp lock: ffff9b3843798000/0x89871fc3aba18217 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x89871fc3aba1821e expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044144.469343:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1784044144.469349:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38430b6050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+4:13785:x1870705580957312:12345-0@lo:104: Request processed in 179us (3456us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044144.469356:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00010000:1.0:1784044144.469359:0:10330:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784044144.469366:0:10330:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: ffff9b3843798000/0x89871fc3aba18217 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x89871fc3aba1821e expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044144.469373:0:10330:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3843798000 already unused, calling callback (ffffffffc113cc20) 10000000:00010000:1.0:1784044144.469376:0:10330:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: ffff9b3843798000/0x89871fc3aba18217 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x89871fc3aba1821e expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044144.469384:0:10330:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9b3843798000/0x89871fc3aba18217 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x89871fc3aba1821e expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784044144.469391:0:10330:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9b3843798000/0x89871fc3aba18217 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x89871fc3aba1821e expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784044144.469397:0:10330:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:2.0:1784044144.469399:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1784044144.469406:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38436a3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+3:13785:x1870705580957568:12345-0@lo:104: 00010000:00010000:2.0:1784044144.469413:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.140@tcp lock: ffff9b38426fc800/0x89871fc3aba18209 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x89871fc3aba18210 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044144.469420:0:10330:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.140@tcp lock: ffff9b3843798000/0x89871fc3aba18217 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x89871fc3aba1821e expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044144.469425:0:10330:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784044144.469443:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1784044144.469448:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38436a3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+3:13785:x1870705580957568:12345-0@lo:104: Request processed in 43us (406us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044144.469458:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00010000:2.0:1784044144.469474:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784044144.469479:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: ffff9b38426fc800/0x89871fc3aba18209 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x89871fc3aba18210 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044144.469497:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38426fc800 already unused, calling callback (ffffffffc113cc20) 10000000:00010000:2.0:1784044144.469500:0:6499:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: ffff9b38426fc800/0x89871fc3aba18209 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x89871fc3aba18210 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044144.469507:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9b38426fc800/0x89871fc3aba18209 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x89871fc3aba18210 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784044144.469513:0:6499:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9b38426fc800/0x89871fc3aba18209 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x89871fc3aba18210 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784044144.469518:0:6499:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1784044144.469533:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.140@tcp lock: ffff9b38426fc800/0x89871fc3aba18209 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x89871fc3aba18210 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044144.469539:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1784044144.469869:0:13785:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b384316c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13785:1870705580957312:0@lo:104: 00000100:00100000:3.0:1784044144.469878:0:13785:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b384316ea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13785:1870705580957568:0@lo:104: 00010000:00010000:3.0:1784044144.469899:0:13785:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b39759f9400/0x89871fc3aba18241 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044144.472031:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: ffff9b38426fc800/0x89871fc3aba18209 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x89871fc3aba18210 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044144.472048:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9b38426fc800/0x89871fc3aba18209 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x89871fc3aba18210 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044144.472067:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784044144.472069:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784044144.472071:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784044144.472197:0:10330:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: ffff9b3843798000/0x89871fc3aba18217 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x89871fc3aba1821e expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044144.472206:0:10330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9b3843798000/0x89871fc3aba18217 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x89871fc3aba1821e expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044144.472243:0:10330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784044144.472246:0:10330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784044144.472248:0:10330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784044144.472267:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843e0d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:3640:1870705580957696:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784044144.472286:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b38436a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:3641:1870705580957824:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784044144.472379:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044144.472567:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044144.472999:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580957824 00000100:00100000:3.0:1784044144.473007:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580957824 00010000:00010000:3.0:1784044144.473041:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b3843799e00/0x89871fc3aba18210 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x89871fc3aba18209 expref: 22 pid: 6504 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044144.473072:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580957696 00000100:00100000:3.0:1784044144.473075:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580957696 00010000:00010000:3.0:1784044144.473086:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b3843798400/0x89871fc3aba1821e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x89871fc3aba18217 expref: 23 pid: 6506 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044144.473151:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1784044144.473161:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397a8a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+23:3641:x1870705580957824:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784044144.473218:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1784044144.473260:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1784044144.473270:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38436a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+23:3640:x1870705580957696:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784044144.473278:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784044144.473285:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b3843798400/0x89871fc3aba1821e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x89871fc3aba18217 expref: 23 pid: 6506 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044144.473298:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b3843798400/0x89871fc3aba1821e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x89871fc3aba18217 expref: 23 pid: 6506 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044144.473315:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b3843798400/0x89871fc3aba1821e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x89871fc3aba18217 expref: 23 pid: 6506 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044144.473328:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784044144.473371:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38436a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+22:3640:x1870705580957696:12345-0@lo:103:ldlm_bl.0 Request processed in 103us (803us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044144.473379:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00010000:3.0:1784044144.473424:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b3843799e00/0x89871fc3aba18210 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x89871fc3aba18209 expref: 21 pid: 6504 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044144.473449:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b3843799e00/0x89871fc3aba18210 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x89871fc3aba18209 expref: 21 pid: 6504 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044144.473459:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b3843799e00/0x89871fc3aba18210 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x89871fc3aba18209 expref: 21 pid: 6504 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044144.473470:0:6496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b39759f9400/0x89871fc3aba18241 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044144.473479:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b39759f9400/0x89871fc3aba18241 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044144.473493:0:6496:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b39759f9400/0x89871fc3aba18241 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044144.473500:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b39759f9400/0x89871fc3aba18241 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044144.473507:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b39759f9400/0x89871fc3aba18241 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044144.473516:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b39759f9400/0x89871fc3aba18241 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044144.473522:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b39759f9400 already unused, calling callback (ffffffffc0b56230) 00010000:00010000:3.0:1784044144.473526:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b39759f9400/0x89871fc3aba18241 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044144.473534:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b39759f9400/0x89871fc3aba18241 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044144.473563:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b39759f9400/0x89871fc3aba18241 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044144.473573:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784044144.473618:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397a8a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+20:3641:x1870705580957824:12345-0@lo:103:ldlm_bl.0 Request processed in 446us (1227us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044144.473625:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00010000:00010000:1.0:1784044144.473759:0:13785:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b39759f9400/0x89871fc3aba18241 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044144.473768:0:13785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b39759f9400/0x89871fc3aba18241 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044144.473774:0:13785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b39759f9400/0x89871fc3aba18241 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044144.474193:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843e0d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:3640:1870705580957696:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784044144.474382:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b38436a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:3641:1870705580957824:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784044144.613598:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044144.613855:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565135360 00000100:00100000:0.0:1784044144.613867:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565135360 00000100:00100000:0.0:1784044144.613926:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 368 00000100:00100000:0.0:1784044144.613947:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3950373c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4a09ad9-a185-4679-99bb-b6a07b865440+11:6180:x1870705565135360:12345-192.168.202.40@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784044144.613966:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784044144.613989:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b38410b7200/0x89871fc3aba18248 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd3dffad52ca6638 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044144.614016:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b38410b7200/0x89871fc3aba18248 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6638 expref: 12 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044144.614027:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b38410b7200/0x89871fc3aba18248 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6638 expref: 12 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044144.614052:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b38410b7200, rc 0) 00000100:00100000:0.0:1784044144.614115:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3950373c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4a09ad9-a185-4679-99bb-b6a07b865440+12:6180:x1870705565135360:12345-192.168.202.40@tcp:101:ll_cfg_requeue.0 Request processed in 170us (536us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044144.614122:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 368 00000100:00100000:3.0:1784044144.619802:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044144.620961:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565135488 00000100:00100000:0.0:1784044144.620976:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565135488 00000100:00100000:0.0:1784044144.621041:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 369 00000100:00100000:0.0:1784044144.621052:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3950371c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4a09ad9-a185-4679-99bb-b6a07b865440+12:6180:x1870705565135488:12345-192.168.202.40@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784044144.621241:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3950371c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4a09ad9-a185-4679-99bb-b6a07b865440+12:6180:x1870705565135488:12345-192.168.202.40@tcp:501:ll_cfg_requeue.0 Request processed in 189us (1450us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044144.621249:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 369 00000100:00100000:3.0:1784044144.632584:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044144.632672:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565135616 00000100:00100000:2.0:1784044144.632695:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565135616 00000100:00100000:2.0:1784044144.632752:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 370 00000100:00100000:2.0:1784044144.632761:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3950372c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4a09ad9-a185-4679-99bb-b6a07b865440+12:6180:x1870705565135616:12345-192.168.202.40@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784044144.632912:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3950372c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4a09ad9-a185-4679-99bb-b6a07b865440+12:6180:x1870705565135616:12345-192.168.202.40@tcp:503:ll_cfg_requeue.0 Request processed in 151us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044144.632920:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 370 00000100:00100000:2.0:1784044144.637944:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044144.642449:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565135744 00000100:00100000:0.0:1784044144.642467:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565135744 00000100:00100000:0.0:1784044144.642606:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 371 00000100:00100000:0.0:1784044144.642619:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3970ede850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4a09ad9-a185-4679-99bb-b6a07b865440+12:10800:x1870705565135744:12345-192.168.202.40@tcp:502:llog_process_th.0 00000100:00100000:0.0:1784044144.642806:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3970ede850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4a09ad9-a185-4679-99bb-b6a07b865440+12:10800:x1870705565135744:12345-192.168.202.40@tcp:502:llog_process_th.0 Request processed in 189us (4880us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044144.642816:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 371 00000100:00100000:3.0:1784044144.649608:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044144.654094:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565135872 00000100:00100000:0.0:1784044144.654114:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565135872 00000100:00100000:0.0:1784044144.654230:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 372 00000100:00100000:0.0:1784044144.654245:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3970edc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4a09ad9-a185-4679-99bb-b6a07b865440+12:10800:x1870705565135872:12345-192.168.202.40@tcp:502:llog_process_th.0 00000100:00100000:0.0:1784044144.654438:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3970edc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4a09ad9-a185-4679-99bb-b6a07b865440+12:10800:x1870705565135872:12345-192.168.202.40@tcp:502:llog_process_th.0 Request processed in 196us (4843us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044144.654457:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 372 00000100:00100000:2.0:1784044144.663657:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044144.663789:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565136000 00000100:00100000:0.0:1784044144.663802:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565136000 00000100:00100000:0.0:1784044144.663882:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 373 00000100:00100000:0.0:1784044144.663897:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3970edf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4a09ad9-a185-4679-99bb-b6a07b865440+12:6180:x1870705565136000:12345-192.168.202.40@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784044144.663918:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784044144.663956:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b38410b6e00/0x89871fc3aba1824f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd3dffad52ca663f expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044144.663989:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b38410b6e00/0x89871fc3aba1824f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca663f expref: 13 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044144.664001:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b38410b6e00/0x89871fc3aba1824f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca663f expref: 13 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044144.664010:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b38410b6e00, rc 0) 00000100:00100000:0.0:1784044144.664082:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3970edf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4a09ad9-a185-4679-99bb-b6a07b865440+13:6180:x1870705565136000:12345-192.168.202.40@tcp:101:ll_cfg_requeue.0 Request processed in 189us (440us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044144.664090:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 373 00000100:00100000:1.0:1784044144.671063:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044144.673020:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565136128 00000100:00100000:2.0:1784044144.673036:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565136128 00000100:00100000:2.0:1784044144.673132:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 374 00000100:00100000:2.0:1784044144.673145:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3970edd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4a09ad9-a185-4679-99bb-b6a07b865440+13:6180:x1870705565136128:12345-192.168.202.40@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784044144.673385:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3970edd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4a09ad9-a185-4679-99bb-b6a07b865440+13:6180:x1870705565136128:12345-192.168.202.40@tcp:501:ll_cfg_requeue.0 Request processed in 241us (2331us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044144.673394:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 374 00000100:00100000:3.0:1784044144.675868:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044144.682749:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565136256 00000100:00100000:0.0:1784044144.682768:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565136256 00000100:00100000:0.0:1784044144.682865:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 375 00000100:00100000:0.0:1784044144.682878:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3970edf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4a09ad9-a185-4679-99bb-b6a07b865440+13:6180:x1870705565136256:12345-192.168.202.40@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784044144.683073:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3970edf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4a09ad9-a185-4679-99bb-b6a07b865440+13:6180:x1870705565136256:12345-192.168.202.40@tcp:503:ll_cfg_requeue.0 Request processed in 197us (7216us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044144.683082:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 375 00000100:00100000:0.0:1784044144.688696:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044144.691799:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565136384 00000100:00100000:3.0:1784044144.691820:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565136384 00000100:00100000:3.0:1784044144.691982:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 376 00000100:00100000:3.0:1784044144.691997:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3970ede050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4a09ad9-a185-4679-99bb-b6a07b865440+13:10804:x1870705565136384:12345-192.168.202.40@tcp:502:llog_process_th.0 00000100:00100000:3.0:1784044144.692394:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3970ede050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4a09ad9-a185-4679-99bb-b6a07b865440+13:10804:x1870705565136384:12345-192.168.202.40@tcp:502:llog_process_th.0 Request processed in 400us (3709us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044144.692403:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 376 00000100:00100000:1.0:1784044144.697517:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044144.699778:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565136512 00000100:00100000:2.0:1784044144.699798:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565136512 00000100:00100000:2.0:1784044144.699881:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 377 00000100:00100000:2.0:1784044144.699891:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3970edf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4a09ad9-a185-4679-99bb-b6a07b865440+13:10804:x1870705565136512:12345-192.168.202.40@tcp:502:llog_process_th.0 00000100:00100000:2.0:1784044144.700130:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3970edf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4a09ad9-a185-4679-99bb-b6a07b865440+13:10804:x1870705565136512:12345-192.168.202.40@tcp:502:llog_process_th.0 Request processed in 239us (2623us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044144.700139:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 377 00000100:00100000:1.0:1784044144.717440:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1784044144.717512:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784044144.717539:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b38436a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1870705580958080:0@lo:400:kworker.0 00000100:00100000:3.0:1784044144.717608:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044144.717679:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580958080 00000100:00100000:3.0:1784044144.717687:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580958080 00000100:00100000:3.0:1784044144.717733:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1784044144.717741:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b384316ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1870705580958080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044144.717791:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b384316ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1870705580958080:12345-0@lo:400:kworker.0 Request processed in 50us (182us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044144.717812:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1784044144.717855:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b38436a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1870705580958080:0@lo:400:kworker.0 00000100:00100000:0.0:1784044144.718082:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784044144.718092:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397a8a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1870705580958208:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784044144.718125:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044144.718156:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580958208 00000100:00100000:0.0:1784044144.718159:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580958208 00000100:00100000:0.0:1784044144.718224:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1784044144.718232:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397a8a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1870705580958208:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1784044144.718256:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784044144.718291:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397a8a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1870705580958208:12345-0@lo:13:osp-pre-1-0.0 Request processed in 60us (166us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044144.718298:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00010000:00080000:0.0:1784044144.718326:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b397a8a7800 x1870705580958208/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784044160 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784044144.718341:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397a8a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1870705580958208:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784044144.718642:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b384316c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1870705580958336:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1784044144.718667:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044144.718735:0:10713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580958336 00000100:00100000:3.0:1784044144.718740:0:10713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580958336 00000100:00100000:3.0:1784044144.718772:0:10713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1784044144.718779:0:10713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397a8a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1870705580958336:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1784044144.718790:0:10713:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784044144.718821:0:10713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397a8a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1870705580958336:12345-0@lo:13:osp-pre-1-1.0 Request processed in 42us (152us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044144.718826:0:10713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00010000:00080000:0.0:1784044144.718894:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b384316c380 x1870705580958336/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784044160 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784044144.718907:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b384316c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1870705580958336:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1784044144.719117:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784044144.719257:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b38436a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3639:1870705580957952:0@lo:400:kworker.0 00000100:00100000:1.0:1784044144.719648:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044144.719853:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b38420a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1870705580958720:0@lo:400:kworker.0 00000100:00100000:2.0:1784044144.719896:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044144.719957:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b38420a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1870705580958848:0@lo:400:kworker.0 00000100:00100000:2.0:1784044144.720003:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044144.720036:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580958720 00000100:00100000:2.0:1784044144.720040:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580958720 00000100:00100000:2.0:1784044144.720081:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580958848 00000100:00100000:2.0:1784044144.720085:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580958848 00000100:00100000:2.0:1784044144.720102:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1784044144.720109:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38420aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1870705580958720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784044144.720147:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38420aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1870705580958720:12345-0@lo:400:kworker.0 Request processed in 38us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044144.720153:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1784044144.720166:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1784044144.720428:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b38436a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1870705580958464:0@lo:400:kworker.0 00000100:00100000:0.0:1784044144.720459:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044144.720514:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b38436a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1870705580958592:0@lo:400:kworker.0 00000100:00100000:1.0:1784044144.720553:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044144.720587:0:7768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580958592 00000100:00100000:1.0:1784044144.720591:0:7768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580958592 00000100:00100000:1.0:1784044144.720619:0:7768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1784044144.720625:0:7768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843e0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1870705580958592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044144.720662:0:7768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843e0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1870705580958592:12345-0@lo:400:kworker.0 Request processed in 37us (108us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044144.720668:0:7768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1784044144.720704:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b38436a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1870705580958592:0@lo:400:kworker.0 00000100:00100000:2.0:1784044144.720827:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397f9dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3641:x1870705580958848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784044144.720875:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397f9dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3641:x1870705580958848:12345-0@lo:400:kworker.0 Request processed in 703us (871us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044144.720881:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1784044144.720917:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b38420a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1870705580958720:0@lo:400:kworker.0 00000100:00100000:2.0:1784044144.720986:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397f9dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3640:1870705580959232:0@lo:400:kworker.0 00000100:00100000:2.0:1784044144.721015:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397f9dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3639:1870705580959104:0@lo:400:kworker.0 00000100:00100000:1.0:1784044144.721601:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b38420a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3641:1870705580959360:0@lo:400:kworker.0 00000100:00100000:0.0:1784044144.723952:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397f9dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1870705580958976:0@lo:400:kworker.0 00000100:00100000:0.0:1784044144.724014:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044144.724197:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580957952 00000100:00100000:3.0:1784044144.724207:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580957952 00000100:00100000:3.0:1784044144.724302:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580958464 00000100:00100000:3.0:1784044144.724306:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580958464 00000100:00100000:1.0:1784044144.724366:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:1.0:1784044144.724378:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843e0d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1870705580957952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044144.724440:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843e0d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1870705580957952:12345-0@lo:400:kworker.0 Request processed in 63us (4791us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044144.724448:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:1.0:1784044144.724468:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:1.0:1784044144.724474:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397a8a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1870705580958464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044144.724521:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397a8a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1870705580958464:12345-0@lo:400:kworker.0 Request processed in 48us (4061us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044144.724527:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:0.0:1784044144.724699:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b38436a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1870705580958464:0@lo:400:kworker.0 00000100:00100000:1.0:1784044144.724834:0:9501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580958976 00000100:00100000:1.0:1784044144.724839:0:9501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580958976 00000100:00100000:1.0:1784044144.724885:0:9501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:1.0:1784044144.724892:0:9501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397a8a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1870705580958976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044144.725112:0:9501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397a8a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1870705580958976:12345-0@lo:400:kworker.0 Request processed in 219us (1096us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044144.725119:0:9501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:1.0:1784044144.725160:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1784044144.725264:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784044144.725356:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b38420a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1870705580958848:0@lo:400:kworker.0 00000100:00100000:1.0:1784044144.725381:0:9501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580959360 00000100:00100000:1.0:1784044144.725384:0:9501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580959360 00000100:00100000:1.0:1784044144.725458:0:9501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:1.0:1784044144.725464:0:9501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843e0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1870705580959360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044144.725518:0:9501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843e0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1870705580959360:12345-0@lo:400:kworker.0 Request processed in 54us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044144.725524:0:9501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00010000:00080000:1.0:1784044144.725552:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b38420a9180 x1870705580959360/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044160 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784044144.725564:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b38420a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3641:1870705580959360:0@lo:400:kworker.0 00000100:00100000:1.0:1784044144.725589:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397f9dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1870705580958976:0@lo:400:kworker.0 00000100:00100000:2.0:1784044144.732131:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044144.732302:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044144.732364:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b38436a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3639:1870705580957952:0@lo:400:kworker.0 00000100:00100000:2.0:1784044144.732400:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580959232 00000100:00100000:2.0:1784044144.732406:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580959232 00000100:00100000:1.0:1784044144.732491:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580959104 00000100:00100000:1.0:1784044144.732496:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580959104 00000100:00080000:0.0:1784044144.732751:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1784044144.732755:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1784044144.738966:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:2.0:1784044144.738986:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38420a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1870705580959232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784044144.739123:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38420a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1870705580959232:12345-0@lo:400:kworker.0 Request processed in 143us (7000us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044144.739131:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:3.0:1784044144.739233:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397f9dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3640:1870705580959232:0@lo:400:kworker.0 00000100:00100000:1.0:1784044144.739657:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:1.0:1784044144.739666:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38420a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1870705580959104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044144.739717:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38420a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1870705580959104:12345-0@lo:400:kworker.0 Request processed in 53us (7415us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044144.739723:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00010000:00080000:3.0:1784044144.739842:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b397f9dc700 x1870705580959104/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044160 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784044144.739855:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397f9dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3639:1870705580959104:0@lo:400:kworker.0 00010000:00010000:0.0:1784044145.293556:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1784044145.357822:0:13763:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:3.0:1784044145.997293:0:6508:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1784044145.997301:0:6508:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9b384244a000 from 10 10000000:01000000:3.0:1784044145.997320:0:6508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1784044145.997372:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b39759f8600/0x89871fc3aba18256 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044145.997382:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9b39759f8600/0x89871fc3aba18256 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044145.997424:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9b39759f8600/0x89871fc3aba18256 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044145.997451:0:6508:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b384316c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580959488:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784044145.997525:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044145.997610:0:6508:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3843617240 going to sleep for 11 seconds 00000100:00100000:0.0:1784044145.997794:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580959488 00000100:00100000:0.0:1784044145.997802:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580959488 00000100:00100000:0.0:1784044145.997855:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 378 00000100:00100000:0.0:1784044145.997864:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3970edd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+20:6508:x1870705580959488:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784044145.997877:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784044145.997892:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b38410b7400/0x89871fc3aba1825d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x89871fc3aba18256 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044145.997948:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b38410b7400/0x89871fc3aba1825d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x89871fc3aba18256 expref: 21 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044145.997960:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b38410b7400/0x89871fc3aba1825d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x89871fc3aba18256 expref: 21 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044145.997970:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b38410b7400, rc 0) 00000100:00100000:0.0:1784044145.998032:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3970edd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+21:6508:x1870705580959488:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 169us (507us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044145.998039:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 378 00000100:00100000:3.0:1784044145.998338:0:6508:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b384316c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580959488:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784044145.998354:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9b39759f8600/0x89871fc3aba18256 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba1825d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044145.998363:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9b39759f8600/0x89871fc3aba18256 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x89871fc3aba1825d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044145.998445:0:6508:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b384316c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580959616:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784044145.998471:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044145.998498:0:6508:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3843617240 going to sleep for 11 seconds 00000100:00100000:0.0:1784044145.998661:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580959616 00000100:00100000:0.0:1784044145.998666:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580959616 00000100:00100000:0.0:1784044145.998697:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 379 00000100:00100000:0.0:1784044145.998704:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3970edc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+21:6508:x1870705580959616:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784044145.998833:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3970edc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+21:6508:x1870705580959616:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 129us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044145.998852:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 379 00000100:00100000:1.0:1784044145.999284:0:6508:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b384316c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580959616:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784044145.999320:0:6508:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843e0f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580959744:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784044145.999373:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044145.999401:0:6508:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3941254900 going to sleep for 11 seconds 00000100:00100000:0.0:1784044145.999428:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580959744 00000100:00100000:0.0:1784044145.999434:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580959744 00000100:00100000:0.0:1784044145.999467:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 380 00000100:00100000:0.0:1784044145.999473:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3970ede450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+21:6508:x1870705580959744:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784044145.999557:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3970ede450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+21:6508:x1870705580959744:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 84us (183us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044145.999572:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 380 00000100:00100000:1.0:1784044145.999970:0:6508:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843e0f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580959744:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784044146.001650:0:13798:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397bbbfb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:13798:1870705580959872:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784044146.001739:0:13798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044146.001780:0:13798:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3942e1a840 going to sleep for 11 seconds 00000100:00100000:0.0:1784044146.001839:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580959872 00000100:00100000:0.0:1784044146.001845:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580959872 00000100:00100000:0.0:1784044146.001889:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 381 00000100:00100000:0.0:1784044146.001897:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3970edfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+21:13798:x1870705580959872:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784044146.002023:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3970edfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+21:13798:x1870705580959872:12345-0@lo:502:llog_process_th.0 Request processed in 126us (283us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044146.002030:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 381 00000100:00100000:2.0:1784044146.002125:0:13798:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397bbbfb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:13798:1870705580959872:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1784044146.002152:0:13798:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784044146.002160:0:13798:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784044146.002163:0:13798:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1784044146.002168:0:13798:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9b384244a000 00000020:00000080:2.0:1784044146.002171:0:13798:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1784044146.002297:0:13798:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397bbbfb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:13798:1870705580960000:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784044146.002331:0:13798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044146.002372:0:13798:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3942e1a840 going to sleep for 11 seconds 00000100:00100000:3.0:1784044146.002508:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580960000 00000100:00100000:3.0:1784044146.002513:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580960000 00000100:00100000:3.0:1784044146.002552:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 382 00000100:00100000:3.0:1784044146.002560:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3970eddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+21:13798:x1870705580960000:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784044146.002654:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3970eddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+21:13798:x1870705580960000:12345-0@lo:502:llog_process_th.0 Request processed in 94us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044146.002661:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 382 00000100:00100000:2.0:1784044146.004311:0:13798:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397bbbfb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:13798:1870705580960000:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1784044146.004358:0:13798:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784044146.004366:0:13798:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784044146.004368:0:13798:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1784044146.004373:0:13798:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:1.0:1784044146.004620:0:6508:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-12 (rc=0) 10000000:01000000:1.0:1784044146.004649:0:6508:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1784044146.004659:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b39759f8600/0x89871fc3aba18256 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba1825d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044146.004671:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9b39759f8600/0x89871fc3aba18256 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba1825d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784044146.004682:0:6508:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1784044146.004685:0:6508:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9b3975aa3000 from 10 10000000:01000000:1.0:1784044146.004687:0:6508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1784044146.004723:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b38426fd200/0x89871fc3aba18264 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044146.004732:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9b38426fd200/0x89871fc3aba18264 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044146.004755:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9b38426fd200/0x89871fc3aba18264 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044146.004773:0:6508:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843e0f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580960128:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784044146.004819:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044146.004859:0:6508:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3941254900 going to sleep for 11 seconds 00000100:00100000:2.0:1784044146.005537:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580960128 00000100:00100000:2.0:1784044146.005543:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580960128 00000100:00100000:2.0:1784044146.005602:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 383 00000100:00100000:2.0:1784044146.005611:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3965efcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+21:6508:x1870705580960128:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784044146.005624:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784044146.005643:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b3843798800/0x89871fc3aba1826b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x89871fc3aba18264 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044146.005677:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b3843798800/0x89871fc3aba1826b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x89871fc3aba18264 expref: 22 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044146.005687:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b3843798800/0x89871fc3aba1826b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x89871fc3aba18264 expref: 22 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044146.005697:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3843798800, rc 0) 00000100:00100000:2.0:1784044146.005752:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3965efcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+22:6508:x1870705580960128:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 141us (931us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044146.005759:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 383 00000100:00100000:3.0:1784044146.005900:0:6508:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843e0f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580960128:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784044146.005927:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9b38426fd200/0x89871fc3aba18264 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba1826b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044146.005942:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9b38426fd200/0x89871fc3aba18264 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x89871fc3aba1826b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044146.006003:0:6508:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b384316d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580960256:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784044146.006030:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044146.006060:0:6508:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3843617d80 going to sleep for 11 seconds 00000100:00100000:2.0:1784044146.006215:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580960256 00000100:00100000:2.0:1784044146.006219:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580960256 00000100:00100000:2.0:1784044146.006249:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 384 00000100:00100000:2.0:1784044146.006255:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3970edec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+22:6508:x1870705580960256:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784044146.006366:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3970edec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+22:6508:x1870705580960256:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 111us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044146.006374:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 384 00000100:00100000:3.0:1784044146.006522:0:6508:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b384316d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580960256:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784044146.006550:0:6508:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b384316d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580960384:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784044146.006586:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044146.006612:0:6508:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3843617d80 going to sleep for 11 seconds 00000100:00100000:3.0:1784044146.006626:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580960384 00000100:00100000:3.0:1784044146.006630:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580960384 00000100:00100000:3.0:1784044146.006658:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 385 00000100:00100000:3.0:1784044146.006664:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3965efd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+22:6508:x1870705580960384:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784044146.006746:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3965efd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+22:6508:x1870705580960384:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 81us (158us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044146.006752:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 385 00000100:00100000:3.0:1784044146.006788:0:6508:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b384316d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580960384:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784044146.006968:0:13800:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b384316d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:13800:1870705580960512:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784044146.006997:0:13800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044146.007016:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580960512 00000100:00100000:3.0:1784044146.007019:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580960512 00000100:00100000:3.0:1784044146.007035:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 386 00000100:00100000:3.0:1784044146.007040:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3965efc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+22:13800:x1870705580960512:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784044146.007104:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3965efc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+22:13800:x1870705580960512:12345-0@lo:502:llog_process_th.0 Request processed in 63us (106us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044146.007111:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 386 00000100:00100000:3.0:1784044146.007137:0:13800:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3843617180 going to sleep for 11 seconds 00000100:00100000:3.0:1784044146.007147:0:13800:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b384316d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:13800:1870705580960512:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1784044146.007167:0:13800:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784044146.007314:0:13800:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784044146.007317:0:13800:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1784044146.007325:0:13800:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9b3975aa3000 00000020:00000080:3.0:1784044146.007327:0:13800:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1784044146.007552:0:13800:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b384316d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:13800:1870705580960640:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784044146.007584:0:13800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044146.007612:0:13800:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3843617180 going to sleep for 11 seconds 00000100:00100000:2.0:1784044146.007658:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580960640 00000100:00100000:2.0:1784044146.007662:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580960640 00000100:00100000:2.0:1784044146.007699:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 387 00000100:00100000:2.0:1784044146.007707:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3965efbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+22:13800:x1870705580960640:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784044146.007788:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3965efbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+22:13800:x1870705580960640:12345-0@lo:502:llog_process_th.0 Request processed in 82us (202us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044146.007794:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 387 00000100:00100000:3.0:1784044146.007910:0:13800:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b384316d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:13800:1870705580960640:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1784044146.007938:0:13800:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784044146.007942:0:13800:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784044146.007943:0:13800:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1784044146.007947:0:13800:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:2.0:1784044146.008089:0:6508:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-12 (rc=0) 10000000:01000000:2.0:1784044146.008112:0:6508:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1784044146.008126:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b38426fd200/0x89871fc3aba18264 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba1826b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044146.008137:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9b38426fd200/0x89871fc3aba18264 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba1826b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784044146.008147:0:6508:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1784044146.008150:0:6508:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9b396f3cf800 from 10 10000000:01000000:2.0:1784044146.008153:0:6508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1784044146.008199:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b3843798e00/0x89871fc3aba18272 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044146.008207:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9b3843798e00/0x89871fc3aba18272 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044146.008216:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9b3843798e00/0x89871fc3aba18272 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044146.008228:0:6508:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397bbbfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580960768:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1784044146.008255:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044146.008272:0:6508:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3942e1a540 going to sleep for 11 seconds 00000100:00100000:3.0:1784044146.008323:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580960768 00000100:00100000:3.0:1784044146.008327:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580960768 00000100:00100000:3.0:1784044146.008364:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 388 00000100:00100000:3.0:1784044146.008371:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3965efac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+22:6508:x1870705580960768:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784044146.008379:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784044146.008393:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b39759f9800/0x89871fc3aba18279 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x89871fc3aba18272 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044146.008415:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b39759f9800/0x89871fc3aba18279 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x89871fc3aba18272 expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044146.008434:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b39759f9800/0x89871fc3aba18279 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x89871fc3aba18272 expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044146.008443:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b39759f9800, rc 0) 00000100:00100000:3.0:1784044146.008472:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3965efac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+23:6508:x1870705580960768:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 102us (216us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044146.008479:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 388 00000100:00100000:2.0:1784044146.008589:0:6508:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397bbbfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580960768:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784044146.008602:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9b3843798e00/0x89871fc3aba18272 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba18279 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044146.008611:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9b3843798e00/0x89871fc3aba18272 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x89871fc3aba18279 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044146.008657:0:6508:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397bbbfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580960896:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784044146.008692:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044146.008722:0:6508:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3942e1a540 going to sleep for 11 seconds 00000100:00100000:2.0:1784044146.008738:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580960896 00000100:00100000:2.0:1784044146.008741:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580960896 00000100:00100000:2.0:1784044146.008764:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 389 00000100:00100000:2.0:1784044146.008771:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3965ef8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+23:6508:x1870705580960896:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784044146.008854:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3965ef8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+23:6508:x1870705580960896:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 83us (161us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044146.008861:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 389 00000100:00100000:2.0:1784044146.008889:0:6508:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397bbbfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580960896:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784044146.008911:0:6508:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397bbbfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580961024:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784044146.008954:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044146.008966:0:6508:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3942e1a540 going to sleep for 11 seconds 00000100:00100000:2.0:1784044146.008978:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580961024 00000100:00100000:2.0:1784044146.008981:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580961024 00000100:00100000:2.0:1784044146.008998:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 390 00000100:00100000:2.0:1784044146.009003:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3965ef9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+23:6508:x1870705580961024:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784044146.009062:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3965ef9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+23:6508:x1870705580961024:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 58us (107us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044146.009068:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 390 00000100:00100000:2.0:1784044146.009104:0:6508:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397bbbfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580961024:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784044146.010870:0:13801:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397bbbfb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:13801:1870705580961152:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784044146.010942:0:13801:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044146.010970:0:13801:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3942e1a600 going to sleep for 11 seconds 00000100:00100000:3.0:1784044146.011822:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580961152 00000100:00100000:3.0:1784044146.011830:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580961152 00000100:00100000:3.0:1784044146.011884:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 391 00000100:00100000:3.0:1784044146.011893:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3965ef9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+23:13801:x1870705580961152:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784044146.012034:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3965ef9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+23:13801:x1870705580961152:12345-0@lo:502:llog_process_th.0 Request processed in 143us (1093us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044146.012040:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 391 00000100:00100000:3.0:1784044146.012089:0:13801:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397bbbfb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:13801:1870705580961152:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1784044146.012113:0:13801:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784044146.012120:0:13801:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784044146.012122:0:13801:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1784044146.012127:0:13801:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9b396f3cf800 00000020:00000080:3.0:1784044146.012129:0:13801:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1784044146.013028:0:13801:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b384316d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:13801:1870705580961280:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784044146.013073:0:13801:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044146.013105:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580961280 00000100:00100000:3.0:1784044146.013110:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580961280 00000100:00100000:3.0:1784044146.013142:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 392 00000100:00100000:3.0:1784044146.013148:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3965ef8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+23:13801:x1870705580961280:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784044146.013245:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3965ef8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+23:13801:x1870705580961280:12345-0@lo:502:llog_process_th.0 Request processed in 96us (171us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044146.013252:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 392 00000100:00100000:3.0:1784044146.013295:0:13801:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3843617f00 going to sleep for 11 seconds 00000100:00100000:3.0:1784044146.013309:0:13801:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b384316d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:13801:1870705580961280:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1784044146.013759:0:13801:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784044146.013766:0:13801:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784044146.013768:0:13801:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1784044146.013772:0:13801:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:2.0:1784044146.013949:0:6508:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-12 (rc=0) 10000000:01000000:2.0:1784044146.013988:0:6508:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1784044146.014001:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b3843798e00/0x89871fc3aba18272 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba18279 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044146.014013:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9b3843798e00/0x89871fc3aba18272 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba18279 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784044146.014024:0:6508:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1784044146.014027:0:6508:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9b397418c800 from 10 10000000:01000000:2.0:1784044146.014029:0:6508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1784044146.014059:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b3843799200/0x89871fc3aba18280 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044146.014068:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9b3843799200/0x89871fc3aba18280 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044146.014078:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9b3843799200/0x89871fc3aba18280 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044146.014095:0:6508:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397bbbc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580961408:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1784044146.014130:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044146.014157:0:6508:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3944cca900 going to sleep for 11 seconds 00000100:00100000:3.0:1784044146.015154:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580961408 00000100:00100000:3.0:1784044146.015162:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580961408 00000100:00100000:3.0:1784044146.015895:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 393 00000100:00100000:3.0:1784044146.015906:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3965efa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+23:6508:x1870705580961408:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784044146.016672:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784044146.016694:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b39759f8e00/0x89871fc3aba18287 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x89871fc3aba18280 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044146.016725:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b39759f8e00/0x89871fc3aba18287 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x89871fc3aba18280 expref: 24 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044146.016737:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b39759f8e00/0x89871fc3aba18287 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x89871fc3aba18280 expref: 24 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044146.016746:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b39759f8e00, rc 0) 00000100:00100000:3.0:1784044146.016817:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3965efa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+24:6508:x1870705580961408:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 913us (2685us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044146.016825:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 393 00000100:00100000:1.0:1784044146.017535:0:6508:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397bbbc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580961408:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784044146.017556:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9b3843799200/0x89871fc3aba18280 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba18287 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044146.017566:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9b3843799200/0x89871fc3aba18280 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x89871fc3aba18287 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044146.017645:0:6508:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843e0d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580961536:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784044146.017684:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044146.025477:0:6508:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3941254780 going to sleep for 11 seconds 00000100:00100000:3.0:1784044146.026557:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580961536 00000100:00100000:3.0:1784044146.026574:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580961536 00000100:00100000:3.0:1784044146.026623:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 394 00000100:00100000:3.0:1784044146.026632:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3965ef8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+24:6508:x1870705580961536:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784044146.026818:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3965ef8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+24:6508:x1870705580961536:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 187us (9132us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044146.026826:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 394 00000100:00100000:3.0:1784044146.026866:0:6508:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843e0d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580961536:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784044146.026930:0:6508:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b384316d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580961664:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784044146.026977:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044146.026997:0:6508:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3843617540 going to sleep for 11 seconds 00000100:00100000:3.0:1784044146.027016:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580961664 00000100:00100000:3.0:1784044146.027019:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580961664 00000100:00100000:3.0:1784044146.027034:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 395 00000100:00100000:3.0:1784044146.027039:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3965efb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+24:6508:x1870705580961664:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784044146.027104:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3965efb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+24:6508:x1870705580961664:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 64us (126us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044146.027110:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 395 00000100:00100000:3.0:1784044146.027138:0:6508:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b384316d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:6508:1870705580961664:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784044146.027316:0:13803:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b384316d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:13803:1870705580961792:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784044146.027341:0:13803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044146.028079:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580961792 00000100:00100000:3.0:1784044146.028085:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580961792 00000100:00100000:3.0:1784044146.028109:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 396 00000100:00100000:3.0:1784044146.028115:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3965ef9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+24:13803:x1870705580961792:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784044146.028472:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3965ef9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+24:13803:x1870705580961792:12345-0@lo:502:llog_process_th.0 Request processed in 356us (1128us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044146.028486:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 396 00000100:00100000:3.0:1784044146.028531:0:13803:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3843617e40 going to sleep for 11 seconds 00000100:00100000:3.0:1784044146.028546:0:13803:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b384316d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:13803:1870705580961792:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1784044146.028570:0:13803:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784044146.028580:0:13803:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784044146.028582:0:13803:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1784044146.028588:0:13803:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9b397418c800 00000020:00000080:3.0:1784044146.028591:0:13803:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1784044146.028670:0:13803:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b384316d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:13803:1870705580961920:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784044146.028701:0:13803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044146.028802:0:13803:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b38436ea300 going to sleep for 11 seconds 00000100:00100000:2.0:1784044146.029537:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580961920 00000100:00100000:2.0:1784044146.029544:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580961920 00000100:00100000:1.0:1784044146.031024:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 397 00000100:00100000:1.0:1784044146.031041:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3965efa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+24:13803:x1870705580961920:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784044146.031242:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3965efa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+24:13803:x1870705580961920:12345-0@lo:502:llog_process_th.0 Request processed in 207us (2538us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044146.031249:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 397 00000100:00100000:3.0:1784044146.031309:0:13803:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b384316d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:13803:1870705580961920:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1784044146.031414:0:13803:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784044146.031424:0:13803:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784044146.031426:0:13803:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1784044146.031432:0:13803:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:3.0:1784044146.031503:0:6508:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-12 (rc=0) 10000000:01000000:3.0:1784044146.031528:0:6508:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1784044146.031540:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b3843799200/0x89871fc3aba18280 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba18287 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044146.031551:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9b3843799200/0x89871fc3aba18280 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba18287 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1784044146.033563:0:13804:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1784044146.317537:0:10331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1784044147.089733:0:13804:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1784044147.341393:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784044147.433616:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044147.433665:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044147.433697:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044147.433726:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044147.433749:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044147.433774:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565136896 00000100:00100000:0.0:1784044147.433778:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044147.433784:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565136896 00000100:00100000:0.0:1784044147.433798:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565137024 00000100:00100000:0.0:1784044147.433801:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565137024 00000100:00100000:2.0:1784044147.433835:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565137152 00000100:00100000:2.0:1784044147.433838:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565137152 00000100:00100000:0.0:1784044147.433839:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 92 00000100:00100000:0.0:1784044147.433847:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843e3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+5:2407:x1870705565137024:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:2.0:1784044147.433850:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565136768 00000100:00100000:2.0:1784044147.433852:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565136768 00000100:00100000:2.0:1784044147.433863:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565137280 00000100:00100000:2.0:1784044147.433869:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565137280 00000100:00100000:2.0:1784044147.433884:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 254 00000100:00100000:2.0:1784044147.433890:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397a8a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+5:2407:x1870705565136896:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:3.0:1784044147.433977:0:9501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 255 00000100:00100000:3.0:1784044147.433988:0:9501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397a8a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68dfcea6-5d83-4dbb-8fa3-e35542d621e5+5:2407:x1870705565137152:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:0.0:1784044147.434062:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843e3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+5:2407:x1870705565137024:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 215us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044147.434071:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 92 00000100:00100000:0.0:1784044147.434101:0:6511:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:0.0:1784044147.434110:0:6511:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00080000:0.0:1784044147.434128:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1784044147.434134:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1784044147.434136:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1784044147.434299:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 256 00000100:00100000:0.0:1784044147.434306:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843e3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+5:2407:x1870705565136768:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:2.0:1784044147.434437:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397a8a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+5:2407:x1870705565136896:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 546us (771us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044147.434455:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 254 00000100:00100000:2.0:1784044147.434470:0:6513:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:2.0:1784044147.434477:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 257 00000100:00100000:2.0:1784044147.434484:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843ce5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68dfcea6-5d83-4dbb-8fa3-e35542d621e5+5:2407:x1870705565137280:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:2.0:1784044147.434510:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843ce5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68dfcea6-5d83-4dbb-8fa3-e35542d621e5+5:2407:x1870705565137280:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 27us (731us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044147.434516:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 257 00000100:00100000:1.0:1784044147.435993:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565136640 00000100:00100000:1.0:1784044147.436006:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565136640 00000100:00100000:1.0:1784044147.436080:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 398 00000100:00100000:1.0:1784044147.436088:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3965efb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4a09ad9-a185-4679-99bb-b6a07b865440+13:2407:x1870705565136640:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:1.0:1784044147.436138:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3965efb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4a09ad9-a185-4679-99bb-b6a07b865440+13:2407:x1870705565136640:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 51us (2532us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044147.436145:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 398 00000100:00100000:3.0:1784044147.436770:0:9501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397a8a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68dfcea6-5d83-4dbb-8fa3-e35542d621e5+5:2407:x1870705565137152:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 2781us (3068us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044147.436780:0:9501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 255 00000100:00100000:0.0:1784044147.441384:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843e3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+5:2407:x1870705565136768:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 7064us (7643us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044147.441407:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 256 00000100:00100000:3.0:1784044147.789609:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1784044147.789637:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39503be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1870705580962048:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1784044147.789720:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044147.789784:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580962048 00000100:00100000:0.0:1784044147.789794:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580962048 00000100:00100000:0.0:1784044147.789852:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1784044147.789861:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b384316d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1870705580962048:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1784044147.789894:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1784044147.790076:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b384316d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1870705580962048:12345-0@lo:41:osp-pre-0-1.0 Request processed in 106us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044147.790083:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1784044147.790641:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39503be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1870705580962048:0@lo:41:osp-pre-0-1.0 00000001:00080000:2.0:1784044147.792104:0:8421:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00010000:00010000:1.0:1784044148.365451:0:10330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784044148.813751:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784044148.813779:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397bbbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1870705580962176:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784044148.813838:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1784044148.813851:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843e0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1870705580962304:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1784044148.813862:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044148.814032:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784044148.814045:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397bbbfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1870705580962432:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1784044148.815909:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044148.815996:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580962304 00000100:00100000:1.0:1784044148.816007:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580962304 00000100:00100000:1.0:1784044148.816061:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1784044148.816072:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843e0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1870705580962304:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1784044148.817234:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1784044148.817327:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843e0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1870705580962304:12345-0@lo:41:osp-pre-1-0.0 Request processed in 1254us (1422us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044148.817336:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1784044148.817426:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843e0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1870705580962304:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1784044148.817578:0:10713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580962176 00000100:00100000:1.0:1784044148.817584:0:10713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580962176 00000100:00100000:1.0:1784044148.817716:0:10713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1784044148.817724:0:10713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39503be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1870705580962176:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1784044148.817751:0:10713:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784044148.817788:0:10713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39503be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1870705580962176:12345-0@lo:13:osp-pre-0-0.0 Request processed in 66us (3928us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044148.817794:0:10713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00080000:1.0:1784044148.818579:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784044148.820508:0:3638:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:1.0:1784044148.820522:0:3638:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b38427b7800, transno 4294967301 00000100:00100000:1.0:1784044148.820559:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397bbbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1870705580962176:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784044148.820910:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044148.821106:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580962432 00000100:00100000:1.0:1784044148.821114:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580962432 00000100:00100000:1.0:1784044148.821216:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1784044148.821226:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b384316c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1870705580962432:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1784044148.821250:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784044148.821302:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b384316c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1870705580962432:12345-0@lo:13:osp-pre-0-1.0 Request processed in 77us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044148.821310:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00080000:0.0:1784044148.821458:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784044148.821841:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397bbbfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1870705580962432:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1784044149.392134:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784044149.837417:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d46d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1870705580962560:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784044149.837435:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39759b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1870705580962816:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1784044149.843924:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397bbbfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:3638:1870705580962688:0@lo:400:kworker.0 00000100:00100000:2.0:1784044149.844406:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397bbbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3641:1870705580962944:0@lo:400:kworker.0 00000100:00100000:3.0:1784044149.844517:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044149.844579:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1870705580963328:0@lo:400:kworker.0 00000100:00100000:3.0:1784044149.845110:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044149.845146:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843c56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1870705580963840:0@lo:400:kworker.0 00000100:00100000:3.0:1784044149.845193:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044149.845213:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843c55500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1870705580964352:0@lo:400:kworker.0 00000100:00100000:3.0:1784044149.845236:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044149.845265:0:9822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580964352 00000100:00100000:3.0:1784044149.845272:0:9822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580964352 00000100:00100000:3.0:1784044149.845330:0:9822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1784044149.845340:0:9822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39759b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3640:x1870705580964352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044149.845387:0:9822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39759b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3640:x1870705580964352:12345-0@lo:400:kworker.0 Request processed in 49us (149us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044149.845404:0:9822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00010000:00080000:3.0:1784044149.845455:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b3843c55500 x1870705580964352/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784044165 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784044149.845468:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843c55500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1870705580964352:0@lo:400:kworker.0 00000100:00080000:3.0:1784044149.845519:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784044149.845531:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580963328 00000100:00100000:3.0:1784044149.845535:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580963328 00000100:00100000:3.0:1784044149.845562:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1784044149.845568:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39759b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1870705580963328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044149.851051:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044149.851124:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3639:1870705580963200:0@lo:400:kworker.0 00000100:00100000:1.0:1784044149.851167:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044149.851283:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843c55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3639:1870705580963712:0@lo:400:kworker.0 00000100:00100000:1.0:1784044149.851309:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044149.851327:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843c54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1870705580964224:0@lo:400:kworker.0 00000100:00100000:1.0:1784044149.851352:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044149.851491:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39759b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1870705580963328:12345-0@lo:400:kworker.0 Request processed in 5920us (6379us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044149.851502:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1784044149.851571:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1870705580963328:0@lo:400:kworker.0 00000100:00100000:3.0:1784044149.851643:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580963840 00000100:00100000:3.0:1784044149.851651:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580963840 00000100:00100000:3.0:1784044149.851810:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580963200 00000100:00100000:3.0:1784044149.851813:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580963200 00000100:00100000:3.0:1784044149.851835:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580963712 00000100:00100000:3.0:1784044149.851837:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580963712 00000100:00100000:3.0:1784044149.851851:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:3.0:1784044149.851858:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39759b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1870705580963840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044149.851923:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39759b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1870705580963840:12345-0@lo:400:kworker.0 Request processed in 64us (6728us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044149.851930:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:3.0:1784044149.853147:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:3.0:1784044149.853163:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843e0e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1870705580963200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044149.853247:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843e0e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1870705580963200:12345-0@lo:400:kworker.0 Request processed in 90us (2079us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044149.853254:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:3.0:1784044149.853268:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:3.0:1784044149.853274:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843e0c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1870705580963712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044149.853300:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843e0c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1870705580963712:12345-0@lo:400:kworker.0 Request processed in 27us (1991us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044149.853305:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:3.0:1784044149.853329:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580962816 00000100:00100000:3.0:1784044149.853334:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580962816 00000100:00100000:3.0:1784044149.853365:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580962560 00000100:00100000:3.0:1784044149.853367:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580962560 00000100:00100000:3.0:1784044149.853378:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1784044149.853383:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39759b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1870705580962816:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1784044149.854326:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784044149.854392:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39759b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1870705580962816:12345-0@lo:13:osp-pre-1-1.0 Request processed in 1005us (9873us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044149.854400:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1784044149.854425:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1784044149.854434:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843e0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1870705580962560:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1784044149.854447:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784044149.854474:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843e0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1870705580962560:12345-0@lo:13:osp-pre-1-0.0 Request processed in 42us (3431us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044149.854479:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00080000:3.0:1784044149.854505:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1784044149.854510:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1784044149.854527:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1784044149.854565:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b3843c56300 x1870705580963840/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044165 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784044149.854580:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843c56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1870705580963840:0@lo:400:kworker.0 00010000:00080000:3.0:1784044149.854592:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b39759b7b80 x1870705580962816/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784044165 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784044149.854621:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39759b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1870705580962816:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1784044149.858807:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044149.858874:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1870705580963072:0@lo:400:kworker.0 00000100:00100000:0.0:1784044149.858927:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1784044149.864553:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b3843d46d80 x1870705580962560/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784044165 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784044149.864584:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d46d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1870705580962560:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784044149.864629:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3639:1870705580963200:0@lo:400:kworker.0 00000100:00100000:1.0:1784044149.864670:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843c55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3639:1870705580963712:0@lo:400:kworker.0 00000100:00100000:1.0:1784044149.864683:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1784044149.864696:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1870705580963584:0@lo:400:kworker.0 00000100:00100000:1.0:1784044149.864754:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044149.864804:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843c55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3639:1870705580964096:0@lo:400:kworker.0 00000100:00100000:1.0:1784044149.864829:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044149.864872:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580964224 00000100:00100000:1.0:1784044149.864878:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580964224 00000100:00100000:1.0:1784044149.864938:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580963584 00000100:00100000:1.0:1784044149.864942:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580963584 00000100:00100000:1.0:1784044149.864964:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1784044149.864973:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843e0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1870705580964224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044149.865028:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843e0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1870705580964224:12345-0@lo:400:kworker.0 Request processed in 56us (13675us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044149.865035:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1784044149.865052:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1784044149.865058:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843e0df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1870705580963584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044149.865091:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843e0df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1870705580963584:12345-0@lo:400:kworker.0 Request processed in 33us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044149.865097:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1784044149.865119:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580964096 00000100:00100000:1.0:1784044149.865122:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580964096 00000100:00100000:1.0:1784044149.865156:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:1.0:1784044149.865163:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843e0e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1870705580964096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044149.866148:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580962688 00000100:00100000:3.0:1784044149.866156:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580962688 00000100:00100000:3.0:1784044149.866206:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 399 00000100:00100000:3.0:1784044149.866214:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3965ef9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+24:3638:x1870705580962688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044149.866263:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3965ef9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+24:3638:x1870705580962688:12345-0@lo:400:kworker.0 Request processed in 51us (7464us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044149.866270:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 399 00000100:00080000:3.0:1784044149.866525:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1784044149.866557:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1870705580963584:0@lo:400:kworker.0 00010000:00080000:3.0:1784044149.866573:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b3843c54e00 x1870705580964224/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784044165 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784044149.866584:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843c54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1870705580964224:0@lo:400:kworker.0 00000100:00100000:1.0:1784044149.870571:0:7768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580963072 00000100:00100000:1.0:1784044149.870585:0:7768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580963072 00000100:00100000:1.0:1784044149.870665:0:7768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1784044149.870675:0:7768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1870705580963072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784044149.874535:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397bbbfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:3638:1870705580962688:0@lo:400:kworker.0 00000100:00100000:0.0:1784044149.874682:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843e0e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1870705580964096:12345-0@lo:400:kworker.0 Request processed in 9518us (9850us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044149.874703:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00010000:00080000:2.0:1784044149.875288:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b3843c55c00 x1870705580964096/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044165 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784044149.875302:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843c55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3639:1870705580964096:0@lo:400:kworker.0 00000100:00100000:1.0:1784044149.878639:0:7768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1870705580963072:12345-0@lo:400:kworker.0 Request processed in 7956us (19701us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044149.878655:0:7768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1784044149.879218:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1870705580963072:0@lo:400:kworker.0 00000100:00100000:2.0:1784044149.890263:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044149.890309:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1870705580963456:0@lo:400:kworker.0 00000100:00100000:2.0:1784044149.890344:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044149.890375:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843c54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3641:1870705580963968:0@lo:400:kworker.0 00000100:00100000:2.0:1784044149.890399:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044149.890506:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580962944 00000100:00100000:0.0:1784044149.890514:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580962944 00000100:00100000:0.0:1784044149.890568:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580963968 00000100:00100000:0.0:1784044149.890572:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580963968 00000100:00100000:0.0:1784044149.890602:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:0.0:1784044149.890623:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843c55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1870705580962944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784044149.890679:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843c55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1870705580962944:12345-0@lo:400:kworker.0 Request processed in 59us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044149.890686:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:1.0:1784044149.890737:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580963456 00000100:00100000:1.0:1784044149.890742:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580963456 00000100:00100000:1.0:1784044149.890772:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1784044149.890778:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843c54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1870705580963456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044149.890812:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843c54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1870705580963456:12345-0@lo:400:kworker.0 Request processed in 35us (468us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044149.890819:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1784044149.890834:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1784044149.890841:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843c55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1870705580963968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784044149.890873:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843c55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1870705580963968:12345-0@lo:400:kworker.0 Request processed in 32us (473us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044149.890889:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1784044149.890989:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397bbbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3641:1870705580962944:0@lo:400:kworker.0 00000100:00100000:2.0:1784044149.891002:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1870705580963456:0@lo:400:kworker.0 00000100:00100000:2.0:1784044149.891030:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843c54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3641:1870705580963968:0@lo:400:kworker.0 00000100:00080000:3.0:1784044149.891197:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1784044150.414312:0:10331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784044151.441209:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784044152.468352:0:10330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784044152.550046:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044152.550323:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565137408 00000100:00100000:2.0:1784044152.550336:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565137408 00000100:00100000:2.0:1784044152.550403:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 400 00000100:00100000:2.0:1784044152.550415:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3965ef8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4a09ad9-a185-4679-99bb-b6a07b865440+13:2409:x1870705565137408:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:2.0:1784044152.550508:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3965ef8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4a09ad9-a185-4679-99bb-b6a07b865440+13:2409:x1870705565137408:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 95us (476us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044152.550516:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 400 00000100:00100000:3.0:1784044152.565283:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044152.565326:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044152.565368:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044152.565404:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044152.565449:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044152.565501:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565137536 00000100:00100000:3.0:1784044152.565513:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565137536 00000100:00100000:3.0:1784044152.565814:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565138048 00000100:00100000:3.0:1784044152.565819:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565138048 00000100:00100000:3.0:1784044152.565835:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565137664 00000100:00100000:3.0:1784044152.565837:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565137664 00000100:00100000:3.0:1784044152.565852:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565137920 00000100:00100000:3.0:1784044152.565854:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565137920 00000100:00100000:3.0:1784044152.565887:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 264 00000100:00100000:3.0:1784044152.565898:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39759b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+5:2409:x1870705565137536:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:3.0:1784044152.565993:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39759b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+5:2409:x1870705565137536:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 97us (728us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044152.566001:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 264 00000100:00100000:1.0:1784044152.566116:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565137792 00000100:00100000:1.0:1784044152.566121:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565137792 00000100:00100000:1.0:1784044152.566155:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 97 00000100:00100000:1.0:1784044152.566162:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d2d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+5:2410:x1870705565137792:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:1.0:1784044152.566224:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d2d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+5:2410:x1870705565137792:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 63us (897us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044152.566231:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 97 00000100:00100000:1.0:1784044152.566279:0:9501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 265 00000100:00100000:1.0:1784044152.566286:0:9501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68dfcea6-5d83-4dbb-8fa3-e35542d621e5+5:2410:x1870705565138048:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:1.0:1784044152.566311:0:9501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68dfcea6-5d83-4dbb-8fa3-e35542d621e5+5:2410:x1870705565138048:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 26us (943us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044152.566317:0:9501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 265 00000100:00100000:1.0:1784044152.566333:0:9501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 266 00000100:00100000:1.0:1784044152.566348:0:9501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a93fdf3c-d42f-420a-95ea-b0cbfe954363+5:2410:x1870705565137664:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:1.0:1784044152.566371:0:9501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a93fdf3c-d42f-420a-95ea-b0cbfe954363+5:2410:x1870705565137664:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 24us (967us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044152.566378:0:9501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 266 00000100:00100000:1.0:1784044152.566393:0:9501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 267 00000100:00100000:1.0:1784044152.566399:0:9501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68dfcea6-5d83-4dbb-8fa3-e35542d621e5+5:2410:x1870705565137920:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:1.0:1784044152.566423:0:9501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68dfcea6-5d83-4dbb-8fa3-e35542d621e5+5:2410:x1870705565137920:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 23us (973us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044152.566429:0:9501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 267 00000100:00080000:1.0:1784044152.566447:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1784044152.566451:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1784044152.566453:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784044152.916587:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784044152.916636:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d46680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1870705580964480:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1784044152.916711:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044152.916848:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580964480 00000100:00100000:1.0:1784044152.916865:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580964480 00000100:00100000:1.0:1784044152.916936:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1784044152.916946:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1870705580964480:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1784044152.916980:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1784044152.917046:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1870705580964480:12345-0@lo:41:osp-pre-0-1.0 Request processed in 101us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044152.917054:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1784044152.917868:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d46680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1870705580964480:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1784044153.485754:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784044153.934295:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843c54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1870705580964608:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1784044153.934375:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044153.934658:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580964608 00000100:00100000:1.0:1784044153.934667:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580964608 00000100:00100000:1.0:1784044153.934732:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1784044153.934743:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1870705580964608:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1784044153.934775:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784044153.934820:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1870705580964608:12345-0@lo:13:osp-pre-0-1.0 Request processed in 80us (445us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044153.934841:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00080000:1.0:1784044153.934875:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784044153.934909:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843c54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1870705580964608:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1784044153.935553:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843c56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1870705580964736:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784044153.935594:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044153.935678:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580964736 00000100:00100000:0.0:1784044153.935692:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580964736 00000100:00100000:0.0:1784044153.935740:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1784044153.935748:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3842705f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1870705580964736:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1784044153.935762:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784044153.935798:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3842705f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1870705580964736:12345-0@lo:13:osp-pre-0-0.0 Request processed in 52us (204us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044153.935805:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00080000:3.0:1784044153.935949:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784044153.935977:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843c56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1870705580964736:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784044153.936372:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1870705580964864:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1784044153.936409:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044153.936504:0:7768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580964864 00000100:00100000:0.0:1784044153.936509:0:7768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580964864 00000100:00100000:0.0:1784044153.936551:0:7768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1784044153.936557:0:7768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843c54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1870705580964864:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1784044153.936586:0:7768:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1784044153.936630:0:7768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843c54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1870705580964864:12345-0@lo:41:osp-pre-1-0.0 Request processed in 72us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044153.936637:0:7768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1784044153.936713:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1870705580964864:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1784044154.509415:0:10331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784044154.963377:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843c55880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1870705580964992:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1784044154.963448:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044154.963527:0:10713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580964992 00000100:00100000:2.0:1784044154.963535:0:10713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580964992 00000100:00100000:2.0:1784044154.963587:0:10713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1784044154.963607:0:10713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843c54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1870705580964992:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1784044154.963637:0:10713:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784044154.963693:0:10713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843c54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1870705580964992:12345-0@lo:13:osp-pre-1-1.0 Request processed in 98us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044154.963700:0:10713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00080000:2.0:1784044154.963720:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1784044154.963747:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b3843c55880 x1870705580964992/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784044170 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784044154.963780:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843c55880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1870705580964992:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1784044154.972229:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:3638:1870705580965120:0@lo:400:kworker.0 00000100:00100000:0.0:1784044154.972303:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044154.972343:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1870705580965632:0@lo:400:kworker.0 00000100:00100000:0.0:1784044154.972372:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044154.972392:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d46d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1870705580966144:0@lo:400:kworker.0 00000100:00100000:0.0:1784044154.972465:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044154.972504:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1784044154.972521:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1870705580965248:0@lo:400:kworker.0 00000100:00100000:0.0:1784044154.972545:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044154.972563:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1870705580965760:0@lo:400:kworker.0 00000100:00100000:0.0:1784044154.972585:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044154.972602:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397bbbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3638:1870705580966272:0@lo:400:kworker.0 00000100:00100000:0.0:1784044154.972621:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044154.972650:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d44380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1870705580965376:0@lo:400:kworker.0 00000100:00100000:0.0:1784044154.972683:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044154.972701:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1870705580965888:0@lo:400:kworker.0 00000100:00100000:0.0:1784044154.972721:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044154.972736:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397bbbfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3640:1870705580966400:0@lo:400:kworker.0 00000100:00100000:0.0:1784044154.972756:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044154.972773:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1784044154.972778:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1870705580965504:0@lo:400:kworker.0 00000100:00100000:0.0:1784044154.972798:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044154.972811:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3640:1870705580966016:0@lo:400:kworker.0 00000100:00100000:0.0:1784044154.972829:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044154.972852:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b38435eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1870705580966528:0@lo:400:kworker.0 00000100:00100000:0.0:1784044154.972873:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044154.972917:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580965120 00000100:00100000:0.0:1784044154.972924:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580965120 00000100:00100000:0.0:1784044154.972974:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 401 00000100:00100000:0.0:1784044154.972983:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3965efb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+24:3638:x1870705580965120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784044154.973030:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3965efb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+24:3638:x1870705580965120:12345-0@lo:400:kworker.0 Request processed in 48us (727us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044154.973050:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 401 00000100:00100000:0.0:1784044154.973087:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580965632 00000100:00100000:0.0:1784044154.973091:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580965632 00000100:00100000:0.0:1784044154.973113:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580965376 00000100:00100000:0.0:1784044154.973116:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580965376 00000100:00100000:0.0:1784044154.973130:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1784044154.973135:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38435eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1870705580965632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784044154.973169:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38435eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1870705580965632:12345-0@lo:400:kworker.0 Request processed in 33us (796us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044154.973198:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1784044154.973211:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1784044154.973217:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38435ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1870705580965376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784044154.973249:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38435ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1870705580965376:12345-0@lo:400:kworker.0 Request processed in 32us (576us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044154.973255:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1784044154.973272:0:9501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580966144 00000100:00100000:0.0:1784044154.973275:0:9501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580966144 00000100:00100000:0.0:1784044154.973302:0:9501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580965248 00000100:00100000:0.0:1784044154.973305:0:9501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580965248 00000100:00100000:0.0:1784044154.973316:0:9501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580966272 00000100:00100000:0.0:1784044154.973318:0:9501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580966272 00000100:00100000:0.0:1784044154.973330:0:9501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580966400 00000100:00100000:0.0:1784044154.973333:0:9501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580966400 00000100:00100000:0.0:1784044154.973346:0:9501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580965504 00000100:00100000:0.0:1784044154.973348:0:9501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580965504 00000100:00100000:0.0:1784044154.973358:0:9501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580966016 00000100:00100000:0.0:1784044154.973360:0:9501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580966016 00000100:00100000:0.0:1784044154.973374:0:9501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:0.0:1784044154.973379:0:9501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38435edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1870705580966144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784044154.973420:0:9501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38435edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1870705580966144:12345-0@lo:400:kworker.0 Request processed in 41us (955us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044154.973427:0:9501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:0.0:1784044154.973440:0:9501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:0.0:1784044154.973446:0:9501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38435ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1870705580965248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784044154.973472:0:9501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38435ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1870705580965248:12345-0@lo:400:kworker.0 Request processed in 27us (926us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044154.973478:0:9501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:0.0:1784044154.973489:0:9501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:0.0:1784044154.973495:0:9501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38435edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1870705580966272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784044154.973520:0:9501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38435edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1870705580966272:12345-0@lo:400:kworker.0 Request processed in 26us (898us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044154.973526:0:9501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:0.0:1784044154.973536:0:9501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:0.0:1784044154.973541:0:9501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38435efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1870705580966400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784044154.973569:0:9501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38435efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1870705580966400:12345-0@lo:400:kworker.0 Request processed in 28us (812us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044154.973575:0:9501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:0.0:1784044154.973585:0:9501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:0.0:1784044154.973591:0:9501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38435ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1870705580965504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784044154.973616:0:9501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38435ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1870705580965504:12345-0@lo:400:kworker.0 Request processed in 25us (817us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044154.973622:0:9501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:0.0:1784044154.973632:0:9501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:0.0:1784044154.973638:0:9501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38435ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1870705580966016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784044154.973672:0:9501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38435ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1870705580966016:12345-0@lo:400:kworker.0 Request processed in 34us (842us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044154.973679:0:9501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:0.0:1784044154.973700:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580965760 00000100:00100000:0.0:1784044154.973703:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580965760 00000100:00100000:0.0:1784044154.973726:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580965888 00000100:00100000:0.0:1784044154.973729:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580965888 00000100:00100000:0.0:1784044154.973740:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580966528 00000100:00100000:0.0:1784044154.973742:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580966528 00000100:00100000:0.0:1784044154.973756:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1784044154.973762:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38435ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1870705580965760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784044154.973791:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38435ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1870705580965760:12345-0@lo:400:kworker.0 Request processed in 29us (1204us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044154.973797:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1784044154.973808:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1784044154.973814:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38435ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1870705580965888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784044154.973852:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38435ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1870705580965888:12345-0@lo:400:kworker.0 Request processed in 39us (1130us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044154.973859:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1784044154.973871:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1784044154.973876:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843cfd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1870705580966528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784044154.973901:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843cfd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1870705580966528:12345-0@lo:400:kworker.0 Request processed in 25us (1027us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044154.973906:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1784044154.973964:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1870705580965248:0@lo:400:kworker.0 00000100:00100000:0.0:1784044154.973977:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1870705580965760:0@lo:400:kworker.0 00000100:00100000:0.0:1784044154.973994:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397bbbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3638:1870705580966272:0@lo:400:kworker.0 00000100:00100000:0.0:1784044154.974003:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:3638:1870705580965120:0@lo:400:kworker.0 00000100:00100000:0.0:1784044154.974012:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1870705580965632:0@lo:400:kworker.0 00010000:00080000:0.0:1784044154.974024:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b3843d46d80 x1870705580966144/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044170 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784044154.974035:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d46d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1870705580966144:0@lo:400:kworker.0 00000100:00100000:0.0:1784044154.974078:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1870705580965504:0@lo:400:kworker.0 00000100:00100000:0.0:1784044154.974087:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3640:1870705580966016:0@lo:400:kworker.0 00010000:00080000:0.0:1784044154.974096:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b38435eca80 x1870705580966528/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784044170 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784044154.974105:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b38435eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1870705580966528:0@lo:400:kworker.0 00000100:00100000:0.0:1784044154.974115:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d44380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1870705580965376:0@lo:400:kworker.0 00000100:00100000:0.0:1784044154.974124:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1870705580965888:0@lo:400:kworker.0 00010000:00080000:0.0:1784044154.974131:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b397bbbfb80 x1870705580966400/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044170 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784044154.974139:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397bbbfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3640:1870705580966400:0@lo:400:kworker.0 00000100:00080000:0.0:1784044154.974161:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784044154.974166:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1784044154.974168:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1784044154.977114:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843cfe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1870705580966656:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784044154.977215:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044154.984352:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580966656 00000100:00100000:0.0:1784044154.984366:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580966656 00000100:00100000:0.0:1784044154.984470:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1784044154.984481:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843e0d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1870705580966656:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1784044154.984506:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784044154.984594:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843e0d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1870705580966656:12345-0@lo:13:osp-pre-1-0.0 Request processed in 116us (7379us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044154.984602:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00010000:00080000:1.0:1784044154.984922:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b3843cfe680 x1870705580966656/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784044170 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784044154.984948:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843cfe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1870705580966656:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1784044155.533441:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1784044155.597903:0:13763:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1784044156.560308:0:10330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1784044157.326066:0:13804:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1784044157.581473:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784044157.676612:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044157.676667:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044157.676719:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044157.676758:0:13808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565138432 00000100:00100000:0.0:1784044157.676767:0:13808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565138432 00000100:00100000:0.0:1784044157.676836:0:13808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565138304 00000100:00100000:0.0:1784044157.676840:0:13808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565138304 00000100:00100000:0.0:1784044157.676862:0:13808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 274 00000100:00100000:0.0:1784044157.676874:0:13808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843cff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a93fdf3c-d42f-420a-95ea-b0cbfe954363+5:2409:x1870705565138432:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:0.0:1784044157.676962:0:13808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843cff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a93fdf3c-d42f-420a-95ea-b0cbfe954363+5:2409:x1870705565138432:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 91us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044157.676970:0:13808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 274 00000100:00100000:0.0:1784044157.676987:0:13808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 275 00000100:00100000:0.0:1784044157.676994:0:13808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843cfe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a93fdf3c-d42f-420a-95ea-b0cbfe954363+5:2409:x1870705565138304:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:0.0:1784044157.677019:0:13808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843cfe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a93fdf3c-d42f-420a-95ea-b0cbfe954363+5:2409:x1870705565138304:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 26us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044157.677026:0:13808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 275 00000100:00080000:0.0:1784044157.677042:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1784044157.677046:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1784044157.677668:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565138176 00000100:00100000:3.0:1784044157.677674:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565138176 00000100:00100000:3.0:1784044157.677760:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 402 00000100:00100000:3.0:1784044157.677768:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3965efa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4a09ad9-a185-4679-99bb-b6a07b865440+13:2409:x1870705565138176:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:3.0:1784044157.677797:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3965efa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4a09ad9-a185-4679-99bb-b6a07b865440+13:2409:x1870705565138176:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 31us (1196us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044157.677831:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 402 00000100:00100000:1.0:1784044157.701213:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1784044157.701299:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1784044157.701346:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044157.702752:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565138688 00000100:00100000:2.0:1784044157.702768:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565138688 00000100:00100000:2.0:1784044157.702906:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565138816 00000100:00100000:2.0:1784044157.702910:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565138816 00000100:00100000:2.0:1784044157.702962:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 276 00000100:00100000:2.0:1784044157.702974:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38427b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68dfcea6-5d83-4dbb-8fa3-e35542d621e5+5:2410:x1870705565138688:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:2.0:1784044157.703074:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38427b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68dfcea6-5d83-4dbb-8fa3-e35542d621e5+5:2410:x1870705565138688:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 102us (1773us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044157.703083:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 276 00000100:00100000:2.0:1784044157.703103:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 277 00000100:00100000:2.0:1784044157.703120:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397f9dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68dfcea6-5d83-4dbb-8fa3-e35542d621e5+5:2410:x1870705565138816:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:2.0:1784044157.703145:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397f9dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68dfcea6-5d83-4dbb-8fa3-e35542d621e5+5:2410:x1870705565138816:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 26us (1799us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044157.703151:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 277 00000100:00100000:0.0:1784044157.703732:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565138560 00000100:00080000:1.0:1784044157.703737:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1784044157.703745:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784044157.703767:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565138560 00000100:00100000:0.0:1784044157.703881:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 29 00000100:00100000:0.0:1784044157.703894:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843e0f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+5:2406:x1870705565138560:12345-192.168.202.40@tcp:9:kworker.0 00000020:00000080:0.0:1784044157.703930:0:8427:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x89871fc3aba18176 00000100:00080000:0.0:1784044157.703943:0:8427:0:(import.c:65:import_set_state_nolock()) ffff9b3843e80000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1784044157.704007:0:8427:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967301 00000100:00080000:1.0:1784044157.704070:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1784044157.704101:0:10331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784044157.704268:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843e0f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+2:2406:x1870705565138560:12345-192.168.202.40@tcp:9:kworker.0 Request processed in 376us (3106us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044157.704277:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 29 00000100:00100000:1.0:1784044158.030333:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784044158.030519:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b38435eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1870705580966784:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1784044158.030631:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044158.030991:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580966784 00000100:00100000:0.0:1784044158.031002:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580966784 00000100:00100000:0.0:1784044158.031156:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1784044158.031169:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397f9dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1870705580966784:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1784044158.031229:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1784044158.031302:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397f9dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1870705580966784:12345-0@lo:41:osp-pre-0-1.0 Request processed in 136us (670us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044158.031310:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1784044158.031394:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b38435eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1870705580966784:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1784044158.607995:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784044159.053600:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843c55880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1870705580966912:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784044159.053744:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044159.053776:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b38435eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1870705580967040:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1784044159.053839:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044159.053899:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580967040 00000100:00100000:1.0:1784044159.053947:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580967040 00000100:00100000:1.0:1784044159.054012:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1784044159.054022:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397f9dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1870705580967040:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1784044159.054074:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1784044159.054132:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397f9dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1870705580967040:12345-0@lo:41:osp-pre-1-0.0 Request processed in 111us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044159.054141:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1784044159.054199:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b38435eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1870705580967040:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1784044159.054492:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1784044159.054516:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843c56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1870705580967168:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1784044159.054549:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044159.054581:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580966912 00000100:00100000:2.0:1784044159.054585:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580966912 00000100:00100000:2.0:1784044159.054638:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580967168 00000100:00100000:2.0:1784044159.054641:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580967168 00000100:00100000:2.0:1784044159.054657:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1784044159.054662:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3842706a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1870705580966912:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1784044159.054691:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784044159.054701:0:10713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1784044159.054724:0:10713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843c54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1870705580967168:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1784044159.054731:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3842706a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1870705580966912:12345-0@lo:13:osp-pre-0-0.0 Request processed in 67us (987us total) trans 0 rc 0/0 00002000:00000024:3.0:1784044159.054737:0:10713:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784044159.054741:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1784044159.054779:0:10713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843c54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1870705580967168:12345-0@lo:13:osp-pre-0-1.0 Request processed in 69us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044159.054781:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843c55880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1870705580966912:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784044159.054789:0:10713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1784044159.054829:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843c56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1870705580967168:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1784044159.054966:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1784044159.632541:0:10330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784044160.077682:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397bbbfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1870705580967424:0@lo:400:kworker.0 00000100:00100000:1.0:1784044160.077766:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044160.077834:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1870705580967936:0@lo:400:kworker.0 00000100:00100000:1.0:1784044160.077861:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044160.077887:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3640:1870705580968448:0@lo:400:kworker.0 00000100:00100000:1.0:1784044160.077908:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044160.077933:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1784044160.077938:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397bbbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1870705580967552:0@lo:400:kworker.0 00000100:00100000:1.0:1784044160.077962:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044160.077980:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1870705580968064:0@lo:400:kworker.0 00000100:00100000:1.0:1784044160.077998:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044160.078013:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3640:1870705580968576:0@lo:400:kworker.0 00000100:00100000:1.0:1784044160.078031:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044160.078061:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580967936 00000100:00100000:1.0:1784044160.078068:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580967936 00000100:00100000:3.0:1784044160.078111:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1870705580967680:0@lo:400:kworker.0 00000100:00100000:1.0:1784044160.078111:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580968064 00000100:00100000:1.0:1784044160.078115:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580968064 00000100:00100000:1.0:1784044160.078137:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1784044160.078153:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044160.078210:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d46d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1870705580968192:0@lo:400:kworker.0 00000100:00100000:1.0:1784044160.078220:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38436a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1870705580967936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044160.078239:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044160.078264:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1870705580968704:0@lo:400:kworker.0 00000100:00100000:3.0:1784044160.078293:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044160.078306:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:3.0:1784044160.078313:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b38435eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:3638:1870705580967296:0@lo:400:kworker.0 00000100:00100000:3.0:1784044160.078340:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044160.078362:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d44380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1870705580967808:0@lo:400:kworker.0 00000100:00100000:3.0:1784044160.078386:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044160.078402:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1870705580968320:0@lo:400:kworker.0 00000100:00100000:3.0:1784044160.078421:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044160.078439:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397f944700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1870705580968832:0@lo:400:kworker.0 00000100:00100000:3.0:1784044160.078459:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044160.078484:0:13808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580967424 00000100:00100000:3.0:1784044160.078488:0:13808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580967424 00000100:00100000:3.0:1784044160.078508:0:13808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580968448 00000100:00100000:3.0:1784044160.078511:0:13808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580968448 00000100:00100000:3.0:1784044160.078541:0:13808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580968576 00000100:00100000:3.0:1784044160.078543:0:13808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580968576 00000100:00100000:3.0:1784044160.078557:0:13808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580967680 00000100:00100000:3.0:1784044160.078560:0:13808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580967680 00000100:00100000:3.0:1784044160.078573:0:13808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580968192 00000100:00100000:3.0:1784044160.078575:0:13808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580968192 00000100:00100000:3.0:1784044160.078588:0:13808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580968320 00000100:00100000:3.0:1784044160.078591:0:13808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580968320 00000100:00100000:2.0:1784044160.078609:0:9501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:0.0:1784044160.078693:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580968704 00000100:00100000:0.0:1784044160.078697:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580968704 00000100:00100000:2.0:1784044160.078772:0:9501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38436a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1870705580967424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784044160.078818:0:9501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38436a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1870705580967424:12345-0@lo:400:kworker.0 Request processed in 201us (1051us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044160.078844:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580968832 00000100:00100000:0.0:1784044160.078847:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580968832 00000100:00100000:0.0:1784044160.078861:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1784044160.078867:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397f9ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1870705580968064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784044160.078898:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397f9ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1870705580968064:12345-0@lo:400:kworker.0 Request processed in 31us (900us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044160.078904:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1784044160.078919:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1784044160.078932:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3842707b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1870705580968704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784044160.078960:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3842707b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1870705580968704:12345-0@lo:400:kworker.0 Request processed in 29us (666us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044160.078966:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1784044160.078977:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1784044160.078982:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3842707800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1870705580968832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784044160.079002:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3842707800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1870705580968832:12345-0@lo:400:kworker.0 Request processed in 21us (543us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044160.079008:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00010000:00080000:0.0:1784044160.079037:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b397f944700 x1870705580968832/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784044176 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784044160.079051:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397f944700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1870705580968832:0@lo:400:kworker.0 00010000:00080000:0.0:1784044160.079060:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b3843d46300 x1870705580968704/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784044176 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784044160.079068:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1870705580968704:0@lo:400:kworker.0 00000100:00100000:0.0:1784044160.079089:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397f945180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1870705580968960:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784044160.079111:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044160.079133:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1870705580968064:0@lo:400:kworker.0 00000100:00100000:0.0:1784044160.079143:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397bbbfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1870705580967424:0@lo:400:kworker.0 00000100:00100000:0.0:1784044160.079197:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580967552 00000100:00100000:0.0:1784044160.079200:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580967552 00000100:00100000:3.0:1784044160.079217:0:13808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:0.0:1784044160.079226:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580967808 00000100:00100000:3.0:1784044160.079229:0:13808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38436a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1870705580968448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784044160.079231:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580967808 00000100:00100000:0.0:1784044160.079250:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1784044160.079267:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397f9adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1870705580967552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044160.079278:0:13808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38436a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1870705580968448:12345-0@lo:400:kworker.0 Request processed in 52us (1368us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044160.079286:0:13808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:3.0:1784044160.079300:0:13808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:3.0:1784044160.079306:0:13808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397f9af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1870705580968576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044160.079331:0:13808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397f9af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1870705580968576:12345-0@lo:400:kworker.0 Request processed in 26us (1298us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044160.079336:0:13808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:3.0:1784044160.079346:0:13808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:3.0:1784044160.079351:0:13808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3842707100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1870705580967680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044160.079374:0:13808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3842707100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1870705580967680:12345-0@lo:400:kworker.0 Request processed in 24us (1222us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044160.079388:0:13808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00100000:3.0:1784044160.079399:0:13808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:3.0:1784044160.079404:0:13808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3842705880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1870705580968192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044160.079427:0:13808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3842705880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1870705580968192:12345-0@lo:400:kworker.0 Request processed in 24us (1190us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044160.079432:0:13808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:3.0:1784044160.079441:0:13808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:3.0:1784044160.079445:0:13808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3842704a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1870705580968320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044160.079464:0:13808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3842704a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1870705580968320:12345-0@lo:400:kworker.0 Request processed in 19us (1043us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044160.079469:0:13808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:3.0:1784044160.079486:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580967296 00000100:00100000:3.0:1784044160.079489:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580967296 00000100:00100000:3.0:1784044160.079510:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 403 00000100:00100000:3.0:1784044160.079514:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3950377450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+24:3638:x1870705580967296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044160.079537:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3950377450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+24:3638:x1870705580967296:12345-0@lo:400:kworker.0 Request processed in 23us (1197us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044160.079542:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 403 00000100:00100000:3.0:1784044160.079569:0:7768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1784044160.079575:0:7768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3842704700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1870705580967808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044160.079601:0:7768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3842704700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1870705580967808:12345-0@lo:400:kworker.0 Request processed in 27us (1214us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044160.079607:0:7768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1784044160.080400:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b38435eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:3638:1870705580967296:0@lo:400:kworker.0 00000100:00100000:3.0:1784044160.080427:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d44380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1870705580967808:0@lo:400:kworker.0 00010000:00080000:3.0:1784044160.080439:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b3843d45f80 x1870705580968320/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044176 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784044160.080448:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1870705580968320:0@lo:400:kworker.0 00000100:00100000:3.0:1784044160.080459:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1870705580967680:0@lo:400:kworker.0 00000100:00100000:3.0:1784044160.080469:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d46d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1870705580968192:0@lo:400:kworker.0 00010000:00080000:3.0:1784044160.080507:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b3843d44a80 x1870705580968576/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044176 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784044160.080515:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3640:1870705580968576:0@lo:400:kworker.0 00000100:00100000:3.0:1784044160.080527:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3640:1870705580968448:0@lo:400:kworker.0 00000100:00100000:3.0:1784044160.080640:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3842707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1870705580969088:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1784044160.080678:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044160.080710:0:10713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580968960 00000100:00100000:3.0:1784044160.080714:0:10713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580968960 00000100:00100000:3.0:1784044160.080744:0:10713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580969088 00000100:00100000:3.0:1784044160.080746:0:10713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580969088 00000100:00100000:3.0:1784044160.080756:0:10713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1784044160.080761:0:10713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397f944700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1870705580968960:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1784044160.080784:0:10713:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784044160.080826:0:10713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397f944700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1870705580968960:12345-0@lo:13:osp-pre-1-0.0 Request processed in 64us (1713us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044160.080832:0:10713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1784044160.080845:0:10713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1784044160.080858:0:10713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38435eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1870705580969088:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1784044160.080869:0:10713:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784044160.080898:0:10713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38435eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1870705580969088:12345-0@lo:13:osp-pre-1-1.0 Request processed in 40us (220us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044160.080904:0:10713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00010000:00080000:3.0:1784044160.080926:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b3842707480 x1870705580969088/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784044176 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784044160.080939:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3842707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1870705580969088:0@lo:13:osp-pre-1-1.0 00010000:00080000:3.0:1784044160.080959:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b397f945180 x1870705580968960/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784044176 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784044160.080969:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397f945180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1870705580968960:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1784044160.081001:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1784044160.081006:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1784044160.081008:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784044160.083439:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38436a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1870705580967936:12345-0@lo:400:kworker.0 Request processed in 5211us (5566us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044160.083454:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1784044160.083878:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397f9adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1870705580967552:12345-0@lo:400:kworker.0 Request processed in 4611us (5912us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044160.083889:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1784044160.086552:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397bbbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1870705580967552:0@lo:400:kworker.0 00000100:00100000:3.0:1784044160.086573:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1870705580967936:0@lo:400:kworker.0 00000100:00100000:2.0:1784044160.090576:0:9501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00010000:00010000:0.0:1784044160.656845:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784044161.678456:0:10331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784044162.701545:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784044162.792326:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1784044162.792402:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1784044162.792451:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044162.792663:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565139072 00000100:00100000:2.0:1784044162.792679:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565139072 00000100:00100000:0.0:1784044162.792690:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565138944 00000100:00100000:0.0:1784044162.792702:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565138944 00000100:00100000:2.0:1784044162.792813:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565139328 00000100:00100000:0.0:1784044162.792822:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 404 00000100:00100000:2.0:1784044162.792823:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565139328 00000100:00100000:0.0:1784044162.792860:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3950374050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4a09ad9-a185-4679-99bb-b6a07b865440+13:2410:x1870705565138944:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:2.0:1784044162.792874:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 284 00000100:00100000:2.0:1784044162.792887:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397f9ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+5:2409:x1870705565139072:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:0.0:1784044162.792977:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3950374050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4a09ad9-a185-4679-99bb-b6a07b865440+13:2410:x1870705565138944:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 137us (571us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044162.792988:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397f9ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+5:2409:x1870705565139072:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 100us (679us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044162.792990:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 404 00000100:00100000:2.0:1784044162.793006:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 284 00000100:00100000:2.0:1784044162.793036:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 285 00000100:00100000:2.0:1784044162.793045:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3975b89f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68dfcea6-5d83-4dbb-8fa3-e35542d621e5+5:2409:x1870705565139328:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:2.0:1784044162.793075:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3975b89f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68dfcea6-5d83-4dbb-8fa3-e35542d621e5+5:2409:x1870705565139328:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 32us (625us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044162.793103:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 285 00000100:00080000:1.0:1784044162.793454:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784044162.794528:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044162.794584:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044162.794676:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565139200 00000100:00100000:3.0:1784044162.794686:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565139200 00000100:00100000:3.0:1784044162.794760:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565139456 00000100:00100000:3.0:1784044162.794773:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565139456 00000100:00100000:3.0:1784044162.794803:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 286 00000100:00100000:3.0:1784044162.794812:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843c56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+5:2410:x1870705565139200:12345-192.168.202.40@tcp:400:kworker.0 00000100:00080000:1.0:1784044162.794945:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1784044162.794981:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 287 00000100:00100000:1.0:1784044162.794992:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843c55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68dfcea6-5d83-4dbb-8fa3-e35542d621e5+5:2410:x1870705565139456:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:1.0:1784044162.795056:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843c55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68dfcea6-5d83-4dbb-8fa3-e35542d621e5+5:2410:x1870705565139456:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 68us (471us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044162.795064:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 287 00000100:00100000:3.0:1784044162.795722:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843c56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+5:2410:x1870705565139200:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 908us (1471us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044162.795731:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 286 00000100:00100000:2.0:1784044163.150560:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1784044163.150620:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397f944a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1870705580969216:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1784044163.150958:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044163.151050:0:7768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580969216 00000100:00100000:3.0:1784044163.151156:0:7768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580969216 00000100:00100000:3.0:1784044163.151255:0:7768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1784044163.151266:0:7768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843c54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1870705580969216:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1784044163.151317:0:7768:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1784044163.151387:0:7768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843c54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1870705580969216:12345-0@lo:41:osp-pre-0-1.0 Request processed in 122us (433us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044163.151395:0:7768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1784044163.151770:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397f944a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1870705580969216:0@lo:41:osp-pre-0-1.0 00000001:00100000:2.0:1784044163.663518:0:8421:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of a93fdf3c-d42f-420a-95ea-b0cbfe954363 00000020:00000080:2.0:1784044163.663527:0:8421:0:(genops.c:906:class_export_put()) final put ffff9b384345d000/a93fdf3c-d42f-420a-95ea-b0cbfe954363 00000020:00000080:1.0:1784044163.663663:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9b384345d000/a93fdf3c-d42f-420a-95ea-b0cbfe954363 for lustre-OST0000 00000020:00000080:1.0:1784044163.663745:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9b3843e80000 for lustre-OST0000 00010000:00010000:1.0:1784044163.725427:0:10330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784044164.173522:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784044164.173554:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397f944000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1870705580969344:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1784044164.173628:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044164.173869:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843c55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1870705580969472:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784044164.173902:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044164.173980:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784044164.173990:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3975b8a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1870705580969600:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1784044164.174017:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044164.174146:0:10713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580969472 00000100:00100000:3.0:1784044164.174155:0:10713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580969472 00000100:00100000:3.0:1784044164.174235:0:10713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580969600 00000100:00100000:3.0:1784044164.174239:0:10713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580969600 00000100:00100000:3.0:1784044164.174258:0:10713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1784044164.174266:0:10713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843c56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1870705580969472:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1784044164.174344:0:10713:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784044164.174389:0:10713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843c56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1870705580969472:12345-0@lo:13:osp-pre-0-0.0 Request processed in 123us (485us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044164.174396:0:10713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1784044164.174414:0:10713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1784044164.174421:0:10713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3975b88380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1870705580969600:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1784044164.174433:0:10713:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784044164.174456:0:10713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3975b88380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1870705580969600:12345-0@lo:13:osp-pre-0-1.0 Request processed in 36us (438us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044164.174462:0:10713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1784044164.174530:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3975b8a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1870705580969600:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1784044164.174788:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843c55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1870705580969472:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1784044164.174904:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784044164.175072:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580969344 00000100:00100000:0.0:1784044164.175079:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580969344 00000100:00100000:0.0:1784044164.175118:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1784044164.175125:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3842707480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1870705580969344:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1784044164.175162:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1784044164.175235:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3842707480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1870705580969344:12345-0@lo:41:osp-pre-1-0.0 Request processed in 110us (1606us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044164.175241:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1784044164.175362:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397f944000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1870705580969344:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1784044164.752302:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784044165.197583:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843c55500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:3638:1870705580969728:0@lo:400:kworker.0 00000100:00100000:2.0:1784044165.197661:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044165.197706:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3947eeb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1870705580970240:0@lo:400:kworker.0 00000100:00100000:2.0:1784044165.197733:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044165.197766:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3947ee8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1870705580970752:0@lo:400:kworker.0 00000100:00100000:2.0:1784044165.197787:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044165.197804:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3947eeb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1870705580971264:0@lo:400:kworker.0 00000100:00100000:2.0:1784044165.197825:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044165.197849:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1784044165.197855:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843c55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1870705580969856:0@lo:400:kworker.0 00000100:00100000:2.0:1784044165.197874:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044165.197889:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3947eea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1870705580970368:0@lo:400:kworker.0 00000100:00100000:2.0:1784044165.197917:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044165.197932:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3947ee9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3638:1870705580970880:0@lo:400:kworker.0 00000100:00100000:2.0:1784044165.197950:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044165.197992:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3947eeaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1870705580969984:0@lo:400:kworker.0 00000100:00100000:2.0:1784044165.198015:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044165.198031:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3947eebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1870705580970496:0@lo:400:kworker.0 00000100:00100000:2.0:1784044165.198060:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044165.198080:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3947ee8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3640:1870705580971008:0@lo:400:kworker.0 00000100:00100000:2.0:1784044165.198115:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044165.198133:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1784044165.198138:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3947ee8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1870705580970112:0@lo:400:kworker.0 00000100:00100000:2.0:1784044165.198160:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044165.198199:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3947ee9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3640:1870705580970624:0@lo:400:kworker.0 00000100:00100000:2.0:1784044165.198223:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044165.198234:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3947ee8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1870705580971136:0@lo:400:kworker.0 00000100:00100000:2.0:1784044165.198252:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044165.198285:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580969728 00000100:00100000:2.0:1784044165.198294:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580969728 00000100:00100000:2.0:1784044165.198341:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 405 00000100:00100000:2.0:1784044165.198350:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3950375450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+24:3638:x1870705580969728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784044165.198398:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3950375450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+24:3638:x1870705580969728:12345-0@lo:400:kworker.0 Request processed in 49us (737us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044165.198406:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 405 00000100:00100000:2.0:1784044165.198438:0:7768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580970240 00000100:00100000:2.0:1784044165.198442:0:7768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580970240 00000100:00100000:2.0:1784044165.198472:0:7768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580969984 00000100:00100000:2.0:1784044165.198475:0:7768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580969984 00000100:00100000:2.0:1784044165.198489:0:7768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1784044165.198494:0:7768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3947ee9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1870705580970240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784044165.198528:0:7768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3947ee9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1870705580970240:12345-0@lo:400:kworker.0 Request processed in 34us (794us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044165.198535:0:7768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1784044165.198547:0:7768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1784044165.198552:0:7768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3947ee9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1870705580969984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784044165.198583:0:7768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3947ee9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1870705580969984:12345-0@lo:400:kworker.0 Request processed in 30us (566us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044165.198589:0:7768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1784044165.198610:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580970752 00000100:00100000:2.0:1784044165.198615:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580970752 00000100:00100000:2.0:1784044165.198646:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580969856 00000100:00100000:2.0:1784044165.198649:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580969856 00000100:00100000:2.0:1784044165.198658:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580970880 00000100:00100000:2.0:1784044165.198660:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580970880 00000100:00100000:2.0:1784044165.198673:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580971008 00000100:00100000:2.0:1784044165.198675:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580971008 00000100:00100000:2.0:1784044165.198688:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580970112 00000100:00100000:2.0:1784044165.198691:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580970112 00000100:00100000:2.0:1784044165.198702:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580970624 00000100:00100000:2.0:1784044165.198704:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580970624 00000100:00100000:2.0:1784044165.198719:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:2.0:1784044165.198726:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3947eead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1870705580970752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784044165.198771:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3947eead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1870705580970752:12345-0@lo:400:kworker.0 Request processed in 45us (982us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044165.198777:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:2.0:1784044165.198797:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:2.0:1784044165.198803:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3947eeb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1870705580969856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784044165.198831:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3947eeb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1870705580969856:12345-0@lo:400:kworker.0 Request processed in 29us (956us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044165.198837:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:2.0:1784044165.198848:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:2.0:1784044165.198853:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3947eea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1870705580970880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784044165.198879:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3947eea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1870705580970880:12345-0@lo:400:kworker.0 Request processed in 25us (927us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044165.198885:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00100000:2.0:1784044165.198896:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:2.0:1784044165.198902:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39412ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1870705580971008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784044165.198930:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39412ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1870705580971008:12345-0@lo:400:kworker.0 Request processed in 29us (815us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044165.198936:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00100000:2.0:1784044165.198948:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:2.0:1784044165.198954:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39412e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1870705580970112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784044165.198979:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39412e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1870705580970112:12345-0@lo:400:kworker.0 Request processed in 26us (818us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044165.198985:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00100000:2.0:1784044165.198997:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:2.0:1784044165.199003:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39412eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1870705580970624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784044165.199030:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39412eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1870705580970624:12345-0@lo:400:kworker.0 Request processed in 27us (806us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044165.199036:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00100000:2.0:1784044165.199067:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580971264 00000100:00100000:2.0:1784044165.199072:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580971264 00000100:00100000:2.0:1784044165.199094:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580970368 00000100:00100000:2.0:1784044165.199097:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580970368 00000100:00100000:2.0:1784044165.199108:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580970496 00000100:00100000:2.0:1784044165.199111:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580970496 00000100:00100000:2.0:1784044165.199121:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580971136 00000100:00100000:2.0:1784044165.199124:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580971136 00000100:00100000:2.0:1784044165.199138:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1784044165.199145:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3947ee9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1870705580971264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784044165.199210:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3947ee9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1870705580971264:12345-0@lo:400:kworker.0 Request processed in 65us (1383us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044165.199216:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1784044165.199227:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1784044165.199233:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3947ee8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1870705580970368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784044165.199261:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3947ee8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1870705580970368:12345-0@lo:400:kworker.0 Request processed in 28us (1343us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044165.199267:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1784044165.199278:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1784044165.199283:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39412e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1870705580970496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784044165.199307:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39412e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1870705580970496:12345-0@lo:400:kworker.0 Request processed in 25us (1247us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044165.199313:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1784044165.199323:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1784044165.199329:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39412e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1870705580971136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784044165.199353:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39412e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1870705580971136:12345-0@lo:400:kworker.0 Request processed in 25us (1100us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044165.199369:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1784044165.199446:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843c55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1870705580969856:0@lo:400:kworker.0 00000100:00100000:2.0:1784044165.199459:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3947eea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1870705580970368:0@lo:400:kworker.0 00000100:00100000:2.0:1784044165.199469:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3947ee9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3638:1870705580970880:0@lo:400:kworker.0 00000100:00100000:2.0:1784044165.199479:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843c55500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:3638:1870705580969728:0@lo:400:kworker.0 00000100:00100000:2.0:1784044165.199489:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3947eeb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1870705580970240:0@lo:400:kworker.0 00010000:00080000:2.0:1784044165.199502:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b3947ee8700 x1870705580970752/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044181 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784044165.199512:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3947ee8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1870705580970752:0@lo:400:kworker.0 00010000:00080000:2.0:1784044165.199523:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b3947eeb800 x1870705580971264/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784044181 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784044165.199531:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3947eeb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1870705580971264:0@lo:400:kworker.0 00000100:00100000:2.0:1784044165.199580:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3947ee8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1870705580970112:0@lo:400:kworker.0 00000100:00100000:2.0:1784044165.199591:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3947ee9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3640:1870705580970624:0@lo:400:kworker.0 00010000:00080000:2.0:1784044165.199600:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b3947ee8000 x1870705580971136/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784044181 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784044165.199608:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3947ee8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1870705580971136:0@lo:400:kworker.0 00000100:00100000:2.0:1784044165.199620:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3947eeaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1870705580969984:0@lo:400:kworker.0 00000100:00100000:2.0:1784044165.199629:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3947eebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1870705580970496:0@lo:400:kworker.0 00010000:00080000:2.0:1784044165.199651:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b3947ee8a80 x1870705580971008/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044181 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784044165.199661:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3947ee8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3640:1870705580971008:0@lo:400:kworker.0 00000100:00080000:2.0:1784044165.199689:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1784044165.199693:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1784044165.199695:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1784044165.205778:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397aa55f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1870705580971392:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1784044165.205861:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044165.205923:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1784044165.205932:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39412eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1870705580971520:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784044165.205957:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044165.208210:0:10713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580971392 00000100:00100000:2.0:1784044165.208221:0:10713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580971392 00000100:00100000:2.0:1784044165.208424:0:10713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580971520 00000100:00100000:2.0:1784044165.208429:0:10713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580971520 00000100:00100000:2.0:1784044165.208450:0:10713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1784044165.208461:0:10713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39412ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1870705580971392:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1784044165.208499:0:10713:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784044165.208572:0:10713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39412ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1870705580971392:12345-0@lo:13:osp-pre-1-1.0 Request processed in 112us (2710us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044165.208580:0:10713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1784044165.208597:0:10713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1784044165.208602:0:10713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39412ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1870705580971520:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1784044165.208611:0:10713:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784044165.208639:0:10713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39412ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1870705580971520:12345-0@lo:13:osp-pre-1-0.0 Request processed in 36us (2680us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044165.208662:0:10713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00010000:00080000:2.0:1784044165.208717:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b397aa55f80 x1870705580971392/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784044181 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784044165.208776:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397aa55f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1870705580971392:0@lo:13:osp-pre-1-1.0 00010000:00080000:2.0:1784044165.208812:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b39412eb480 x1870705580971520/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784044181 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784044165.208825:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39412eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1870705580971520:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1784044165.781153:0:10331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1784044165.838918:0:13763:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1784044166.797444:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1784044167.567253:0:13804:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1784044167.821376:0:10330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784044167.911287:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044167.911410:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044167.911436:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044167.911453:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044167.911473:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044167.911500:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565139840 00000100:00100000:0.0:1784044167.911523:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565139840 00000100:00100000:0.0:1784044167.911730:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565140096 00000100:00100000:0.0:1784044167.911734:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565140096 00000100:00100000:0.0:1784044167.911754:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565139712 00000100:00100000:0.0:1784044167.911757:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565139712 00000100:00100000:0.0:1784044167.911769:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565139968 00000100:00100000:0.0:1784044167.911771:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565139968 00000100:00100000:0.0:1784044167.911788:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 294 00000100:00100000:0.0:1784044167.911798:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397f947800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+5:2409:x1870705565139840:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:0.0:1784044167.911891:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397f947800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+5:2409:x1870705565139840:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 94us (481us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044167.911899:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 294 00000100:00100000:0.0:1784044167.911919:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 295 00000100:00100000:0.0:1784044167.911925:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397f945880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68dfcea6-5d83-4dbb-8fa3-e35542d621e5+5:2409:x1870705565140096:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:0.0:1784044167.911950:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397f945880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68dfcea6-5d83-4dbb-8fa3-e35542d621e5+5:2409:x1870705565140096:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 25us (514us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044167.911955:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 295 00000100:00100000:0.0:1784044167.911966:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 296 00000100:00100000:0.0:1784044167.911971:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397f946d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+5:2409:x1870705565139712:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:0.0:1784044167.911995:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397f946d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+5:2409:x1870705565139712:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 24us (542us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044167.912001:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 296 00000100:00100000:0.0:1784044167.912012:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 297 00000100:00100000:0.0:1784044167.912017:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397f945500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68dfcea6-5d83-4dbb-8fa3-e35542d621e5+5:2409:x1870705565139968:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:0.0:1784044167.912039:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397f945500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68dfcea6-5d83-4dbb-8fa3-e35542d621e5+5:2409:x1870705565139968:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 22us (566us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044167.912054:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 297 00000100:00080000:0.0:1784044167.912081:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1784044167.912085:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1784044167.919832:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565139584 00000100:00100000:1.0:1784044167.919851:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565139584 00000100:00100000:2.0:1784044167.920001:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 406 00000100:00100000:2.0:1784044167.920013:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3950376450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4a09ad9-a185-4679-99bb-b6a07b865440+13:2409:x1870705565139584:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:2.0:1784044167.920102:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3950376450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4a09ad9-a185-4679-99bb-b6a07b865440+13:2409:x1870705565139584:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 91us (8826us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044167.920110:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 406 00000100:00100000:1.0:1784044168.271750:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784044168.271779:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397f947100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1870705580971648:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1784044168.271919:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044168.272063:0:7768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580971648 00000100:00100000:2.0:1784044168.272074:0:7768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580971648 00000100:00100000:2.0:1784044168.279588:0:7768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1784044168.279613:0:7768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3975b8a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1870705580971648:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1784044168.279657:0:7768:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1784044168.279780:0:7768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3975b8a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1870705580971648:12345-0@lo:41:osp-pre-0-1.0 Request processed in 179us (7861us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044168.279788:0:7768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1784044168.280294:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397f947100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1870705580971648:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1784044168.845371:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784044169.293563:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1784044169.293624:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39412eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1870705580971776:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784044169.293753:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044169.293823:0:10713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580971776 00000100:00100000:2.0:1784044169.293830:0:10713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580971776 00000100:00100000:2.0:1784044169.293877:0:10713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1784044169.293887:0:10713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39412e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1870705580971776:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1784044169.293916:0:10713:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784044169.293954:0:10713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39412e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1870705580971776:12345-0@lo:13:osp-pre-0-0.0 Request processed in 69us (201us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044169.293961:0:10713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1784044169.294002:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39412eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1870705580971776:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1784044169.294255:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784044169.294472:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784044169.294485:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397f944380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1870705580971904:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1784044169.294517:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044169.295807:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580971904 00000100:00100000:0.0:1784044169.295818:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580971904 00000100:00100000:0.0:1784044169.295877:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1784044169.295886:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397aa54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1870705580971904:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1784044169.295920:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1784044169.295997:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397aa54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1870705580971904:12345-0@lo:41:osp-pre-1-0.0 Request processed in 112us (1478us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044169.296004:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1784044169.296108:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397f944380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1870705580971904:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1784044169.296637:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843cafb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1870705580972032:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1784044169.296676:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044169.296763:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580972032 00000100:00100000:2.0:1784044169.296769:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580972032 00000100:00100000:2.0:1784044169.296810:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1784044169.296818:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397aa55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1870705580972032:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1784044169.296834:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00080000:0.0:1784044169.296899:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784044169.322631:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397aa55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1870705580972032:12345-0@lo:13:osp-pre-0-1.0 Request processed in 25802us (25943us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044169.322649:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1784044169.325107:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843cafb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1870705580972032:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1784044169.869743:0:10331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784044170.318559:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397f945c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3639:1870705580972416:0@lo:400:kworker.0 00000100:00100000:0.0:1784044170.318636:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044170.318705:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397f946300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1870705580972928:0@lo:400:kworker.0 00000100:00100000:0.0:1784044170.318736:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044170.318762:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397f947100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3639:1870705580973440:0@lo:400:kworker.0 00000100:00100000:0.0:1784044170.318784:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044170.318814:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:0.0:1784044170.318820:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397f946680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:3639:1870705580972288:0@lo:400:kworker.0 00000100:00100000:0.0:1784044170.318848:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044170.318872:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397f947480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1870705580972800:0@lo:400:kworker.0 00000100:00100000:0.0:1784044170.318899:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044170.318942:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397f944380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3639:1870705580973312:0@lo:400:kworker.0 00000100:00100000:0.0:1784044170.318966:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044170.318984:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397f945180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1870705580973824:0@lo:400:kworker.0 00000100:00100000:0.0:1784044170.319005:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044170.319040:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580972416 00000100:00100000:0.0:1784044170.319048:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580972416 00000100:00100000:0.0:1784044170.319101:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 298 00000100:00100000:0.0:1784044170.319111:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397bbbc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1870705580972416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784044170.319166:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397bbbc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1870705580972416:12345-0@lo:400:kworker.0 Request processed in 56us (530us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044170.319209:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 298 00000100:00100000:0.0:1784044170.319230:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580973440 00000100:00100000:0.0:1784044170.319233:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580973440 00000100:00100000:0.0:1784044170.319263:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580973312 00000100:00100000:0.0:1784044170.319266:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580973312 00000100:00100000:0.0:1784044170.319285:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299 00000100:00100000:0.0:1784044170.319291:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1870705580973440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784044170.319320:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1870705580973440:12345-0@lo:400:kworker.0 Request processed in 30us (535us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044170.319327:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299 00000100:00100000:0.0:1784044170.319339:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 300 00000100:00100000:0.0:1784044170.319345:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1870705580973312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784044170.319372:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1870705580973312:12345-0@lo:400:kworker.0 Request processed in 27us (404us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044170.319378:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 300 00000100:00100000:0.0:1784044170.319395:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580972928 00000100:00100000:0.0:1784044170.319399:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580972928 00000100:00100000:0.0:1784044170.319431:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580973824 00000100:00100000:0.0:1784044170.319434:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580973824 00000100:00100000:0.0:1784044170.319455:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1784044170.319462:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397bbbfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1870705580972928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784044170.319492:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397bbbfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1870705580972928:12345-0@lo:400:kworker.0 Request processed in 30us (755us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044170.319498:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1784044170.319508:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1784044170.319514:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d46d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1870705580973824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784044170.319542:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d46d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1870705580973824:12345-0@lo:400:kworker.0 Request processed in 27us (535us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044170.319547:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1784044170.319581:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580972288 00000100:00100000:0.0:1784044170.319584:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580972288 00000100:00100000:0.0:1784044170.319611:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 407 00000100:00100000:0.0:1784044170.319619:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3950377c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+24:3639:x1870705580972288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784044170.319649:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3950377c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+24:3639:x1870705580972288:12345-0@lo:400:kworker.0 Request processed in 31us (800us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044170.319655:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 407 00000100:00100000:0.0:1784044170.319686:0:7768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580972800 00000100:00100000:0.0:1784044170.319690:0:7768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580972800 00000100:00100000:0.0:1784044170.319729:0:7768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1784044170.319736:0:7768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1870705580972800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784044170.319769:0:7768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1870705580972800:12345-0@lo:400:kworker.0 Request processed in 33us (869us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044170.319776:0:7768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00080000:0.0:1784044170.319803:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784044170.319814:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1784044170.319817:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784044170.319860:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397f946680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:3639:1870705580972288:0@lo:400:kworker.0 00000100:00100000:0.0:1784044170.319875:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397f947480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1870705580972800:0@lo:400:kworker.0 00010000:00080000:0.0:1784044170.319888:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b397f944380 x1870705580973312/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044186 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784044170.319900:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397f944380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3639:1870705580973312:0@lo:400:kworker.0 00010000:00080000:0.0:1784044170.319912:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b397f945180 x1870705580973824/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784044186 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784044170.319920:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397f945180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1870705580973824:0@lo:400:kworker.0 00000100:00100000:0.0:1784044170.319931:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397f945c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3639:1870705580972416:0@lo:400:kworker.0 00000100:00100000:0.0:1784044170.319941:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397f946300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1870705580972928:0@lo:400:kworker.0 00000100:00100000:0.0:1784044170.319951:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397f947100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3639:1870705580973440:0@lo:400:kworker.0 00000100:00100000:3.0:1784044170.320391:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397f946a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1870705580972544:0@lo:400:kworker.0 00000100:00100000:3.0:1784044170.320439:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044170.320465:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397f947b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1870705580973056:0@lo:400:kworker.0 00000100:00100000:3.0:1784044170.320487:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044170.320504:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397f944000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3640:1870705580973568:0@lo:400:kworker.0 00000100:00100000:3.0:1784044170.320523:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044170.320542:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:3.0:1784044170.320548:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39412eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1870705580972160:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784044170.320569:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044170.320587:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397f944e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1870705580972672:0@lo:400:kworker.0 00000100:00100000:3.0:1784044170.320608:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044170.320633:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397f945f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3640:1870705580973184:0@lo:400:kworker.0 00000100:00100000:3.0:1784044170.320653:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044170.320669:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397f944a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1870705580973696:0@lo:400:kworker.0 00000100:00100000:3.0:1784044170.320687:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044170.320726:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580972544 00000100:00100000:3.0:1784044170.320730:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580972544 00000100:00100000:3.0:1784044170.320762:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1784044170.320768:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397aa54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1870705580972544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044170.320807:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397aa54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1870705580972544:12345-0@lo:400:kworker.0 Request processed in 39us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044170.320813:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1784044170.320832:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580972160 00000100:00100000:3.0:1784044170.320835:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580972160 00000100:00100000:3.0:1784044170.320856:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1784044170.320862:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397aa55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1870705580972160:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1784044170.320882:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784044170.320912:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397aa55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1870705580972160:12345-0@lo:13:osp-pre-1-0.0 Request processed in 49us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044170.320918:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1784044170.320937:0:9822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580973056 00000100:00100000:3.0:1784044170.320940:0:9822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580973056 00000100:00100000:3.0:1784044170.320959:0:9822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580973696 00000100:00100000:3.0:1784044170.320961:0:9822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580973696 00000100:00100000:3.0:1784044170.320983:0:9822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1784044170.320989:0:9822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397aa54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3640:x1870705580973056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044170.321014:0:9822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397aa54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3640:x1870705580973056:12345-0@lo:400:kworker.0 Request processed in 26us (527us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044170.321029:0:9822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1784044170.321039:0:9822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1784044170.321044:0:9822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3975b7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3640:x1870705580973696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044170.321072:0:9822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3975b7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3640:x1870705580973696:12345-0@lo:400:kworker.0 Request processed in 28us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044170.321078:0:9822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1784044170.321099:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580973568 00000100:00100000:3.0:1784044170.321103:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580973568 00000100:00100000:3.0:1784044170.321126:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580972672 00000100:00100000:3.0:1784044170.321129:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580972672 00000100:00100000:3.0:1784044170.321143:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580973184 00000100:00100000:3.0:1784044170.321146:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580973184 00000100:00100000:3.0:1784044170.321161:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301 00000100:00100000:3.0:1784044170.321166:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397aa54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1870705580973568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044170.321222:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397aa54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1870705580973568:12345-0@lo:400:kworker.0 Request processed in 55us (696us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044170.321228:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301 00000100:00100000:3.0:1784044170.321242:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:3.0:1784044170.321247:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397aa55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1870705580972672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044170.321271:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397aa55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1870705580972672:12345-0@lo:400:kworker.0 Request processed in 24us (662us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044170.321276:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00000100:00100000:3.0:1784044170.321287:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:3.0:1784044170.321292:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397aa55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1870705580973184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044170.321315:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397aa55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1870705580973184:12345-0@lo:400:kworker.0 Request processed in 22us (660us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044170.321329:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00000100:00080000:3.0:1784044170.321353:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1784044170.321357:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1784044170.321359:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1784044170.321387:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b39412eb480 x1870705580972160/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784044186 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784044170.321404:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39412eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1870705580972160:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784044170.321416:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397f944e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1870705580972672:0@lo:400:kworker.0 00000100:00100000:3.0:1784044170.321425:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397f945f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3640:1870705580973184:0@lo:400:kworker.0 00010000:00080000:3.0:1784044170.321433:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b397f944a80 x1870705580973696/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784044186 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784044170.321441:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397f944a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1870705580973696:0@lo:400:kworker.0 00000100:00100000:3.0:1784044170.321450:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397f946a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1870705580972544:0@lo:400:kworker.0 00000100:00100000:3.0:1784044170.321459:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397f947b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1870705580973056:0@lo:400:kworker.0 00010000:00080000:3.0:1784044170.321467:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b397f944000 x1870705580973568/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044186 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784044170.321474:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397f944000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3640:1870705580973568:0@lo:400:kworker.0 00000100:00100000:2.0:1784044170.323598:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784044170.323627:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397aa57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1870705580973952:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1784044170.323712:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044170.324774:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580973952 00000100:00100000:3.0:1784044170.324786:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580973952 00000100:00100000:3.0:1784044170.324841:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1784044170.324851:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39412e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1870705580973952:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1784044170.324878:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784044170.324952:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39412e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1870705580973952:12345-0@lo:13:osp-pre-1-1.0 Request processed in 102us (1239us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044170.324958:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00010000:00080000:2.0:1784044170.324968:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b397aa57800 x1870705580973952/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784044186 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784044170.324990:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397aa57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1870705580973952:0@lo:13:osp-pre-1-1.0 00000001:02000400:2.0:1784044170.633015:0:14063:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 11:49:28 (1784044168) 00010000:00010000:2.0:1784044170.894746:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784044171.918616:0:10330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784044172.499245:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044172.499468:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565140224 00000100:00100000:3.0:1784044172.499480:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565140224 00000100:00100000:3.0:1784044172.499626:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 40 00000100:00100000:3.0:1784044172.499640:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+5:11095:x1870705565140224:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1784044172.499671:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00080000:0.0:1784044172.499804:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1784044172.499891:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b39759f9400/0x89871fc3aba1828e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcd3dffad52ca6646 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044172.499989:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b39759f9c00/0x89871fc3aba18295 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044172.500004:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b39759f9c00/0x89871fc3aba18295 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044172.500019:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b39759f9c00/0x89871fc3aba18295 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784044172.500114:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1784044172.500119:0:6511:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1784044172.500157:0:6511:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b39759f9c00/0x89871fc3aba18295 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044172.500263:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b39759f9400/0x89871fc3aba1828e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6646 expref: 7 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044172.500286:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b39759f9c00/0x89871fc3aba18295 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6646 expref: 6 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044172.500315:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b396f2a8000) 00010000:00010000:3.0:1784044172.500319:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1784044172.500322:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b39759f9c00, rc 0) 00000100:00100000:3.0:1784044172.500395:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+6:11095:x1870705565140224:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 Request processed in 758us (1225us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044172.500405:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 40 00000100:00100000:1.0:1784044172.509307:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044172.509477:0:9501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565140352 00000100:00100000:3.0:1784044172.509491:0:9501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565140352 00000100:00100000:3.0:1784044172.509578:0:9501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 41 00000100:00100000:3.0:1784044172.509590:0:9501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843caed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a93fdf3c-d42f-420a-95ea-b0cbfe954363+6:11096:x1870705565140352:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1784044172.509618:0:9501:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784044172.509645:0:9501:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b39759f9400/0x89871fc3aba1829c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcd3dffad52ca664d expref: -99 pid: 9501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044172.509741:0:9501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b39759f9e00/0x89871fc3aba182a3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044172.509758:0:9501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b39759f9e00/0x89871fc3aba182a3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044172.509773:0:9501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b39759f9e00/0x89871fc3aba182a3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044172.509790:0:9501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b39759f8800/0x89871fc3aba182aa lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044172.509798:0:9501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b39759f8800/0x89871fc3aba182aa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044172.509823:0:9501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b39759f8800/0x89871fc3aba182aa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044172.509903:0:9501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b39759f8000/0x89871fc3aba182b1 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044172.509911:0:9501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b39759f8000/0x89871fc3aba182b1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044172.509918:0:9501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b39759f8000/0x89871fc3aba182b1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784044172.511248:0:9501:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1784044172.511258:0:9501:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1784044172.511391:0:9501:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b39759f8000/0x89871fc3aba182b1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044172.511411:0:9501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b39759f9e00/0x89871fc3aba182a3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044172.511499:0:9501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b39759f9e00/0x89871fc3aba182a3 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044172.511507:0:9501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b39759f9e00/0x89871fc3aba182a3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044172.511514:0:9501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b39759f9e00 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:2.0:1784044172.511519:0:9501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b39759f9e00/0x89871fc3aba182a3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044172.511527:0:9501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b39759f9e00/0x89871fc3aba182a3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044172.511548:0:9501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b396f2a8000) 00010000:00010000:2.0:1784044172.511551:0:9501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784044172.511555:0:9501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b39759f9e00/0x89871fc3aba182a3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044172.511562:0:9501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b39759f9e00/0x89871fc3aba182a3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044172.511584:0:9501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b39759f8800/0x89871fc3aba182aa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044172.511590:0:9501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b39759f8800/0x89871fc3aba182aa lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044172.511613:0:9501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b39759f8800/0x89871fc3aba182aa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044172.511618:0:9501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b39759f8800 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:2.0:1784044172.511621:0:9501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b39759f8800/0x89871fc3aba182aa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044172.511627:0:9501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b39759f8800/0x89871fc3aba182aa lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044172.511635:0:9501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9b396f2a8c00) 00010000:00010000:2.0:1784044172.511637:0:9501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784044172.511640:0:9501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b39759f8800/0x89871fc3aba182aa lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044172.511646:0:9501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b39759f8800/0x89871fc3aba182aa lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044172.511713:0:9501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b39759f9400/0x89871fc3aba1829c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca664d expref: 8 pid: 9501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044172.511730:0:9501:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b39759f8000/0x89871fc3aba182b1 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca664d expref: 7 pid: 9501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044172.511738:0:9501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9b396f2a8100) 00010000:00010000:2.0:1784044172.511740:0:9501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1784044172.511742:0:9501:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b39759f8000, rc 0) 00000100:00100000:2.0:1784044172.511854:0:9501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843caed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a93fdf3c-d42f-420a-95ea-b0cbfe954363+7:11096:x1870705565140352:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 Request processed in 2265us (2567us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044172.511874:0:9501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 41 00000100:00100000:0.0:1784044172.514373:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044172.514536:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565140480 00000100:00100000:2.0:1784044172.514548:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565140480 00000100:00100000:2.0:1784044172.514622:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 7 00000100:00100000:2.0:1784044172.514635:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+7:11096:x1870705565140480:12345-192.168.202.40@tcp:900:lhsmtool_posix.0 00000100:00100000:2.0:1784044172.514765:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+7:11096:x1870705565140480:12345-192.168.202.40@tcp:900:lhsmtool_posix.0 Request processed in 132us (406us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044172.514773:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 7 00000100:00100000:0.0:1784044172.517895:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044172.518123:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565140736 00000100:00100000:3.0:1784044172.518139:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565140736 00000100:00100000:3.0:1784044172.518364:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 42 00000100:00100000:3.0:1784044172.518379:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+7:11096:x1870705565140736:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1784044172.518423:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784044172.518460:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b39759f9200/0x89871fc3aba182b8 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcd3dffad52ca6654 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044172.518577:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b39759f8200/0x89871fc3aba182bf lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044172.518598:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b39759f8200/0x89871fc3aba182bf lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044172.518615:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b39759f8200/0x89871fc3aba182bf lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044172.518872:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b39759f9400/0x89871fc3aba182c6 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044172.518898:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b39759f9400/0x89871fc3aba182c6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044172.518911:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b39759f9400/0x89871fc3aba182c6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044172.519057:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b39759f8800/0x89871fc3aba182cd lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044172.519066:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b39759f8800/0x89871fc3aba182cd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044172.519073:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b39759f8800/0x89871fc3aba182cd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784044172.519085:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:3.0:1784044172.519251:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b39759f8200/0x89871fc3aba182bf lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044172.519260:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b39759f8200/0x89871fc3aba182bf lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044172.519266:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b39759f8200/0x89871fc3aba182bf lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044172.519272:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b39759f8200 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:3.0:1784044172.519276:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b39759f8200/0x89871fc3aba182bf lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044172.519301:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b39759f8200/0x89871fc3aba182bf lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044172.519315:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9b396f2a8100) 00010000:00010000:3.0:1784044172.519318:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784044172.519323:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b39759f8200/0x89871fc3aba182bf lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044172.519329:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b39759f8200/0x89871fc3aba182bf lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044172.519343:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b39759f9400/0x89871fc3aba182c6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044172.519349:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b39759f9400/0x89871fc3aba182c6 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044172.519355:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b39759f9400/0x89871fc3aba182c6 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044172.519360:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b39759f9400 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:3.0:1784044172.519363:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b39759f9400/0x89871fc3aba182c6 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044172.519368:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b39759f9400/0x89871fc3aba182c6 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044172.519375:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9b396f2a8800) 00010000:00010000:3.0:1784044172.519378:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784044172.519381:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b39759f9400/0x89871fc3aba182c6 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044172.519397:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b39759f9400/0x89871fc3aba182c6 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044172.520151:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b39759f9200/0x89871fc3aba182b8 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6654 expref: 10 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044172.521898:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b39759f8800/0x89871fc3aba182cd lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6654 expref: 9 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044172.521919:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9b396f2a8900) 00010000:00010000:3.0:1784044172.521923:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784044172.521927:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b39759f8800, rc 0) 00000100:00100000:2.0:1784044172.522229:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+9:11096:x1870705565140736:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 Request processed in 3841us (4337us total) trans 4294967311 rc 0/0 00000100:00100000:2.0:1784044172.522245:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 42 00000100:00100000:1.0:1784044172.525655:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044172.525850:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565140864 00000100:00100000:3.0:1784044172.525863:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565140864 00000100:00100000:3.0:1784044172.525950:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 43 00000100:00100000:3.0:1784044172.525963:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843cac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+9:11096:x1870705565140864:12345-192.168.202.40@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1784044172.526514:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843cac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+9:11096:x1870705565140864:12345-192.168.202.40@tcp:59:lhsmtool_posix.0 Request processed in 551us (874us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044172.526524:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 43 00000100:00100000:0.0:1784044172.528907:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044172.529112:0:9501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565140992 00000100:00100000:2.0:1784044172.529128:0:9501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565140992 00000100:00100000:2.0:1784044172.529304:0:9501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 44 00000100:00100000:2.0:1784044172.529317:0:9501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a93fdf3c-d42f-420a-95ea-b0cbfe954363+5:11096:x1870705565140992:12345-192.168.202.40@tcp:59:lhsmtool_posix.0 00000100:00080000:0.0:1784044172.531121:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00080000:0.0:1784044172.537059:0:9501:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 7677us 00000100:00100000:0.0:1784044172.554669:0:9501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a93fdf3c-d42f-420a-95ea-b0cbfe954363+5:11096:x1870705565140992:12345-192.168.202.40@tcp:59:lhsmtool_posix.0 Request processed in 25342us (25766us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044172.554698:0:9501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 44 00000040:00080000:1.0:1784044172.686104:0:13804:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1784044172.941352:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1784044173.008748:0:13763:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1784044173.030690:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044173.030740:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044173.030778:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044173.030814:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565141376 00000100:00100000:0.0:1784044173.030828:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565141376 00000100:00100000:0.0:1784044173.030907:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565141248 00000100:00100000:0.0:1784044173.030911:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565141248 00000100:00100000:0.0:1784044173.030945:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 304 00000100:00100000:0.0:1784044173.030957:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68dfcea6-5d83-4dbb-8fa3-e35542d621e5+5:2410:x1870705565141376:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:0.0:1784044173.031057:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68dfcea6-5d83-4dbb-8fa3-e35542d621e5+5:2410:x1870705565141376:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 102us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044173.031066:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 304 00000100:00100000:0.0:1784044173.031088:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 305 00000100:00100000:0.0:1784044173.031094:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397f944000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68dfcea6-5d83-4dbb-8fa3-e35542d621e5+5:2410:x1870705565141248:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:0.0:1784044173.031122:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397f944000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68dfcea6-5d83-4dbb-8fa3-e35542d621e5+5:2410:x1870705565141248:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 27us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044173.031128:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 305 00000100:00080000:0.0:1784044173.031147:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1784044173.031151:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1784044173.033165:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565141120 00000100:00100000:3.0:1784044173.033305:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565141120 00000100:00100000:3.0:1784044173.033387:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 408 00000100:00100000:3.0:1784044173.033400:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3950375c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4a09ad9-a185-4679-99bb-b6a07b865440+13:2410:x1870705565141120:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:3.0:1784044173.033516:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3950375c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4a09ad9-a185-4679-99bb-b6a07b865440+13:2410:x1870705565141120:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 119us (2850us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044173.033546:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 408 00000100:00100000:0.0:1784044173.389746:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784044173.389779:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397f947b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1870705580974080:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1784044173.389881:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044173.389997:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580974080 00000100:00100000:0.0:1784044173.390009:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580974080 00000100:00100000:0.0:1784044173.390081:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1784044173.390092:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397f946a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1870705580974080:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1784044173.390139:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1784044173.390241:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397f946a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1870705580974080:12345-0@lo:41:osp-pre-0-1.0 Request processed in 149us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044173.390250:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1784044173.390314:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397f947b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1870705580974080:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1784044173.967439:0:10331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784044174.413498:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784044174.413533:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39412e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1870705580974208:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784044174.413638:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044174.413792:0:10713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580974208 00000100:00100000:2.0:1784044174.413802:0:10713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580974208 00000100:00100000:2.0:1784044174.413886:0:10713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1784044174.413910:0:10713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843cadc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1870705580974208:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1784044174.413952:0:10713:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784044174.414009:0:10713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843cadc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1870705580974208:12345-0@lo:13:osp-pre-0-0.0 Request processed in 113us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044174.414018:0:10713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00080000:1.0:1784044174.414233:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784044174.414281:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39412e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1870705580974208:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784044174.416692:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784044174.416720:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397f947b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1870705580974336:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1784044174.416802:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044174.416863:0:7768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580974336 00000100:00100000:0.0:1784044174.416872:0:7768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580974336 00000100:00100000:0.0:1784044174.416942:0:7768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1784044174.416952:0:7768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397f944a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1870705580974336:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1784044174.416996:0:7768:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1784044174.417047:0:7768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397f944a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1870705580974336:12345-0@lo:41:osp-pre-1-0.0 Request processed in 95us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044174.417056:0:7768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1784044174.417113:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397f947b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1870705580974336:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1784044174.423724:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843cafb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1870705580974464:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1784044174.423831:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044174.428016:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580974464 00000100:00100000:3.0:1784044174.428039:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580974464 00000100:00100000:3.0:1784044174.428166:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1784044174.428197:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39412e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1870705580974464:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1784044174.428236:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00080000:1.0:1784044174.428477:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784044174.432786:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39412e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1870705580974464:12345-0@lo:13:osp-pre-0-1.0 Request processed in 4578us (8940us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044174.432807:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1784044174.434880:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843cafb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1870705580974464:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1784044174.834774:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044174.834815:0:9501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565141504 00000100:00100000:3.0:1784044174.834825:0:9501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565141504 00000100:00100000:3.0:1784044174.834890:0:9501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 45 00000100:00100000:3.0:1784044174.834901:0:9501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3975b7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a93fdf3c-d42f-420a-95ea-b0cbfe954363+9:11139:x1870705565141504:12345-192.168.202.40@tcp:101:lfs.0 00010000:00010000:3.0:1784044174.834923:0:9501:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784044174.834947:0:9501:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b39759f9200/0x89871fc3aba182db lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcd3dffad52ca665b expref: -99 pid: 9501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044174.835016:0:9501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b39759f9400/0x89871fc3aba182e2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044174.835031:0:9501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b39759f9400/0x89871fc3aba182e2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044174.835043:0:9501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b39759f9400/0x89871fc3aba182e2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044174.835057:0:9501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b39759f8200/0x89871fc3aba182e9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044174.835071:0:9501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b39759f8200/0x89871fc3aba182e9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044174.835078:0:9501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b39759f8200/0x89871fc3aba182e9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044174.835120:0:9501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b39759f9400/0x89871fc3aba182e2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044174.835128:0:9501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b39759f9400/0x89871fc3aba182e2 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044174.835134:0:9501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b39759f9400/0x89871fc3aba182e2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044174.835140:0:9501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b39759f9400 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:3.0:1784044174.835145:0:9501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b39759f9400/0x89871fc3aba182e2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044174.835153:0:9501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b39759f9400/0x89871fc3aba182e2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044174.835166:0:9501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b396f2a8000) 00010000:00010000:3.0:1784044174.835169:0:9501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784044174.838875:0:9501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b39759f9400/0x89871fc3aba182e2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044174.838893:0:9501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b39759f9400/0x89871fc3aba182e2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044174.838913:0:9501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b39759f8200/0x89871fc3aba182e9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044174.838928:0:9501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b39759f8200/0x89871fc3aba182e9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044174.838934:0:9501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b39759f8200/0x89871fc3aba182e9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044174.838941:0:9501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b39759f8200 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:3.0:1784044174.838946:0:9501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b39759f8200/0x89871fc3aba182e9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044174.838953:0:9501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b39759f8200/0x89871fc3aba182e9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044174.838970:0:9501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9b397aa61100) 00010000:00010000:3.0:1784044174.838974:0:9501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784044174.838977:0:9501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b39759f8200/0x89871fc3aba182e9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044174.838982:0:9501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b39759f8200/0x89871fc3aba182e9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044174.839031:0:9501:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b39759f9200/0x89871fc3aba182db lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca665b expref: 10 pid: 9501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044174.839043:0:9501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b396f2a8000) 00010000:00010000:3.0:1784044174.839045:0:9501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784044174.839049:0:9501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b39759f9200/0x89871fc3aba182db lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca665b expref: 10 pid: 9501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044174.839058:0:9501:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b39759f9200, rc 0) 00000100:00100000:3.0:1784044174.839141:0:9501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3975b7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a93fdf3c-d42f-420a-95ea-b0cbfe954363+9:11139:x1870705565141504:12345-192.168.202.40@tcp:101:lfs.0 Request processed in 4241us (4371us total) trans 0 rc 301/301 00000100:00100000:3.0:1784044174.839151:0:9501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 45 00000100:00080000:3.0:1784044174.839210:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784044174.851398:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044174.851627:0:13808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565141760 00000100:00100000:3.0:1784044174.851637:0:13808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565141760 00000100:00100000:3.0:1784044174.851710:0:13808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 46 00000100:00100000:3.0:1784044174.851720:0:13808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843cafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a93fdf3c-d42f-420a-95ea-b0cbfe954363+9:11139:x1870705565141760:12345-192.168.202.40@tcp:36:lfs.0 00010000:00010000:3.0:1784044174.851776:0:13808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784044174.851805:0:13808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b39759f9c00/0x89871fc3aba18295 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6646 expref: 9 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044174.851822:0:13808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b396f2a8000) 00010000:00010000:3.0:1784044174.851831:0:13808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784044174.851892:0:13808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b39759f9e00/0x89871fc3aba182f0 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044174.851905:0:13808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b39759f9e00/0x89871fc3aba182f0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044174.851915:0:13808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b39759f9e00/0x89871fc3aba182f0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044174.851927:0:13808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3982054600/0x89871fc3aba182f7 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044174.851934:0:13808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3982054600/0x89871fc3aba182f7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044174.851940:0:13808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3982054600/0x89871fc3aba182f7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044174.852497:0:13808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166aa00/0x89871fc3aba182fe lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044174.852509:0:13808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166aa00/0x89871fc3aba182fe lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044174.852516:0:13808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166aa00/0x89871fc3aba182fe lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784044174.852531:0:13808:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000299227c3 reply state 00000000e61a50aa transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166aa00/0x89871fc3aba182fe lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044174.852541:0:13808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166aa00/0x89871fc3aba182fe lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044174.852546:0:13808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9b397aa61900) 00010000:00010000:3.0:1784044174.852549:0:13808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1784044174.852551:0:13808:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1784044174.852557:0:13808:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:3.0:1784044174.852564:0:13808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b39759f9e00/0x89871fc3aba182f0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044174.852570:0:13808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b39759f9e00/0x89871fc3aba182f0 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044174.852576:0:13808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b39759f9e00/0x89871fc3aba182f0 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044174.852582:0:13808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b39759f9e00 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:3.0:1784044174.852588:0:13808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b39759f9e00/0x89871fc3aba182f0 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044174.852607:0:13808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b39759f9e00/0x89871fc3aba182f0 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044174.852616:0:13808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b397aa61000) 00010000:00010000:3.0:1784044174.852618:0:13808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784044174.852622:0:13808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b39759f9e00/0x89871fc3aba182f0 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044174.852628:0:13808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b39759f9e00/0x89871fc3aba182f0 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784044174.852645:0:13808:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000299227c3 reply state 00000000e61a50aa transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff9b3982054600/0x89871fc3aba182f7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044174.852662:0:13808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3982054600/0x89871fc3aba182f7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044174.852669:0:13808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9b397aa61d00) 00010000:00010000:3.0:1784044174.852671:0:13808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1784044174.852674:0:13808:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:3.0:1784044174.852800:0:13808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843cafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a93fdf3c-d42f-420a-95ea-b0cbfe954363+10:11139:x1870705565141760:12345-192.168.202.40@tcp:36:lfs.0 Request processed in 1077us (1410us total) trans 4294967312 rc 0/0 00000100:00100000:3.0:1784044174.852809:0:13808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 46 00010000:00010000:2.0:1784044174.997320:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784044174.999892:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044175.002680:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565141888 00000100:00100000:0.0:1784044175.002698:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565141888 00000100:00100000:0.0:1784044175.002848:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 47 00000100:00100000:0.0:1784044175.002861:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3975b7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+10:11147:x1870705565141888:12345-192.168.202.40@tcp:101:lctl.0 00010000:00010000:0.0:1784044175.002887:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784044175.002913:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7c00/0x89871fc3aba18305 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcd3dffad52ca6662 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044175.002982:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6c00/0x89871fc3aba1830c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044175.003015:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6c00/0x89871fc3aba1830c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044175.003026:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6c00/0x89871fc3aba1830c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784044175.003074:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1784044175.003078:0:6511:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1784044175.003113:0:6511:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6c00/0x89871fc3aba1830c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044175.003140:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7c00/0x89871fc3aba18305 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6662 expref: 12 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044175.003159:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6c00/0x89871fc3aba1830c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6662 expref: 11 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044175.003168:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b39758c1000) 00010000:00010000:0.0:1784044175.003171:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1784044175.003218:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b38410b6c00, rc 0) 00000100:00100000:0.0:1784044175.003299:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3975b7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+11:11147:x1870705565141888:12345-192.168.202.40@tcp:101:lctl.0 Request processed in 440us (3416us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044175.003307:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 47 00000040:00080000:2.0:1784044175.053962:0:13763:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1784044175.122891:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044175.123643:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565142016 00000100:00100000:0.0:1784044175.123685:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565142016 00000100:00100000:0.0:1784044175.123780:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 48 00000100:00100000:0.0:1784044175.123792:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3975b7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+11:11153:x1870705565142016:12345-192.168.202.40@tcp:101:bash.0 00010000:00010000:0.0:1784044175.123821:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784044175.123881:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7c00/0x89871fc3aba18313 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcd3dffad52ca6669 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044175.123972:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7a00/0x89871fc3aba1831a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044175.123991:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7a00/0x89871fc3aba1831a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044175.124005:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7a00/0x89871fc3aba1831a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044175.124017:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7600/0x89871fc3aba18321 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044175.124025:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7600/0x89871fc3aba18321 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044175.124032:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7600/0x89871fc3aba18321 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044175.124157:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6400/0x89871fc3aba18328 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044175.124167:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6400/0x89871fc3aba18328 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044175.124241:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6400/0x89871fc3aba18328 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784044175.124291:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:0.0:1784044175.125420:0:6512:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1784044175.125493:0:6512:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6400/0x89871fc3aba18328 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044175.125526:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7a00/0x89871fc3aba1831a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044175.125534:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7a00/0x89871fc3aba1831a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044175.125543:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7a00/0x89871fc3aba1831a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044175.125551:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38410b7a00 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:0.0:1784044175.125557:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7a00/0x89871fc3aba1831a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044175.125566:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7a00/0x89871fc3aba1831a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044175.125585:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b39758c1000) 00010000:00010000:0.0:1784044175.125589:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784044175.125595:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7a00/0x89871fc3aba1831a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044175.125602:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7a00/0x89871fc3aba1831a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044175.125621:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7600/0x89871fc3aba18321 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044175.125627:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7600/0x89871fc3aba18321 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044175.125634:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7600/0x89871fc3aba18321 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044175.125645:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38410b7600 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:0.0:1784044175.125649:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7600/0x89871fc3aba18321 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044175.125666:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7600/0x89871fc3aba18321 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044175.125676:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9b397aa61d00) 00010000:00010000:0.0:1784044175.125679:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784044175.125682:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7600/0x89871fc3aba18321 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044175.125689:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7600/0x89871fc3aba18321 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044175.125730:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7c00/0x89871fc3aba18313 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6669 expref: 13 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044175.125747:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6400/0x89871fc3aba18328 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6669 expref: 12 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044175.125756:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9b397aa61900) 00010000:00010000:0.0:1784044175.125759:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1784044175.125761:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b38410b6400, rc 0) 00000100:00100000:0.0:1784044175.125852:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3975b7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+12:11153:x1870705565142016:12345-192.168.202.40@tcp:101:bash.0 Request processed in 2063us (2978us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044175.125862:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 48 00000100:00100000:2.0:1784044175.129309:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1784044175.129511:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565142272 00000100:00100000:1.0:1784044175.129521:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565142272 00000100:00100000:1.0:1784044175.129587:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 49 00000100:00100000:1.0:1784044175.129598:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39412e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+12:11153:x1870705565142272:12345-192.168.202.40@tcp:101:bash.0 00010000:00010000:1.0:1784044175.129619:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784044175.129643:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc000/0x89871fc3aba1832f lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcd3dffad52ca6670 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044175.129793:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fce00/0x89871fc3aba18336 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044175.129809:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fce00/0x89871fc3aba18336 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044175.129845:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fce00/0x89871fc3aba18336 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044175.129883:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fda00/0x89871fc3aba1833d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044175.129891:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fda00/0x89871fc3aba1833d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044175.129898:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fda00/0x89871fc3aba1833d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1784044175.130314:0:6513:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x2:0x0], index 1: 0 00010000:00010000:1.0:1784044175.132959:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fcc00/0x89871fc3aba18344 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044175.132987:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fcc00/0x89871fc3aba18344 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044175.133000:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fcc00/0x89871fc3aba18344 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044175.133042:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fce00/0x89871fc3aba18336 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044175.133048:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fce00/0x89871fc3aba18336 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044175.133055:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fce00/0x89871fc3aba18336 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044175.133061:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38426fce00 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:1.0:1784044175.133078:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fce00/0x89871fc3aba18336 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044175.133086:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fce00/0x89871fc3aba18336 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044175.133099:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9b397aa61900) 00010000:00010000:1.0:1784044175.133102:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784044175.133107:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fce00/0x89871fc3aba18336 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044175.133205:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fce00/0x89871fc3aba18336 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784044175.133219:0:6513:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f1ec8a66 reply state 00000000358ca15c transno 4294967313 ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fda00/0x89871fc3aba1833d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044175.133230:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fda00/0x89871fc3aba1833d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044175.133236:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9b3842776700) 00010000:00010000:1.0:1784044175.133238:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784044175.133241:0:6513:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1784044175.133281:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc000/0x89871fc3aba1832f lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6670 expref: 15 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044175.133473:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fcc00/0x89871fc3aba18344 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6670 expref: 14 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044175.133551:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9b3842776900) 00010000:00010000:1.0:1784044175.133554:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784044175.133565:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b38426fcc00, rc 0) 00000100:00100000:1.0:1784044175.133717:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39412e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+15:11153:x1870705565142272:12345-192.168.202.40@tcp:101:bash.0 Request processed in 4119us (4421us total) trans 4294967313 rc 0/0 00000100:00100000:1.0:1784044175.133728:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 49 00000100:00100000:2.0:1784044175.137935:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044175.138005:0:9822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565142400 00000100:00100000:3.0:1784044175.138016:0:9822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565142400 00000100:00100000:3.0:1784044175.138072:0:9822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 30 00000100:00100000:3.0:1784044175.138080:0:9822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39412eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2406:x1870705565142400:12345-192.168.202.40@tcp:8:bash.0 00010000:00080000:3.0:1784044175.138143:0:9822:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from a93fdf3c-d42f-420a-95ea-b0cbfe954363@192.168.202.40@tcp t0 exp 0000000000000000 cur 368 last 0 00000020:00000080:3.0:1784044175.138198:0:9822:0:(genops.c:1406:class_connect()) connect: client a93fdf3c-d42f-420a-95ea-b0cbfe954363, cookie 0x89871fc3aba18352 00002000:00100000:3.0:1784044175.138212:0:9822:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli a93fdf3c-d42f-420a-95ea-b0cbfe954363/ffff9b3843c36000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136a2 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1784044175.138234:0:9822:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type b7, return b7 00002000:00080000:3.0:1784044175.138313:0:9822:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1784044175.138348:0:9822:0:(import.c:65:import_set_state_nolock()) ffff9b3843c33000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1784044175.138766:0:9822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39412eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a93fdf3c-d42f-420a-95ea-b0cbfe954363+6:2406:x1870705565142400:12345-192.168.202.40@tcp:8:bash.0 Request processed in 683us (841us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044175.138775:0:9822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 30 00000100:00100000:2.0:1784044175.141580:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044175.141830:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565142528 00000100:00100000:3.0:1784044175.141841:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565142528 00000100:00100000:3.0:1784044175.141945:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 31 00000100:00100000:3.0:1784044175.141955:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39412e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+6:0:x1870705565142528:12345-192.168.202.40@tcp:101:bash.0 00010000:00010000:3.0:1784044175.141978:0:8426:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784044175.142007:0:8426:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d20ba4de/0x89871fc3aba18359 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcd3dffad52ca6677 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784044175.142035:0:8426:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784044175.142058:0:8426:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=368s v=(0 0) 00010000:00010000:3.0:1784044175.142063:0:8426:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784044175.142073:0:8426:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d20ba4de/0x89871fc3aba18359 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6677 expref: 7 pid: 8426 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044175.142095:0:8426:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d20ba4de/0x89871fc3aba18359 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6677 expref: 7 pid: 8426 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044175.142143:0:8426:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b394166bc00, rc 0) 00000100:00100000:3.0:1784044175.142474:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39412e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+7:0:x1870705565142528:12345-192.168.202.40@tcp:101:bash.0 Request processed in 518us (901us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044175.142492:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 31 00000100:00080000:1.0:1784044175.142704:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784044175.146615:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044175.146788:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565142656 00000100:00100000:0.0:1784044175.146803:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565142656 00000100:00100000:0.0:1784044175.146865:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 32 00000100:00100000:0.0:1784044175.146876:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3943eb1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+7:11153:x1870705565142656:12345-192.168.202.40@tcp:101:bash.0 00010000:00010000:0.0:1784044175.146896:0:8428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784044175.146920:0:8428:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a21e3764/0x89871fc3aba18360 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcd3dffad52ca667e expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044175.146952:0:8428:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d20ba4de/0x89871fc3aba18359 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6677 expref: 8 pid: 8426 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044175.146961:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784044175.146965:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784044175.146971:0:8428:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a21e3764/0x89871fc3aba18360 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca667e expref: 8 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044175.147006:0:8428:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d20ba4de/0x89871fc3aba18359 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6677 expref: 8 pid: 8426 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044175.147021:0:8428:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d20ba4de/0x89871fc3aba18359 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6677 expref: 8 pid: 8426 timeout: 468 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044175.147036:0:8428:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397f947b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8428:1870705580974592:192.168.202.40@tcp:104: 00000100:00100000:0.0:1784044175.147161:0:8428:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b397f923d80 going to sleep for 11 seconds 00000100:00100000:2.0:1784044175.151285:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044175.151404:0:8428:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397f947b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8428:1870705580974592:192.168.202.40@tcp:104: 00010000:00010000:0.0:1784044175.151441:0:8428:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a21e3764/0x89871fc3aba18360 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca667e expref: 8 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044175.151490:0:8428:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b38410b7c00, rc 0) 00000100:00100000:0.0:1784044175.151555:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3943eb1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+8:11153:x1870705565142656:12345-192.168.202.40@tcp:101:bash.0 Request processed in 4681us (4949us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044175.151564:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 32 00000100:00100000:1.0:1784044175.152042:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565142784 00000100:00100000:1.0:1784044175.152051:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565142784 00010000:00010000:1.0:1784044175.152087:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d20ba4de/0x89871fc3aba18359 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6677 expref: 8 pid: 8426 timeout: 468 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044175.152124:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 56 00000100:00100000:1.0:1784044175.152134:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39412ead80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+8:2410:x1870705565142784:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784044175.152148:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784044175.152169:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d20ba4de/0x89871fc3aba18359 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6677 expref: 8 pid: 8426 timeout: 468 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044175.152214:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d20ba4de/0x89871fc3aba18359 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6677 expref: 8 pid: 8426 timeout: 468 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044175.152239:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d20ba4de/0x89871fc3aba18359 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6677 expref: 8 pid: 8426 timeout: 468 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044175.152255:0:6497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784044175.152260:0:6497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784044175.152268:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a21e3764/0x89871fc3aba18360 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca667e expref: 7 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044175.152291:0:6497:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a21e3764/0x89871fc3aba18360 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca667e expref: 7 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044175.152324:0:6497:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000a21e3764/0x89871fc3aba18360 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca667e expref: 7 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044175.152337:0:6497:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3943eb0a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6497:1870705580974720:192.168.202.40@tcp:105: 00000100:00100000:1.0:1784044175.152414:0:6497:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3950d63540 going to sleep for 11 seconds 00000100:00100000:1.0:1784044175.159727:0:6497:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3943eb0a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6497:1870705580974720:192.168.202.40@tcp:105: 00010000:00010000:1.0:1784044175.159759:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784044175.159824:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39412ead80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+7:2410:x1870705565142784:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 7690us (8549us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044175.159834:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 56 00000100:00100000:2.0:1784044175.162722:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1784044175.162833:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565143040 00000100:00100000:1.0:1784044175.162843:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565143040 00000100:00100000:1.0:1784044175.162906:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 6 00000100:00100000:1.0:1784044175.162918:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39412e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+15:11153:x1870705565143040:12345-192.168.202.40@tcp:35:bash.0 00000100:00100000:1.0:1784044175.163263:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39412e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+16:11153:x1870705565143040:12345-192.168.202.40@tcp:35:bash.0 Request processed in 339us (541us total) trans 4294967314 rc 0/0 00000100:00100000:1.0:1784044175.163271:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 6 00000100:00100000:3.0:1784044175.278741:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044175.279234:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565143296 00000100:00100000:0.0:1784044175.279247:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565143296 00000100:00100000:0.0:1784044175.279606:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 50 00000100:00100000:0.0:1784044175.279619:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3975b7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+16:11163:x1870705565143296:12345-192.168.202.40@tcp:101:lfs.0 00010000:00010000:0.0:1784044175.279659:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784044175.279686:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7600/0x89871fc3aba18367 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcd3dffad52ca6685 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784044175.279804:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:0.0:1784044175.279920:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7600/0x89871fc3aba18367 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6685 expref: 18 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044175.279935:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b39758c1000) 00010000:00010000:0.0:1784044175.279939:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1784044175.279944:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7600/0x89871fc3aba18367 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6685 expref: 18 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044175.279959:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b38410b7600, rc 0) 00000100:00100000:0.0:1784044175.280141:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3975b7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+17:11163:x1870705565143296:12345-192.168.202.40@tcp:101:lfs.0 Request processed in 525us (1412us total) trans 4294967315 rc 301/301 00000100:00100000:0.0:1784044175.280150:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 50 00000100:00100000:2.0:1784044175.288638:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1784044175.288725:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565143552 00000100:00100000:1.0:1784044175.288735:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565143552 00000100:00100000:1.0:1784044175.288799:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 7 00000100:00100000:1.0:1784044175.288810:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39412eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+17:11163:x1870705565143552:12345-192.168.202.40@tcp:35:lfs.0 00000100:00100000:1.0:1784044175.289081:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39412eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+18:11163:x1870705565143552:12345-192.168.202.40@tcp:35:lfs.0 Request processed in 272us (918us total) trans 4294967316 rc 0/0 00000100:00100000:1.0:1784044175.289088:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 7 00000100:00100000:2.0:1784044175.383686:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044175.383831:0:13808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565143680 00000100:00100000:3.0:1784044175.383841:0:13808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565143680 00000100:00100000:3.0:1784044175.383909:0:13808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 51 00000100:00100000:3.0:1784044175.383920:0:13808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39412e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a93fdf3c-d42f-420a-95ea-b0cbfe954363+18:11169:x1870705565143680:12345-192.168.202.40@tcp:101:lfs.0 00010000:00010000:3.0:1784044175.383943:0:13808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784044175.383964:0:13808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166b800/0x89871fc3aba18375 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcd3dffad52ca668c expref: -99 pid: 13808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044175.384043:0:13808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166ac00/0x89871fc3aba1837c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044175.384057:0:13808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166ac00/0x89871fc3aba1837c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044175.384068:0:13808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166ac00/0x89871fc3aba1837c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784044175.384113:0:13808:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:3.0:1784044175.384117:0:13808:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1784044175.384137:0:13808:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166ac00/0x89871fc3aba1837c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044175.384162:0:13808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166b800/0x89871fc3aba18375 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca668c expref: 20 pid: 13808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044175.384242:0:13808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166ac00/0x89871fc3aba1837c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca668c expref: 19 pid: 13808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044175.384252:0:13808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9b397aa61900) 00010000:00010000:3.0:1784044175.384255:0:13808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1784044175.384259:0:13808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b394166ac00, rc 0) 00000100:00100000:2.0:1784044175.384970:0:13808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39412e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a93fdf3c-d42f-420a-95ea-b0cbfe954363+19:11169:x1870705565143680:12345-192.168.202.40@tcp:101:lfs.0 Request processed in 1048us (1290us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044175.384981:0:13808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 51 00000100:00100000:0.0:1784044175.392041:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1784044175.392474:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565143936 00000100:00100000:1.0:1784044175.392485:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565143936 00000100:00100000:1.0:1784044175.392575:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 52 00000100:00100000:1.0:1784044175.392585:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397f947b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+19:11169:x1870705565143936:12345-192.168.202.40@tcp:101:lfs.0 00010000:00010000:1.0:1784044175.392607:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784044175.392627:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc000/0x89871fc3aba18383 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcd3dffad52ca6693 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044175.392749:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fce00/0x89871fc3aba1838a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044175.392765:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fce00/0x89871fc3aba1838a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044175.392778:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fce00/0x89871fc3aba1838a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784044175.392789:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:1.0:1784044175.392899:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc000/0x89871fc3aba18383 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6693 expref: 22 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044175.392918:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fce00/0x89871fc3aba1838a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6693 expref: 21 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044175.392926:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9b3842776900) 00010000:00010000:1.0:1784044175.392946:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784044175.392951:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b38426fce00, rc 0) 00000100:00100000:1.0:1784044175.393019:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397f947b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+21:11169:x1870705565143936:12345-192.168.202.40@tcp:101:lfs.0 Request processed in 436us (987us total) trans 4294967317 rc 0/0 00000100:00100000:1.0:1784044175.393027:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 52 00000100:00100000:0.0:1784044175.398552:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044175.398598:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1784044175.398671:0:13182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565144320 00000100:00100000:1.0:1784044175.398680:0:13182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565144320 00000100:00100000:1.0:1784044175.398743:0:13182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 3 00000100:00100000:1.0:1784044175.398752:0:13182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397f944e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a93fdf3c-d42f-420a-95ea-b0cbfe954363+21:2409:x1870705565144320:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784044175.398766:0:13182:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784044175.398789:0:13182:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fce00/0x89871fc3aba1838a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6693 expref: 21 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044175.398805:0:13182:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9b3842776900) 00010000:00010000:1.0:1784044175.398810:0:13182:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784044175.398867:0:13182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397f944e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a93fdf3c-d42f-420a-95ea-b0cbfe954363+20:2409:x1870705565144320:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 117us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044175.398873:0:13182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 3 00000100:00100000:3.0:1784044175.399457:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565144192 00000100:00100000:3.0:1784044175.399463:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565144192 00000100:00100000:3.0:1784044175.399505:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 53 00000100:00100000:3.0:1784044175.399512:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397f945f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+20:11169:x1870705565144192:12345-192.168.202.40@tcp:101:lfs.0 00010000:00010000:3.0:1784044175.399534:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784044175.399552:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166b800/0x89871fc3aba18398 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcd3dffad52ca669a expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044175.399686:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166be00/0x89871fc3aba1839f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044175.399703:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166be00/0x89871fc3aba1839f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044175.399715:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166be00/0x89871fc3aba1839f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784044175.399726:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:3.0:1784044175.399827:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166b800/0x89871fc3aba18398 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca669a expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044175.399844:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166be00/0x89871fc3aba1839f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca669a expref: 22 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044175.399865:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9b3842776900) 00010000:00010000:3.0:1784044175.399868:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1784044175.399871:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b394166be00, rc 0) 00000100:00100000:3.0:1784044175.399917:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397f945f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+22:11169:x1870705565144192:12345-192.168.202.40@tcp:101:lfs.0 Request processed in 405us (1376us total) trans 4294967318 rc 0/0 00000100:00100000:3.0:1784044175.399923:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 53 00000100:00100000:0.0:1784044175.411684:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044175.411786:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565144448 00000100:00100000:3.0:1784044175.411796:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565144448 00000100:00100000:3.0:1784044175.411857:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 33 00000100:00100000:3.0:1784044175.411868:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397f947100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+7:2409:x1870705565144448:12345-192.168.202.40@tcp:1:lfs.0 00010000:00010000:3.0:1784044175.411915:0:8427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008c8b1a27/0x89871fc3aba183ad lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044175.411937:0:8427:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a21e3764/0x89871fc3aba18360 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca667e expref: 7 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044175.411947:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784044175.411952:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1784044175.411957:0:8427:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008c8b1a27/0x89871fc3aba183ad lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044175.411996:0:8427:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a21e3764/0x89871fc3aba18360 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca667e expref: 7 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044175.412009:0:8427:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a21e3764/0x89871fc3aba18360 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca667e expref: 7 pid: 8428 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044175.412041:0:8427:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3975b7dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8427:1870705580974848:192.168.202.40@tcp:104: 00000100:00100000:3.0:1784044175.412151:0:8427:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3843df7900 going to sleep for 11 seconds 00000100:00100000:2.0:1784044175.416324:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044175.416443:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565144576 00000100:00100000:0.0:1784044175.416452:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565144576 00002000:00100000:0.0:1784044175.416496:0:8431:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x2:0x0] (0->12) req@ffff9b39412eb480 x1870705565144576/t0(0) o4->a93fdf3c-d42f-420a-95ea-b0cbfe954363@192.168.202.40@tcp:326/0 lens 504/0 e 0 to 0 dl 1784044186 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784044175.416509:0:8431:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b39412eb480 with x1870705565144576 ext(0->12) 00010000:00010000:0.0:1784044175.416519:0:8431:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000a21e3764/0x89871fc3aba18360 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca667e expref: 8 pid: 8428 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044175.416536:0:8431:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000a21e3764/0x89871fc3aba18360 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca667e expref: 8 pid: 8428 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784044175.416544:0:8431:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9b39412eb480 00000100:00100000:0.0:1784044175.416577:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 0 00000100:00100000:0.0:1784044175.416587:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39412eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+8:2409:x1870705565144576:12345-192.168.202.40@tcp:4:lfs.0 00000100:00100000:3.0:1784044175.417420:0:8427:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3975b7dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8427:1870705580974848:192.168.202.40@tcp:104: 00010000:00010000:3.0:1784044175.417444:0:8427:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000008c8b1a27/0x89871fc3aba183ad lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:1.0:1784044175.419109:0:9505:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of a93fdf3c-d42f-420a-95ea-b0cbfe954363 00000100:00100000:0.0:1784044175.419739:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39412eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+9:2409:x1870705565144576:12345-192.168.202.40@tcp:4:lfs.0 Request processed in 3145us (3416us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1784044175.419753:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 0 00002000:00100000:0.0:1784044175.419765:0:8431:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x2:0x0] (0->12) req@ffff9b39412eb480 x1870705565144576/t4294967300(0) o4->a93fdf3c-d42f-420a-95ea-b0cbfe954363@192.168.202.40@tcp:326/0 lens 504/448 e 0 to 0 dl 1784044186 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784044175.419775:0:8431:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b39412eb480 with x1870705565144576 ext(0->12) 00010000:00010000:0.0:1784044175.419785:0:8431:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000a21e3764/0x89871fc3aba18360 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca667e expref: 9 pid: 8428 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044175.419817:0:8431:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000a21e3764/0x89871fc3aba18360 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca667e expref: 9 pid: 8428 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784044175.419825:0:8431:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9b39412eb480 00000100:00100000:2.0:1784044175.422579:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044175.422694:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565144704 00000100:00100000:3.0:1784044175.422705:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565144704 00010000:00010000:3.0:1784044175.422750:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a21e3764/0x89871fc3aba18360 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca667e expref: 9 pid: 8428 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044175.422794:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 57 00000100:00100000:3.0:1784044175.422803:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397aa57800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+9:2407:x1870705565144704:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784044175.422819:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1784044175.422837:0:6496:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1784044175.422839:0:6496:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb mtime from disk: 0 -> 1784044174 00002000:00010000:3.0:1784044175.422842:0:6496:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb atime from disk: 0 -> 1784044175 00002000:00010000:3.0:1784044175.422844:0:6496:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb ctime from disk: 0 -> 1784044174 00002000:00010000:3.0:1784044175.422845:0:6496:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1784044175.422852:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a21e3764/0x89871fc3aba18360 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca667e expref: 9 pid: 8428 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044175.422865:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a21e3764/0x89871fc3aba18360 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca667e expref: 9 pid: 8428 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044175.422907:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a21e3764/0x89871fc3aba18360 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca667e expref: 9 pid: 8428 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044175.422926:0:6496:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1784044175.422931:0:6496:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1784044175.422937:0:6496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008c8b1a27/0x89871fc3aba183ad lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044175.422947:0:6496:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008c8b1a27/0x89871fc3aba183ad lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044175.422984:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784044175.423036:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397aa57800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+8:2407:x1870705565144704:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 234us (467us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044175.423044:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 57 00010000:00010000:0.0:1784044175.423878:0:8427:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000008c8b1a27/0x89871fc3aba183ad lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044175.423892:0:8427:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008c8b1a27/0x89871fc3aba183ad lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044175.423914:0:8427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008c8b1a27/0x89871fc3aba183ad lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044175.423923:0:8427:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008c8b1a27/0x89871fc3aba183ad lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044175.423931:0:8427:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008c8b1a27/0x89871fc3aba183ad lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044175.423938:0:8427:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b394166b800 already unused, calling callback (ffffffffc0b56230) 00010000:00010000:0.0:1784044175.423943:0:8427:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008c8b1a27/0x89871fc3aba183ad lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044175.423952:0:8427:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008c8b1a27/0x89871fc3aba183ad lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044175.423984:0:8427:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008c8b1a27/0x89871fc3aba183ad lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044175.423992:0:8427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008c8b1a27/0x89871fc3aba183ad lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044175.424068:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397f947100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+7:2409:x1870705565144448:12345-192.168.202.40@tcp:1:lfs.0 Request processed in 12200us (12396us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044175.424077:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 33 00000100:00100000:2.0:1784044175.428670:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1784044175.428942:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565144960 00000100:00100000:1.0:1784044175.428952:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565144960 00000100:00100000:1.0:1784044175.429018:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 8 00000100:00100000:1.0:1784044175.429029:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3947ee8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+22:11169:x1870705565144960:12345-192.168.202.40@tcp:35:lfs.0 00000004:00010000:1.0:1784044175.429093:0:6514:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166be00/0x89871fc3aba1839f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca669a expref: 22 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1784044175.429538:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00000001:00080000:1.0:1784044175.429599:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:1.0:1784044175.429905:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00010000:00010000:1.0:1784044175.429948:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc200/0x89871fc3aba183b4 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044175.429967:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fcc00/0x89871fc3aba18344 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6670 expref: 26 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044175.429977:0:6514:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc200/0x89871fc3aba183b4 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044175.430013:0:6514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fcc00/0x89871fc3aba18344 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6670 expref: 26 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044175.430028:0:6514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fcc00/0x89871fc3aba18344 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6670 expref: 26 pid: 6513 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044175.430042:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3943eb0a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6514:1870705580974976:192.168.202.40@tcp:104: 00000100:00100000:1.0:1784044175.430139:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3950d63a80 going to sleep for 11 seconds 00000100:00100000:3.0:1784044175.437803:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1784044175.437829:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3975b7dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1870705580975104:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1784044175.437906:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044175.437955:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580975104 00000100:00100000:3.0:1784044175.437962:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580975104 00000100:00100000:3.0:1784044175.438018:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1784044175.438026:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3975b7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1870705580975104:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1784044175.438051:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784044175.438092:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3975b7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1870705580975104:12345-0@lo:13:osp-pre-1-1.0 Request processed in 66us (185us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044175.438126:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00080000:3.0:1784044175.438151:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784044175.438203:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3975b7dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1870705580975104:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1784044175.438517:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3947eebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1870705580975232:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784044175.438547:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044175.438777:0:10713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580975232 00000100:00100000:2.0:1784044175.438783:0:10713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580975232 00000100:00100000:2.0:1784044175.438826:0:10713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1784044175.438833:0:10713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397bdfb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1870705580975232:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1784044175.438846:0:10713:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784044175.438880:0:10713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397bdfb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1870705580975232:12345-0@lo:13:osp-pre-1-0.0 Request processed in 47us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044175.438886:0:10713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1784044175.439082:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3943eb3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3639:1870705580975488:0@lo:400:kworker.0 00000100:00100000:2.0:1784044175.439137:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044175.439164:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3943eb3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1870705580976000:0@lo:400:kworker.0 00000100:00100000:2.0:1784044175.439218:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044175.439234:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3943eb2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3639:1870705580976512:0@lo:400:kworker.0 00000100:00100000:2.0:1784044175.439255:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044175.439272:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1784044175.439278:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3943eb0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:3639:1870705580975360:0@lo:400:kworker.0 00000100:00100000:0.0:1784044175.440473:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3943eb1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1870705580975616:0@lo:400:kworker.0 00000100:00100000:0.0:1784044175.440531:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044175.440565:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3943eb0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1870705580976128:0@lo:400:kworker.0 00000100:00100000:0.0:1784044175.440589:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044175.440604:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3943eb0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3640:1870705580976640:0@lo:400:kworker.0 00000100:00100000:0.0:1784044175.440628:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044175.440679:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580975616 00000100:00100000:0.0:1784044175.440685:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580975616 00000100:00100000:0.0:1784044175.440730:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1784044175.440738:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397f946300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1870705580975616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784044175.440789:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397f946300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1870705580975616:12345-0@lo:400:kworker.0 Request processed in 51us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044175.440796:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1784044175.440837:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3943eb1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1870705580975616:0@lo:400:kworker.0 00000100:00100000:0.0:1784044175.440864:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580976000 00000100:00100000:0.0:1784044175.440880:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580976000 00000100:00100000:0.0:1784044175.440904:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580976128 00000100:00100000:0.0:1784044175.440906:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580976128 00000100:00100000:0.0:1784044175.440922:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1784044175.440927:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3947ee8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1870705580976000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784044175.440958:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3947ee8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1870705580976000:12345-0@lo:400:kworker.0 Request processed in 30us (1740us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044175.440964:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1784044175.440975:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1784044175.440980:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397f945c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1870705580976128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784044175.441007:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397f945c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1870705580976128:12345-0@lo:400:kworker.0 Request processed in 26us (417us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044175.441012:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1784044175.441034:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3943eb0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1870705580976128:0@lo:400:kworker.0 00000100:00100000:0.0:1784044175.441056:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580975488 00000100:00100000:0.0:1784044175.441059:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580975488 00000100:00100000:0.0:1784044175.441079:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580976512 00000100:00100000:0.0:1784044175.441082:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580976512 00000100:00100000:0.0:1784044175.441096:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580976640 00000100:00100000:0.0:1784044175.441098:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580976640 00000100:00100000:0.0:1784044175.441111:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:0.0:1784044175.441117:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3947eeaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1870705580975488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784044175.441146:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3947eeaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1870705580975488:12345-0@lo:400:kworker.0 Request processed in 29us (2009us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044175.441151:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00000100:00100000:0.0:1784044175.441162:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:0.0:1784044175.441167:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3947ee9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1870705580976512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784044175.441224:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3947ee9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1870705580976512:12345-0@lo:400:kworker.0 Request processed in 57us (1968us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044175.441229:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00000100:00100000:0.0:1784044175.441241:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 308 00000100:00100000:0.0:1784044175.441246:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397f945180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1870705580976640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784044175.441276:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397f945180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1870705580976640:12345-0@lo:400:kworker.0 Request processed in 29us (648us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044175.441281:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 308 00010000:00080000:0.0:1784044175.441320:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b3943eb0e00 x1870705580976640/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044191 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784044175.441330:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3943eb0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3640:1870705580976640:0@lo:400:kworker.0 00000100:00100000:2.0:1784044175.441509:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044175.441538:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3943eb1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1870705580975872:0@lo:400:kworker.0 00000100:00100000:2.0:1784044175.441563:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044175.441579:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3943eb1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3639:1870705580976384:0@lo:400:kworker.0 00000100:00100000:2.0:1784044175.441598:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044175.441615:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3943eb3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3639:1870705580975488:0@lo:400:kworker.0 00000100:00100000:2.0:1784044175.441624:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3943eb3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1870705580976000:0@lo:400:kworker.0 00000100:00100000:2.0:1784044175.441633:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3943eb2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3639:1870705580976512:0@lo:400:kworker.0 00000100:00100000:2.0:1784044175.441671:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580975360 00000100:00100000:2.0:1784044175.441674:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580975360 00000100:00100000:2.0:1784044175.441704:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 409 00000100:00100000:2.0:1784044175.441710:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3950374c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+24:3639:x1870705580975360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784044175.441741:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3950374c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+24:3639:x1870705580975360:12345-0@lo:400:kworker.0 Request processed in 31us (232us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044175.441747:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 409 00000100:00100000:2.0:1784044175.441779:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3943eb0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:3639:1870705580975360:0@lo:400:kworker.0 00000100:00100000:2.0:1784044175.441805:0:13808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580976384 00000100:00100000:2.0:1784044175.441808:0:13808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580976384 00000100:00100000:2.0:1784044175.441833:0:13808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 309 00000100:00100000:2.0:1784044175.441839:0:13808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3947eeb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1870705580976384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784044175.441869:0:13808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3947eeb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1870705580976384:12345-0@lo:400:kworker.0 Request processed in 30us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044175.441875:0:13808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 309 00010000:00080000:2.0:1784044175.441896:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b3943eb1c00 x1870705580976384/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044191 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784044175.441906:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3943eb1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3639:1870705580976384:0@lo:400:kworker.0 00000100:00100000:3.0:1784044175.441972:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3943eb2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3641:1870705580975744:0@lo:400:kworker.0 00000100:00100000:3.0:1784044175.442007:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044175.442034:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3943eb2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3641:1870705580976256:0@lo:400:kworker.0 00000100:00100000:3.0:1784044175.442055:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044175.442081:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3947eebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1870705580975232:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784044175.442111:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580975744 00000100:00100000:3.0:1784044175.442115:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580975744 00000100:00100000:3.0:1784044175.442134:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580976256 00000100:00100000:3.0:1784044175.442137:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580976256 00000100:00100000:3.0:1784044175.442153:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 310 00000100:00100000:3.0:1784044175.442159:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3975b7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1870705580975744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044175.442210:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3975b7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1870705580975744:12345-0@lo:400:kworker.0 Request processed in 50us (202us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044175.442216:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 310 00000100:00100000:3.0:1784044175.442229:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 311 00000100:00100000:3.0:1784044175.442235:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3975b7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1870705580976256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044175.442260:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3975b7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1870705580976256:12345-0@lo:400:kworker.0 Request processed in 25us (204us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044175.442265:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 311 00000100:00100000:3.0:1784044175.442301:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3943eb2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3641:1870705580975744:0@lo:400:kworker.0 00000100:00100000:3.0:1784044175.442310:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3943eb2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3641:1870705580976256:0@lo:400:kworker.0 00000100:00080000:1.0:1784044175.444530:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1784044175.444542:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1784044175.444547:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784044175.444636:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580975872 00000100:00100000:0.0:1784044175.444659:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580975872 00000100:00100000:0.0:1784044175.444736:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1784044175.444743:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3947ee8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1870705580975872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784044175.444841:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3947ee8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1870705580975872:12345-0@lo:400:kworker.0 Request processed in 98us (3277us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044175.444847:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1784044175.445167:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3943eb1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1870705580975872:0@lo:400:kworker.0 00000100:00100000:3.0:1784044175.449225:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3943eb0a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6514:1870705580974976:192.168.202.40@tcp:104: 00010000:00010000:3.0:1784044175.449273:0:6514:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc200/0x89871fc3aba183b4 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044175.451984:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1784044175.452338:0:13182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565145088 00000100:00100000:1.0:1784044175.452350:0:13182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565145088 00010000:00010000:1.0:1784044175.452402:0:13182:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fcc00/0x89871fc3aba18344 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6670 expref: 27 pid: 6513 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044175.452444:0:13182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 58 00000100:00100000:1.0:1784044175.452454:0:13182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3944090050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a93fdf3c-d42f-420a-95ea-b0cbfe954363+27:2409:x1870705565145088:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784044175.452470:0:13182:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784044175.452490:0:13182:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fcc00/0x89871fc3aba18344 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6670 expref: 27 pid: 6513 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044175.452503:0:13182:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fcc00/0x89871fc3aba18344 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6670 expref: 27 pid: 6513 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044175.452526:0:13182:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fcc00/0x89871fc3aba18344 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6670 expref: 27 pid: 6513 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044175.452542:0:13182:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9b3842776900) 00010000:00010000:1.0:1784044175.452547:0:13182:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc200/0x89871fc3aba183b4 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044175.452557:0:13182:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc200/0x89871fc3aba183b4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044175.452565:0:13182:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc200/0x89871fc3aba183b4 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044175.452592:0:13182:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784044175.452659:0:13182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3944090050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a93fdf3c-d42f-420a-95ea-b0cbfe954363+26:2409:x1870705565145088:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 197us (679us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044175.452667:0:13182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 58 00010000:00010000:3.0:1784044175.453748:0:6514:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc200/0x89871fc3aba183b4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044175.453761:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc200/0x89871fc3aba183b4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1784044175.453904:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000001:00080000:3.0:1784044175.454038:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00000100:00100000:3.0:1784044175.454563:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3975b7df80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6514:1870705580976768:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1784044175.454644:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044175.454728:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3843df7b40 going to sleep for 11 seconds 00000100:00100000:0.0:1784044175.456510:0:7768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580976768 00000100:00100000:0.0:1784044175.456527:0:7768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580976768 00000100:00100000:0.0:1784044175.456699:0:7768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1784044175.456715:0:7768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3975b7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6514:x1870705580976768:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1784044175.456922:0:7768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3975b7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6514:x1870705580976768:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 212us (2278us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044175.456931:0:7768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1784044175.457043:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3975b7df80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6514:1870705580976768:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1784044175.457311:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00000100:00100000:3.0:1784044175.457406:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3975b7df80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6514:1870705580976896:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1784044175.457447:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044175.458005:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3843df76c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784044175.458082:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580976896 00000100:00100000:2.0:1784044175.458088:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580976896 00000100:00100000:2.0:1784044175.458133:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1784044175.458142:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3975b7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6514:x1870705580976896:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1784044175.458468:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3975b7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6514:x1870705580976896:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 326us (1019us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1784044175.458476:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1784044175.458561:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3975b7df80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6514:1870705580976896:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1784044175.458619:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967325 00010000:00010000:3.0:1784044175.458666:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc200/0x89871fc3aba183b4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044175.458687:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc200/0x89871fc3aba183b4 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044175.458694:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc200/0x89871fc3aba183b4 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044175.458701:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38426fc200 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:3.0:1784044175.458706:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc200/0x89871fc3aba183b4 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044175.458713:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc200/0x89871fc3aba183b4 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044175.458730:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9b3842776900) 00010000:00010000:3.0:1784044175.458733:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1784044175.458738:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc200/0x89871fc3aba183b4 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044175.458744:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc200/0x89871fc3aba183b4 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1784044175.458851:0:6514:0:(mdd_object.c:4016:mdd_close()) Object [0x200000402:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1784044175.458914:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:3.0:1784044175.458925:0:6514:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 368629750134ns, next at 369629748014ns, rc = 0 00000001:00080000:3.0:1784044175.458932:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967326 00010000:00010000:3.0:1784044175.458953:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9b3842776900) 00010000:00010000:3.0:1784044175.458956:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1784044175.458962:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166be00/0x89871fc3aba1839f lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca669a expref: 30 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044175.459077:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3947ee8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+29:11169:x1870705565144960:12345-192.168.202.40@tcp:35:lfs.0 Request processed in 30049us (30426us total) trans 4294967327 rc 0/0 00000100:00100000:3.0:1784044175.459085:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 8 00000020:00080000:3.0:1784044175.459088:0:6514:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1784044175.462869:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044175.462942:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565145216 00000100:00100000:3.0:1784044175.462951:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565145216 00000100:00100000:3.0:1784044175.463013:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 54 00000100:00100000:3.0:1784044175.463022:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3947ee8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+29:11169:x1870705565145216:12345-192.168.202.40@tcp:101:lfs.0 00010000:00010000:3.0:1784044175.463044:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784044175.463064:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166a400/0x89871fc3aba183bb lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcd3dffad52ca66a1 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044175.463130:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166a400/0x89871fc3aba183bb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca66a1 expref: 30 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044175.463144:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166a400/0x89871fc3aba183bb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca66a1 expref: 30 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044175.463197:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9b397aa61500) 00010000:00010000:3.0:1784044175.463200:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1784044175.463204:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b394166a400, rc 0) 00000100:00100000:3.0:1784044175.463255:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3947ee8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+30:11169:x1870705565145216:12345-192.168.202.40@tcp:101:lfs.0 Request processed in 234us (395us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044175.463262:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 54 00000100:00100000:2.0:1784044175.470719:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044175.471005:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565145472 00000100:00100000:3.0:1784044175.471016:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565145472 00000100:00100000:3.0:1784044175.471092:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 9 00000100:00100000:3.0:1784044175.471104:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3974226050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+30:11169:x1870705565145472:12345-192.168.202.40@tcp:35:lfs.0 00000100:00100000:3.0:1784044175.471575:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3974226050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+31:11169:x1870705565145472:12345-192.168.202.40@tcp:35:lfs.0 Request processed in 472us (863us total) trans 4294967328 rc 0/0 00000100:00100000:3.0:1784044175.471585:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 9 00000100:00100000:2.0:1784044175.609620:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044175.609717:0:9501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565145728 00000100:00100000:0.0:1784044175.609727:0:9501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565145728 00000100:00100000:0.0:1784044175.609788:0:9501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 55 00000100:00100000:0.0:1784044175.609798:0:9501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3947eeb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a93fdf3c-d42f-420a-95ea-b0cbfe954363+31:11179:x1870705565145728:12345-192.168.202.40@tcp:101:lfs.0 00010000:00010000:0.0:1784044175.609822:0:9501:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784044175.609842:0:9501:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6600/0x89871fc3aba183c2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcd3dffad52ca66a8 expref: -99 pid: 9501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784044175.609943:0:9501:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:0.0:1784044175.610049:0:9501:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6600/0x89871fc3aba183c2 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca66a8 expref: 33 pid: 9501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044175.610064:0:9501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b39758c1000) 00010000:00010000:0.0:1784044175.610066:0:9501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1784044175.610071:0:9501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6600/0x89871fc3aba183c2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca66a8 expref: 33 pid: 9501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044175.610084:0:9501:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b38410b6600, rc 0) 00000100:00100000:0.0:1784044175.611737:0:9501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3947eeb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a93fdf3c-d42f-420a-95ea-b0cbfe954363+32:11179:x1870705565145728:12345-192.168.202.40@tcp:101:lfs.0 Request processed in 1926us (2439us total) trans 4294967329 rc 301/301 00000100:00100000:0.0:1784044175.611751:0:9501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 55 00000100:00100000:2.0:1784044175.626778:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044175.626865:0:13808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565145856 00000100:00100000:0.0:1784044175.626877:0:13808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565145856 00000100:00100000:0.0:1784044175.626952:0:13808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 56 00000100:00100000:0.0:1784044175.626962:0:13808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3947ee9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a93fdf3c-d42f-420a-95ea-b0cbfe954363+32:11179:x1870705565145856:12345-192.168.202.40@tcp:34:lfs.0 00010000:00010000:0.0:1784044175.627053:0:13808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7800/0x89871fc3aba183d0 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044175.627087:0:13808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7800/0x89871fc3aba183d0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044175.627100:0:13808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7800/0x89871fc3aba183d0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044175.627124:0:13808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6000/0x89871fc3aba183d7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044175.627130:0:13808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6000/0x89871fc3aba183d7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044175.627136:0:13808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6000/0x89871fc3aba183d7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044175.627257:0:13808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6800/0x89871fc3aba183de lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044175.627266:0:13808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6800/0x89871fc3aba183de lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044175.627272:0:13808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6800/0x89871fc3aba183de lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784044175.627329:0:13808:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6800/0x89871fc3aba183de lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044175.627342:0:13808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7800/0x89871fc3aba183d0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044175.627348:0:13808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7800/0x89871fc3aba183d0 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044175.627364:0:13808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7800/0x89871fc3aba183d0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044175.627370:0:13808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38410b7800 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:0.0:1784044175.627375:0:13808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7800/0x89871fc3aba183d0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044175.627384:0:13808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7800/0x89871fc3aba183d0 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044175.627397:0:13808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9b397aa61900) 00010000:00010000:0.0:1784044175.627400:0:13808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784044175.627405:0:13808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7800/0x89871fc3aba183d0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044175.627412:0:13808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7800/0x89871fc3aba183d0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044175.627428:0:13808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6000/0x89871fc3aba183d7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044175.627434:0:13808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6000/0x89871fc3aba183d7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044175.627440:0:13808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6000/0x89871fc3aba183d7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044175.627445:0:13808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38410b6000 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:0.0:1784044175.627448:0:13808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6000/0x89871fc3aba183d7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044175.627463:0:13808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6000/0x89871fc3aba183d7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044175.627471:0:13808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9b3842776700) 00010000:00010000:0.0:1784044175.627473:0:13808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784044175.627476:0:13808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6000/0x89871fc3aba183d7 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044175.627481:0:13808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6000/0x89871fc3aba183d7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044175.627490:0:13808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6800/0x89871fc3aba183de lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044175.627496:0:13808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6800/0x89871fc3aba183de lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044175.627502:0:13808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6800/0x89871fc3aba183de lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044175.627507:0:13808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38410b6800 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:0.0:1784044175.627510:0:13808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6800/0x89871fc3aba183de lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044175.627515:0:13808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6800/0x89871fc3aba183de lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044175.627522:0:13808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9b397aa61500) 00010000:00010000:0.0:1784044175.627525:0:13808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784044175.627527:0:13808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6800/0x89871fc3aba183de lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044175.627542:0:13808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6800/0x89871fc3aba183de lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044175.627625:0:13808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3947ee9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a93fdf3c-d42f-420a-95ea-b0cbfe954363+32:11179:x1870705565145856:12345-192.168.202.40@tcp:34:lfs.0 Request processed in 663us (858us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044175.627635:0:13808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 56 00000100:00100000:1.0:1784044175.630283:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044175.631447:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565146112 00000100:00100000:3.0:1784044175.631462:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565146112 00000100:00100000:3.0:1784044175.631531:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 10 00000100:00100000:3.0:1784044175.631544:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3943eb3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+32:11179:x1870705565146112:12345-192.168.202.40@tcp:35:lfs.0 00000100:00100000:3.0:1784044175.631797:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3943eb3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+33:11179:x1870705565146112:12345-192.168.202.40@tcp:35:lfs.0 Request processed in 257us (1523us total) trans 4294967330 rc 0/0 00000100:00100000:3.0:1784044175.631805:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 10 00000100:00100000:2.0:1784044175.712763:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044175.712884:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565146368 00000100:00100000:0.0:1784044175.712896:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565146368 00000100:00100000:0.0:1784044175.712965:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 57 00000100:00100000:0.0:1784044175.712977:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3947eea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+33:11182:x1870705565146368:12345-192.168.202.40@tcp:101:lfs.0 00010000:00010000:0.0:1784044175.713006:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784044175.713033:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6800/0x89871fc3aba183e5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcd3dffad52ca66af expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044175.713122:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6000/0x89871fc3aba183ec lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044175.713138:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6000/0x89871fc3aba183ec lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044175.713149:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6000/0x89871fc3aba183ec lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044175.713161:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7800/0x89871fc3aba183f3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044175.713168:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7800/0x89871fc3aba183f3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044175.713231:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7800/0x89871fc3aba183f3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044175.713358:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6600/0x89871fc3aba183fa lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044175.713367:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6600/0x89871fc3aba183fa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044175.713374:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6600/0x89871fc3aba183fa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784044175.713385:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:0.0:1784044175.713468:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6000/0x89871fc3aba183ec lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044175.713475:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6000/0x89871fc3aba183ec lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044175.713481:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6000/0x89871fc3aba183ec lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044175.713488:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38410b6000 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:0.0:1784044175.713492:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6000/0x89871fc3aba183ec lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044175.713498:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6000/0x89871fc3aba183ec lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044175.713509:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9b397aa61900) 00010000:00010000:0.0:1784044175.713512:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784044175.713522:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6000/0x89871fc3aba183ec lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044175.713528:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6000/0x89871fc3aba183ec lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044175.713539:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7800/0x89871fc3aba183f3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044175.713545:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7800/0x89871fc3aba183f3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044175.713550:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7800/0x89871fc3aba183f3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044175.713555:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38410b7800 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:0.0:1784044175.713558:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7800/0x89871fc3aba183f3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044175.713564:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7800/0x89871fc3aba183f3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044175.713571:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9b3842776700) 00010000:00010000:0.0:1784044175.713574:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784044175.713577:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7800/0x89871fc3aba183f3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044175.713582:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7800/0x89871fc3aba183f3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044175.713617:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6800/0x89871fc3aba183e5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca66af expref: 36 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044175.713643:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6600/0x89871fc3aba183fa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca66af expref: 35 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044175.713663:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9b397aa61500) 00010000:00010000:0.0:1784044175.713665:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784044175.713668:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b38410b6600, rc 0) 00000100:00100000:0.0:1784044175.713731:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3947eea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+35:11182:x1870705565146368:12345-192.168.202.40@tcp:101:lfs.0 Request processed in 757us (979us total) trans 4294967331 rc 0/0 00000100:00100000:0.0:1784044175.713740:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 57 00000100:00100000:0.0:1784044175.718364:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1784044175.718516:0:9501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565146496 00000100:00100000:1.0:1784044175.718527:0:9501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565146496 00000100:00100000:1.0:1784044175.718594:0:9501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 58 00000100:00100000:1.0:1784044175.718605:0:9501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397f944380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a93fdf3c-d42f-420a-95ea-b0cbfe954363+35:11182:x1870705565146496:12345-192.168.202.40@tcp:54:lfs.0 00010000:00010000:1.0:1784044175.718702:0:9501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc600/0x89871fc3aba18408 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044175.718740:0:9501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc600/0x89871fc3aba18408 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044175.718754:0:9501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc600/0x89871fc3aba18408 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044175.718811:0:9501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc600/0x89871fc3aba18408 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044175.718819:0:9501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc600/0x89871fc3aba18408 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044175.718827:0:9501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc600/0x89871fc3aba18408 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044175.718833:0:9501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38426fc600 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:1.0:1784044175.718838:0:9501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc600/0x89871fc3aba18408 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044175.718847:0:9501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc600/0x89871fc3aba18408 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044175.718862:0:9501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9b397aa61500) 00010000:00010000:1.0:1784044175.718866:0:9501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1784044175.718870:0:9501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc600/0x89871fc3aba18408 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044175.718878:0:9501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc600/0x89871fc3aba18408 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044175.718975:0:9501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397f944380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a93fdf3c-d42f-420a-95ea-b0cbfe954363+35:11182:x1870705565146496:12345-192.168.202.40@tcp:54:lfs.0 Request processed in 371us (622us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044175.718990:0:9501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 58 00000100:00100000:1.0:1784044175.724932:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044175.725059:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565146752 00000100:00100000:3.0:1784044175.725079:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565146752 00000100:00100000:2.0:1784044175.725284:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 11 00000100:00100000:2.0:1784044175.725303:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3943eb2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+35:11182:x1870705565146752:12345-192.168.202.40@tcp:35:lfs.0 00000100:00100000:2.0:1784044175.725610:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3943eb2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+36:11182:x1870705565146752:12345-192.168.202.40@tcp:35:lfs.0 Request processed in 314us (689us total) trans 4294967332 rc 0/0 00000100:00100000:2.0:1784044175.725618:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 11 00000100:00100000:2.0:1784044175.957053:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044175.957262:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565147008 00000100:00100000:3.0:1784044175.957277:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565147008 00000100:00100000:3.0:1784044175.957676:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 59 00000100:00100000:3.0:1784044175.957691:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3947ee8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+36:11213:x1870705565147008:12345-192.168.202.40@tcp:101:cat.0 00010000:00010000:3.0:1784044175.957734:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784044175.957766:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166be00/0x89871fc3aba1840f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcd3dffad52ca66b6 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044175.957944:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166ae00/0x89871fc3aba18416 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044175.957965:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166ae00/0x89871fc3aba18416 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044175.958008:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166ae00/0x89871fc3aba18416 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784044175.958025:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:3.0:1784044175.958257:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166be00/0x89871fc3aba1840f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca66b6 expref: 39 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044175.958293:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166ae00/0x89871fc3aba18416 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca66b6 expref: 38 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044175.958304:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9b397aa61500) 00010000:00010000:3.0:1784044175.958308:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784044175.958312:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b394166ae00, rc 0) 00000100:00100000:3.0:1784044175.958403:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3947ee8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+38:11213:x1870705565147008:12345-192.168.202.40@tcp:101:cat.0 Request processed in 715us (1364us total) trans 4294967333 rc 0/0 00000100:00100000:3.0:1784044175.958412:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 59 00000100:00100000:0.0:1784044175.964251:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044175.964311:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044175.964508:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565147264 00000100:00100000:3.0:1784044175.964523:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565147264 00000100:00100000:3.0:1784044175.964600:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 12 00000100:00100000:3.0:1784044175.964614:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397f947480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+38:11213:x1870705565147264:12345-192.168.202.40@tcp:35:cat.0 00000100:00100000:3.0:1784044175.965003:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397f947480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+39:11213:x1870705565147264:12345-192.168.202.40@tcp:35:cat.0 Request processed in 390us (768us total) trans 4294967334 rc 0/0 00000100:00100000:3.0:1784044175.965012:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 12 00000100:00100000:1.0:1784044175.966241:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565147392 00000100:00100000:1.0:1784044175.966253:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565147392 00000100:00100000:1.0:1784044175.966355:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4 00000100:00100000:1.0:1784044175.966365:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397f946680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+39:2410:x1870705565147392:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784044175.966392:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784044175.966428:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166ae00/0x89871fc3aba18416 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca66b6 expref: 39 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044175.966455:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9b397aa61500) 00010000:00010000:1.0:1784044175.966461:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784044175.966532:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397f946680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+38:2410:x1870705565147392:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 168us (2219us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044175.966541:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4 00010000:00010000:1.0:1784044176.013575:0:10330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784044176.027708:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044176.027974:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565147648 00000100:00100000:3.0:1784044176.027990:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565147648 00000100:00100000:3.0:1784044176.028113:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 60 00000100:00100000:3.0:1784044176.028129:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397f944e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+38:11219:x1870705565147648:12345-192.168.202.40@tcp:101:dd.0 00010000:00010000:3.0:1784044176.028233:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784044176.028238:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00000100:00080000:1.0:1784044176.028377:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1784044176.028748:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166ac00/0x89871fc3aba1837c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca668c expref: 38 pid: 13808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044176.028779:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9b397aa61900) 00010000:00010000:3.0:1784044176.028786:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784044176.028877:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7800/0x89871fc3aba18424 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcd3dffad52ca66bd expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044176.029040:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6000/0x89871fc3aba1842b lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044176.029058:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6600/0x89871fc3aba183fa lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca66af expref: 38 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044176.029068:0:6513:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6000/0x89871fc3aba1842b lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044176.029130:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6600/0x89871fc3aba183fa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca66af expref: 38 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044176.029165:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6600/0x89871fc3aba183fa lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca66af expref: 38 pid: 6511 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044176.029217:0:6513:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397f944700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6513:1870705580977024:192.168.202.40@tcp:104: 00000100:00100000:0.0:1784044176.029789:0:6513:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3942467480 going to sleep for 11 seconds 00000100:00100000:3.0:1784044176.032624:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1784044176.032797:0:13182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565147776 00000100:00100000:1.0:1784044176.032810:0:13182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565147776 00010000:00010000:1.0:1784044176.032881:0:13182:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6600/0x89871fc3aba183fa lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca66af expref: 39 pid: 6511 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044176.032945:0:13182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 59 00000100:00100000:1.0:1784044176.032957:0:13182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3975b52680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a93fdf3c-d42f-420a-95ea-b0cbfe954363+39:2409:x1870705565147776:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784044176.032978:0:13182:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784044176.032986:0:13182:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6600/0x89871fc3aba183fa lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca66af expref: 39 pid: 6511 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044176.033018:0:13182:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6600/0x89871fc3aba183fa lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca66af expref: 39 pid: 6511 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044176.033051:0:13182:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9b397aa61500) 00010000:00010000:1.0:1784044176.033057:0:13182:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6000/0x89871fc3aba1842b lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044176.033069:0:13182:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6000/0x89871fc3aba1842b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044176.033079:0:13182:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6000/0x89871fc3aba1842b lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044176.033105:0:13182:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784044176.033223:0:13182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3975b52680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a93fdf3c-d42f-420a-95ea-b0cbfe954363+39:2409:x1870705565147776:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 267us (614us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044176.033232:0:13182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 59 00010000:00010000:0.0:1784044176.034598:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6600/0x89871fc3aba183fa lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca66af expref: 38 pid: 6511 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044176.034628:0:6513:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397f944700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6513:1870705580977024:192.168.202.40@tcp:104: 00010000:00010000:0.0:1784044176.034677:0:6513:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6000/0x89871fc3aba1842b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044176.034690:0:6513:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6000/0x89871fc3aba1842b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044176.034697:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6000/0x89871fc3aba1842b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784044176.034721:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:0.0:1784044176.034942:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7800/0x89871fc3aba18424 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca66bd expref: 39 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044176.034962:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6000/0x89871fc3aba1842b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca66bd expref: 38 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044176.034974:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9b397aa61500) 00010000:00010000:0.0:1784044176.034995:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1784044176.034999:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b38410b6000, rc 0) 00000100:00100000:0.0:1784044176.035086:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397f944e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+38:11219:x1870705565147648:12345-192.168.202.40@tcp:101:dd.0 Request processed in 6959us (7397us total) trans 4294967335 rc 0/0 00000100:00100000:0.0:1784044176.035096:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 60 00000100:00100000:3.0:1784044176.043690:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044176.043871:0:13808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565147904 00000100:00100000:0.0:1784044176.043885:0:13808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565147904 00000100:00100000:0.0:1784044176.043974:0:13808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 61 00000100:00100000:0.0:1784044176.043988:0:13808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3975b50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a93fdf3c-d42f-420a-95ea-b0cbfe954363+38:11219:x1870705565147904:12345-192.168.202.40@tcp:101:dd.0 00010000:00010000:0.0:1784044176.044025:0:13808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784044176.044056:0:13808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7800/0x89871fc3aba18439 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcd3dffad52ca66c4 expref: -99 pid: 13808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044176.044116:0:13808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6600/0x89871fc3aba18440 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044176.044135:0:13808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6600/0x89871fc3aba18440 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044176.044149:0:13808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6600/0x89871fc3aba18440 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044176.044363:0:13808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7800/0x89871fc3aba18439 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca66c4 expref: 40 pid: 13808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044176.044401:0:13808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6600/0x89871fc3aba18440 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca66c4 expref: 39 pid: 13808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044176.044413:0:13808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9b397aa61500) 00010000:00010000:0.0:1784044176.044424:0:13808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1784044176.044430:0:13808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b38410b6600, rc 0) 00000100:00100000:0.0:1784044176.044517:0:13808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3975b50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a93fdf3c-d42f-420a-95ea-b0cbfe954363+39:11219:x1870705565147904:12345-192.168.202.40@tcp:101:dd.0 Request processed in 531us (854us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044176.044527:0:13808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 61 00000100:00100000:3.0:1784044176.048660:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044176.048779:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565148160 00000100:00100000:0.0:1784044176.048796:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565148160 00000100:00100000:0.0:1784044176.048889:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 62 00000100:00100000:0.0:1784044176.048902:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3975b50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+39:11219:x1870705565148160:12345-192.168.202.40@tcp:36:dd.0 00010000:00010000:0.0:1784044176.049300:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7e00/0x89871fc3aba18447 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044176.049323:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7e00/0x89871fc3aba18447 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044176.049337:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7e00/0x89871fc3aba18447 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1784044176.049392:0:6512:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967336 00000004:00010000:0.0:1784044176.049417:0:6512:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000383d681b reply state 0000000058ff6560 transno 4294967337 ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7e00/0x89871fc3aba18447 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044176.049432:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7e00/0x89871fc3aba18447 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044176.049441:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9b397aa61500) 00010000:00010000:0.0:1784044176.049444:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1784044176.049449:0:6512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1784044176.049579:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3975b50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+42:11219:x1870705565148160:12345-192.168.202.40@tcp:36:dd.0 Request processed in 677us (945us total) trans 4294967337 rc 0/0 00000100:00100000:0.0:1784044176.049589:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 62 00000020:00080000:0.0:1784044176.049617:0:6512:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1784044176.483461:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044176.483629:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565148288 00000100:00100000:0.0:1784044176.483657:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565148288 00000100:00100000:0.0:1784044176.483756:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 63 00000100:00100000:0.0:1784044176.483771:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3943eb3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+42:11233:x1870705565148288:12345-192.168.202.40@tcp:101:stat.0 00010000:00010000:0.0:1784044176.483810:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784044176.483842:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7800/0x89871fc3aba1844e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcd3dffad52ca66cb expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044176.483938:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6800/0x89871fc3aba18455 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044176.483955:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6800/0x89871fc3aba18455 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044176.483968:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6800/0x89871fc3aba18455 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044176.483981:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6200/0x89871fc3aba1845c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044176.483989:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6200/0x89871fc3aba1845c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044176.483996:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6200/0x89871fc3aba1845c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044176.484096:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7c00/0x89871fc3aba18463 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044176.484108:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6000/0x89871fc3aba1842b lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca66bd expref: 43 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044176.484497:0:6513:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7c00/0x89871fc3aba18463 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044176.484547:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6000/0x89871fc3aba1842b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca66bd expref: 43 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044176.484564:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6000/0x89871fc3aba1842b lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca66bd expref: 43 pid: 6513 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044176.484583:0:6513:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397f944700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6513:1870705580977152:192.168.202.40@tcp:104: 00000100:00100000:0.0:1784044176.484759:0:6513:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b397b763480 going to sleep for 11 seconds 00000100:00100000:0.0:1784044176.488588:0:6513:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397f944700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6513:1870705580977152:192.168.202.40@tcp:104: 00010000:00010000:0.0:1784044176.488636:0:6513:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7c00/0x89871fc3aba18463 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044176.490301:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044176.490655:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565148544 00000100:00100000:3.0:1784044176.490668:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565148544 00000100:00100000:3.0:1784044176.490764:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 13 00000100:00100000:3.0:1784044176.490778:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397f944700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+44:6177:x1870705565148544:12345-192.168.202.40@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1784044176.491261:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397f944700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+45:6177:x1870705565148544:12345-192.168.202.40@tcp:35:ldlm_bl.0 Request processed in 483us (986us total) trans 4294967338 rc 0/0 00000100:00100000:3.0:1784044176.491272:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 13 00000100:00100000:3.0:1784044176.495865:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1784044176.495991:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565148672 00000100:00100000:1.0:1784044176.496006:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565148672 00010000:00010000:1.0:1784044176.496066:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6000/0x89871fc3aba1842b lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca66bd expref: 45 pid: 6513 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044176.496162:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 60 00000100:00100000:1.0:1784044176.496213:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3975b53480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+45:2410:x1870705565148672:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784044176.496236:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784044176.496246:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6000/0x89871fc3aba1842b lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca66bd expref: 45 pid: 6513 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044176.496296:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6000/0x89871fc3aba1842b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca66bd expref: 45 pid: 6513 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044176.496334:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6000/0x89871fc3aba1842b lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca66bd expref: 45 pid: 6513 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044176.496363:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9b397aa61500) 00010000:00010000:1.0:1784044176.496369:0:6496:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7c00/0x89871fc3aba18463 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044176.496394:0:6496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7c00/0x89871fc3aba18463 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044176.496406:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7c00/0x89871fc3aba18463 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044176.496444:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784044176.496521:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3975b53480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+44:2410:x1870705565148672:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 348us (671us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044176.496530:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 60 00010000:00010000:3.0:1784044176.497047:0:6513:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7c00/0x89871fc3aba18463 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044176.497059:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7c00/0x89871fc3aba18463 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784044176.497134:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:3.0:1784044176.497139:0:6513:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1784044176.497219:0:6513:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7c00/0x89871fc3aba18463 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044176.497251:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7c00/0x89871fc3aba18463 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044176.497264:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6800/0x89871fc3aba18455 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044176.497271:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6800/0x89871fc3aba18455 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044176.497278:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6800/0x89871fc3aba18455 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044176.497292:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38410b6800 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:3.0:1784044176.497297:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6800/0x89871fc3aba18455 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044176.497304:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6800/0x89871fc3aba18455 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044176.497318:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9b397aa61900) 00010000:00010000:3.0:1784044176.497321:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784044176.497324:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6800/0x89871fc3aba18455 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044176.497330:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6800/0x89871fc3aba18455 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044176.497342:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6200/0x89871fc3aba1845c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044176.497347:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6200/0x89871fc3aba1845c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044176.497359:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6200/0x89871fc3aba1845c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044176.497364:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38410b6200 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:3.0:1784044176.497367:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6200/0x89871fc3aba1845c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044176.497373:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6200/0x89871fc3aba1845c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044176.497392:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9b3842776700) 00010000:00010000:3.0:1784044176.497394:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784044176.497397:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6200/0x89871fc3aba1845c lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044176.497402:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6200/0x89871fc3aba1845c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044176.497444:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7800/0x89871fc3aba1844e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca66cb expref: 44 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044176.497460:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7c00/0x89871fc3aba18463 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca66cb expref: 43 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044176.497468:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9b397aa61500) 00010000:00010000:3.0:1784044176.497470:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784044176.497472:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b38410b7c00, rc 0) 00000100:00100000:3.0:1784044176.497532:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3943eb3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+43:11233:x1870705565148288:12345-192.168.202.40@tcp:101:stat.0 Request processed in 13765us (14373us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044176.497549:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 63 00000100:00100000:3.0:1784044176.604810:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044176.606004:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565148928 00000100:00100000:0.0:1784044176.606036:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565148928 00000100:00100000:0.0:1784044176.606155:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 64 00000100:00100000:0.0:1784044176.606169:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3975b50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+43:11239:x1870705565148928:12345-192.168.202.40@tcp:36:truncate.0 00010000:00010000:0.0:1784044176.606356:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784044176.606393:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7c00/0x89871fc3aba18463 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca66cb expref: 43 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044176.606419:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9b397aa61500) 00010000:00010000:0.0:1784044176.606435:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784044176.606693:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7600/0x89871fc3aba1846a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044176.606711:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7600/0x89871fc3aba1846a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044176.606724:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7600/0x89871fc3aba1846a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1784044176.606778:0:6511:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967339 00000004:00010000:0.0:1784044176.606801:0:6511:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000fc5980b5 reply state 00000000b4be8fde transno 4294967340 ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7600/0x89871fc3aba1846a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044176.606815:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7600/0x89871fc3aba1846a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044176.606835:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9b397aa61500) 00010000:00010000:0.0:1784044176.606837:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1784044176.606840:0:6511:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1784044176.607003:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3975b50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+45:11239:x1870705565148928:12345-192.168.202.40@tcp:36:truncate.0 Request processed in 835us (2204us total) trans 4294967340 rc 0/0 00000100:00100000:0.0:1784044176.607012:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 64 00000020:00080000:0.0:1784044176.607019:0:6511:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1784044176.835001:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1784044176.835395:0:9501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565149056 00000100:00100000:1.0:1784044176.835407:0:9501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565149056 00000100:00100000:1.0:1784044176.835558:0:9501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 65 00000100:00100000:1.0:1784044176.835571:0:9501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3947eebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a93fdf3c-d42f-420a-95ea-b0cbfe954363+45:11253:x1870705565149056:12345-192.168.202.40@tcp:101:stat.0 00010000:00010000:1.0:1784044176.835607:0:9501:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784044176.835651:0:9501:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fde00/0x89871fc3aba18471 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcd3dffad52ca66d2 expref: -99 pid: 9501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044176.835802:0:9501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc400/0x89871fc3aba18478 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044176.836013:0:9501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc400/0x89871fc3aba18478 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044176.836035:0:9501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc400/0x89871fc3aba18478 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044176.836051:0:9501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd400/0x89871fc3aba1847f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044176.836059:0:9501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd400/0x89871fc3aba1847f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044176.836067:0:9501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd400/0x89871fc3aba1847f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044176.836210:0:9501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd800/0x89871fc3aba18486 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044176.836220:0:9501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd800/0x89871fc3aba18486 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044176.836227:0:9501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd800/0x89871fc3aba18486 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784044176.836698:0:9501:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00000004:00200000:1.0:1784044176.836705:0:9501:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1784044176.836742:0:9501:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd800/0x89871fc3aba18486 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044176.836780:0:9501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd800/0x89871fc3aba18486 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044176.836803:0:9501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc400/0x89871fc3aba18478 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044176.836813:0:9501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc400/0x89871fc3aba18478 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044176.836940:0:9501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc400/0x89871fc3aba18478 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044176.836948:0:9501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38426fc400 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:1.0:1784044176.836953:0:9501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc400/0x89871fc3aba18478 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044176.836963:0:9501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc400/0x89871fc3aba18478 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044176.837062:0:9501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9b397aa61900) 00010000:00010000:1.0:1784044176.837066:0:9501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784044176.837072:0:9501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc400/0x89871fc3aba18478 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044176.837079:0:9501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc400/0x89871fc3aba18478 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044176.837099:0:9501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd400/0x89871fc3aba1847f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044176.837105:0:9501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd400/0x89871fc3aba1847f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044176.837119:0:9501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd400/0x89871fc3aba1847f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044176.837124:0:9501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38426fd400 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:1.0:1784044176.837127:0:9501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd400/0x89871fc3aba1847f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044176.837134:0:9501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd400/0x89871fc3aba1847f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044176.837142:0:9501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9b3842776700) 00010000:00010000:1.0:1784044176.837144:0:9501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784044176.837147:0:9501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd400/0x89871fc3aba1847f lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044176.837152:0:9501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd400/0x89871fc3aba1847f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044176.837247:0:9501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fde00/0x89871fc3aba18471 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca66d2 expref: 47 pid: 9501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044176.837265:0:9501:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd800/0x89871fc3aba18486 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca66d2 expref: 46 pid: 9501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044176.837273:0:9501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9b397aa61500) 00010000:00010000:1.0:1784044176.837276:0:9501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784044176.837278:0:9501:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b38426fd800, rc 0) 00000100:00100000:1.0:1784044176.837996:0:9501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3947eebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a93fdf3c-d42f-420a-95ea-b0cbfe954363+46:11253:x1870705565149056:12345-192.168.202.40@tcp:101:stat.0 Request processed in 2419us (3004us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044176.838030:0:9501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 65 00000100:00100000:1.0:1784044176.975782:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044176.976234:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565149312 00000100:00100000:3.0:1784044176.976255:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565149312 00000100:00100000:3.0:1784044176.976340:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 66 00000100:00100000:3.0:1784044176.976618:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3943eb1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+46:11263:x1870705565149312:12345-192.168.202.40@tcp:101:lfs.0 00010000:00010000:3.0:1784044176.976656:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784044176.976686:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166ac00/0x89871fc3aba1848d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcd3dffad52ca66d9 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784044176.976839:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:3.0:1784044176.976958:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166ac00/0x89871fc3aba1848d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca66d9 expref: 48 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044176.976974:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b39758c1000) 00010000:00010000:3.0:1784044176.976978:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1784044176.976983:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166ac00/0x89871fc3aba1848d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca66d9 expref: 48 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044176.976998:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b394166ac00, rc 0) 00000100:00100000:3.0:1784044176.977083:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3943eb1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+47:11263:x1870705565149312:12345-192.168.202.40@tcp:101:lfs.0 Request processed in 734us (1330us total) trans 4294967341 rc 301/301 00000100:00100000:3.0:1784044176.978630:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 66 00000100:00100000:3.0:1784044176.986549:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044176.986720:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565149568 00000100:00100000:2.0:1784044176.986729:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565149568 00000100:00100000:2.0:1784044176.986785:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 14 00000100:00100000:2.0:1784044176.986794:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3975b53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+47:11263:x1870705565149568:12345-192.168.202.40@tcp:35:lfs.0 00000100:00100000:2.0:1784044176.987026:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3975b53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+48:11263:x1870705565149568:12345-192.168.202.40@tcp:35:lfs.0 Request processed in 232us (486us total) trans 4294967342 rc 0/0 00000100:00100000:2.0:1784044176.987034:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 14 00010000:00010000:3.0:1784044177.037403:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784044177.074576:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044177.074686:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565149824 00000100:00100000:3.0:1784044177.074709:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565149824 00000100:00100000:3.0:1784044177.074780:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 67 00000100:00100000:3.0:1784044177.074790:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397f9df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+48:11269:x1870705565149824:12345-192.168.202.40@tcp:101:bash.0 00010000:00010000:3.0:1784044177.074816:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784044177.074839:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166ac00/0x89871fc3aba1849b lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcd3dffad52ca66e0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044177.074956:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166be00/0x89871fc3aba184a2 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044177.074972:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd800/0x89871fc3aba18486 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca66d2 expref: 49 pid: 9501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044177.074982:0:6512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166be00/0x89871fc3aba184a2 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044177.075020:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd800/0x89871fc3aba18486 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca66d2 expref: 49 pid: 9501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044177.075033:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd800/0x89871fc3aba18486 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca66d2 expref: 49 pid: 9501 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044177.075048:0:6512:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3975b50380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6512:1870705580977280:192.168.202.40@tcp:104: 00000100:00100000:3.0:1784044177.075154:0:6512:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3843df7000 going to sleep for 11 seconds 00000100:00100000:1.0:1784044177.084056:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044177.084166:0:13182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565149952 00000100:00100000:0.0:1784044177.084205:0:13182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565149952 00010000:00010000:0.0:1784044177.084247:0:13182:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd800/0x89871fc3aba18486 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca66d2 expref: 50 pid: 9501 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044177.084286:0:13182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 61 00000100:00100000:0.0:1784044177.084295:0:13182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3943eb0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a93fdf3c-d42f-420a-95ea-b0cbfe954363+50:2410:x1870705565149952:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784044177.084323:0:13182:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784044177.084331:0:13182:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd800/0x89871fc3aba18486 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca66d2 expref: 50 pid: 9501 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044177.084345:0:13182:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd800/0x89871fc3aba18486 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca66d2 expref: 50 pid: 9501 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044177.084366:0:13182:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9b397aa61500) 00010000:00010000:0.0:1784044177.084380:0:13182:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166be00/0x89871fc3aba184a2 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044177.084391:0:13182:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166be00/0x89871fc3aba184a2 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044177.084399:0:13182:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166be00/0x89871fc3aba184a2 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044177.084417:0:13182:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784044177.084461:0:13182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3943eb0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a93fdf3c-d42f-420a-95ea-b0cbfe954363+50:2410:x1870705565149952:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 167us (414us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044177.084468:0:13182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 61 00010000:00010000:3.0:1784044177.085610:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd800/0x89871fc3aba18486 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca66d2 expref: 49 pid: 9501 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044177.085646:0:6512:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3975b50380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6512:1870705580977280:192.168.202.40@tcp:104: 00010000:00010000:3.0:1784044177.085683:0:6512:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166be00/0x89871fc3aba184a2 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044177.085693:0:6512:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166be00/0x89871fc3aba184a2 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044177.085699:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166be00/0x89871fc3aba184a2 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784044177.085721:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00010000:00010000:3.0:1784044177.085867:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166ac00/0x89871fc3aba1849b lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca66e0 expref: 50 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044177.085885:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166be00/0x89871fc3aba184a2 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca66e0 expref: 49 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044177.085894:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9b397aa61500) 00010000:00010000:3.0:1784044177.085896:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1784044177.085899:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b394166be00, rc 0) 00000100:00100000:3.0:1784044177.085957:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397f9df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+49:11269:x1870705565149824:12345-192.168.202.40@tcp:101:bash.0 Request processed in 11168us (11392us total) trans 4294967343 rc 0/0 00000100:00100000:3.0:1784044177.085965:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 67 00000100:00100000:1.0:1784044177.091082:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044177.091782:0:9501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565150208 00000100:00100000:0.0:1784044177.091794:0:9501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565150208 00000100:00100000:0.0:1784044177.091861:0:9501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 68 00000100:00100000:0.0:1784044177.091874:0:9501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3943eb0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a93fdf3c-d42f-420a-95ea-b0cbfe954363+49:11269:x1870705565150208:12345-192.168.202.40@tcp:36:bash.0 00010000:00010000:0.0:1784044177.092141:0:9501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7c00/0x89871fc3aba184b0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044177.092203:0:9501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7c00/0x89871fc3aba184b0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044177.092232:0:9501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7c00/0x89871fc3aba184b0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1784044177.092281:0:9501:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967344 00000004:00010000:0.0:1784044177.092302:0:9501:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000979cc48e reply state 0000000034685b62 transno 4294967345 ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7c00/0x89871fc3aba184b0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044177.092315:0:9501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7c00/0x89871fc3aba184b0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044177.092322:0:9501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9b397aa61500) 00010000:00010000:0.0:1784044177.092325:0:9501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1784044177.092328:0:9501:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1784044177.092774:0:9501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3943eb0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a93fdf3c-d42f-420a-95ea-b0cbfe954363+52:11269:x1870705565150208:12345-192.168.202.40@tcp:36:bash.0 Request processed in 901us (1701us total) trans 4294967345 rc 0/0 00000100:00100000:0.0:1784044177.092781:0:9501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 68 00000020:00080000:0.0:1784044177.092787:0:9501:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1784044177.113038:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044177.113137:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565150336 00000100:00100000:3.0:1784044177.113149:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565150336 00000100:00100000:3.0:1784044177.113257:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 69 00000100:00100000:3.0:1784044177.113266:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3943eb1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+52:11269:x1870705565150336:12345-192.168.202.40@tcp:101:bash.0 00010000:00010000:3.0:1784044177.113294:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784044177.113314:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166ac00/0x89871fc3aba184b7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcd3dffad52ca66e7 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044177.113427:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166b800/0x89871fc3aba184be lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044177.113443:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166be00/0x89871fc3aba184a2 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca66e0 expref: 53 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044177.113451:0:6513:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166b800/0x89871fc3aba184be lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044177.113485:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166be00/0x89871fc3aba184a2 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca66e0 expref: 53 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044177.113499:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166be00/0x89871fc3aba184a2 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca66e0 expref: 53 pid: 6512 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044177.113513:0:6513:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3975b50380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6513:1870705580977408:192.168.202.40@tcp:104: 00000100:00100000:3.0:1784044177.113600:0:6513:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3843df7000 going to sleep for 11 seconds 00000100:00100000:1.0:1784044177.120648:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044177.120774:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565150464 00000100:00100000:2.0:1784044177.120784:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565150464 00010000:00010000:2.0:1784044177.120835:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166be00/0x89871fc3aba184a2 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca66e0 expref: 54 pid: 6512 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044177.120886:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 62 00000100:00100000:2.0:1784044177.120897:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3943eb2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+54:2409:x1870705565150464:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784044177.120915:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784044177.120922:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166be00/0x89871fc3aba184a2 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca66e0 expref: 54 pid: 6512 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044177.120937:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166be00/0x89871fc3aba184a2 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca66e0 expref: 54 pid: 6512 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044177.120995:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9b397aa61500) 00010000:00010000:2.0:1784044177.121002:0:6496:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166b800/0x89871fc3aba184be lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044177.121013:0:6496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166b800/0x89871fc3aba184be lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044177.121021:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166b800/0x89871fc3aba184be lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044177.121041:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784044177.121098:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3943eb2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+54:2409:x1870705565150464:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 202us (468us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044177.121106:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 62 00010000:00010000:3.0:1784044177.121908:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166be00/0x89871fc3aba184a2 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca66e0 expref: 53 pid: 6512 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044177.121927:0:6513:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3975b50380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6513:1870705580977408:192.168.202.40@tcp:104: 00010000:00010000:3.0:1784044177.121947:0:6513:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166b800/0x89871fc3aba184be lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044177.121957:0:6513:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166b800/0x89871fc3aba184be lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044177.121979:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166b800/0x89871fc3aba184be lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784044177.122039:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:3.0:1784044177.122044:0:6513:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1784044177.122067:0:6513:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166b800/0x89871fc3aba184be lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044177.122107:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166ac00/0x89871fc3aba184b7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca66e7 expref: 53 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044177.122124:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166b800/0x89871fc3aba184be lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca66e7 expref: 52 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044177.122132:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9b397aa61500) 00010000:00010000:3.0:1784044177.122135:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784044177.122137:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b394166b800, rc 0) 00000100:00100000:3.0:1784044177.122346:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3943eb1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+52:11269:x1870705565150336:12345-192.168.202.40@tcp:101:bash.0 Request processed in 9080us (9324us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044177.122353:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 69 00000100:00100000:1.0:1784044177.128863:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044177.129760:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565150720 00000100:00100000:2.0:1784044177.129774:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565150720 00000100:00100000:2.0:1784044177.129864:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 15 00000100:00100000:2.0:1784044177.129876:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3974227450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+52:11269:x1870705565150720:12345-192.168.202.40@tcp:35:bash.0 00000100:00100000:2.0:1784044177.130215:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3974227450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+53:11269:x1870705565150720:12345-192.168.202.40@tcp:35:bash.0 Request processed in 340us (1369us total) trans 4294967346 rc 0/0 00000100:00100000:2.0:1784044177.130224:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 15 00000100:00100000:2.0:1784044177.237917:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044177.238037:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565150976 00000100:00100000:3.0:1784044177.238048:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565150976 00000100:00100000:3.0:1784044177.238125:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 70 00000100:00100000:3.0:1784044177.238136:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397f9de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+53:11279:x1870705565150976:12345-192.168.202.40@tcp:101:lfs.0 00010000:00010000:3.0:1784044177.238170:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784044177.238229:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166ac00/0x89871fc3aba184c5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcd3dffad52ca66ee expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784044177.238358:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:3.0:1784044177.238489:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166ac00/0x89871fc3aba184c5 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca66ee expref: 55 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044177.238508:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b39758c1000) 00010000:00010000:3.0:1784044177.238511:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1784044177.238517:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166ac00/0x89871fc3aba184c5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca66ee expref: 55 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044177.238715:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b394166ac00, rc 0) 00000100:00100000:3.0:1784044177.238800:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397f9de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+54:11279:x1870705565150976:12345-192.168.202.40@tcp:101:lfs.0 Request processed in 665us (897us total) trans 4294967347 rc 301/301 00000100:00100000:3.0:1784044177.238809:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 70 00000100:00100000:1.0:1784044177.246226:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044177.246519:0:9501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565151104 00000100:00100000:0.0:1784044177.246542:0:9501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565151104 00000100:00100000:0.0:1784044177.246616:0:9501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 71 00000100:00100000:0.0:1784044177.246628:0:9501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3943eb2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a93fdf3c-d42f-420a-95ea-b0cbfe954363+54:11279:x1870705565151104:12345-192.168.202.40@tcp:34:lfs.0 00010000:00010000:0.0:1784044177.246729:0:9501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7a00/0x89871fc3aba184d3 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044177.246749:0:9501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7a00/0x89871fc3aba184d3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044177.246763:0:9501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7a00/0x89871fc3aba184d3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044177.246793:0:9501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7000/0x89871fc3aba184da lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044177.246801:0:9501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7000/0x89871fc3aba184da lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044177.246809:0:9501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7000/0x89871fc3aba184da lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044177.246891:0:9501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6a00/0x89871fc3aba184e1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044177.246901:0:9501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6a00/0x89871fc3aba184e1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044177.246908:0:9501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6a00/0x89871fc3aba184e1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784044177.246957:0:9501:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6a00/0x89871fc3aba184e1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044177.246970:0:9501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7a00/0x89871fc3aba184d3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044177.246976:0:9501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7a00/0x89871fc3aba184d3 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044177.247121:0:9501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7a00/0x89871fc3aba184d3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044177.247129:0:9501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38410b7a00 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:0.0:1784044177.247134:0:9501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7a00/0x89871fc3aba184d3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044177.247148:0:9501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7a00/0x89871fc3aba184d3 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044177.247162:0:9501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9b397aa61900) 00010000:00010000:0.0:1784044177.247165:0:9501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784044177.247170:0:9501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7a00/0x89871fc3aba184d3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044177.247206:0:9501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7a00/0x89871fc3aba184d3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044177.247221:0:9501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7000/0x89871fc3aba184da lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044177.247226:0:9501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7000/0x89871fc3aba184da lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044177.247232:0:9501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7000/0x89871fc3aba184da lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044177.247237:0:9501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38410b7000 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:0.0:1784044177.247240:0:9501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7000/0x89871fc3aba184da lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044177.247246:0:9501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7000/0x89871fc3aba184da lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044177.247254:0:9501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9b3842776700) 00010000:00010000:0.0:1784044177.247256:0:9501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784044177.247260:0:9501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7000/0x89871fc3aba184da lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044177.247278:0:9501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7000/0x89871fc3aba184da lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044177.247289:0:9501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6a00/0x89871fc3aba184e1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044177.247296:0:9501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6a00/0x89871fc3aba184e1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044177.247302:0:9501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6a00/0x89871fc3aba184e1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044177.247308:0:9501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38410b6a00 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:0.0:1784044177.247311:0:9501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6a00/0x89871fc3aba184e1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044177.247317:0:9501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6a00/0x89871fc3aba184e1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044177.247326:0:9501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9b397aa61500) 00010000:00010000:0.0:1784044177.247328:0:9501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784044177.247331:0:9501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6a00/0x89871fc3aba184e1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044177.247337:0:9501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6a00/0x89871fc3aba184e1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044177.247578:0:9501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3943eb2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a93fdf3c-d42f-420a-95ea-b0cbfe954363+54:11279:x1870705565151104:12345-192.168.202.40@tcp:34:lfs.0 Request processed in 949us (1363us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044177.247588:0:9501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 71 00000100:00100000:1.0:1784044177.254463:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044177.254565:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565151360 00000100:00100000:2.0:1784044177.254575:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565151360 00000100:00100000:2.0:1784044177.254642:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16 00000100:00100000:2.0:1784044177.254653:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3943eb1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+54:11279:x1870705565151360:12345-192.168.202.40@tcp:35:lfs.0 00000100:00100000:2.0:1784044177.254930:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3943eb1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+55:11279:x1870705565151360:12345-192.168.202.40@tcp:35:lfs.0 Request processed in 278us (475us total) trans 4294967348 rc 0/0 00000100:00100000:2.0:1784044177.254939:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16 00000100:00100000:1.0:1784044177.303340:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044177.303511:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565151616 00000100:00100000:3.0:1784044177.303527:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565151616 00000100:00100000:3.0:1784044177.303749:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 72 00000100:00100000:3.0:1784044177.303764:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3943eb0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+55:11282:x1870705565151616:12345-192.168.202.40@tcp:101:lfs.0 00010000:00010000:3.0:1784044177.303807:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784044177.303849:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166ac00/0x89871fc3aba184e8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcd3dffad52ca66f5 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044177.303972:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166be00/0x89871fc3aba184ef lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044177.303993:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166be00/0x89871fc3aba184ef lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044177.304033:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166be00/0x89871fc3aba184ef lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044177.304048:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166b600/0x89871fc3aba184f6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044177.304056:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166b600/0x89871fc3aba184f6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044177.304063:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166b600/0x89871fc3aba184f6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044177.304251:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166bc00/0x89871fc3aba184fd lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044177.304261:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166bc00/0x89871fc3aba184fd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044177.304267:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166bc00/0x89871fc3aba184fd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784044177.304279:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:3.0:1784044177.304380:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166be00/0x89871fc3aba184ef lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044177.304389:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166be00/0x89871fc3aba184ef lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044177.304396:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166be00/0x89871fc3aba184ef lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044177.304401:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b394166be00 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:3.0:1784044177.304416:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166be00/0x89871fc3aba184ef lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044177.304424:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166be00/0x89871fc3aba184ef lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044177.304438:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9b397aa61900) 00010000:00010000:3.0:1784044177.304442:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784044177.304447:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166be00/0x89871fc3aba184ef lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044177.304454:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166be00/0x89871fc3aba184ef lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044177.304470:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166b600/0x89871fc3aba184f6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044177.304477:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166b600/0x89871fc3aba184f6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044177.304482:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166b600/0x89871fc3aba184f6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044177.304488:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b394166b600 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:3.0:1784044177.304491:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166b600/0x89871fc3aba184f6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044177.304496:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166b600/0x89871fc3aba184f6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044177.304503:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9b3842776700) 00010000:00010000:3.0:1784044177.304506:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784044177.304515:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166b600/0x89871fc3aba184f6 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044177.304521:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166b600/0x89871fc3aba184f6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044177.304568:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166ac00/0x89871fc3aba184e8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca66f5 expref: 58 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044177.304588:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166bc00/0x89871fc3aba184fd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca66f5 expref: 57 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044177.304611:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9b397aa61500) 00010000:00010000:3.0:1784044177.304614:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784044177.304617:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b394166bc00, rc 0) 00000100:00100000:3.0:1784044177.304729:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3943eb0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+57:11282:x1870705565151616:12345-192.168.202.40@tcp:101:lfs.0 Request processed in 967us (1403us total) trans 4294967349 rc 0/0 00000100:00100000:3.0:1784044177.304740:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 72 00000100:00100000:1.0:1784044177.309532:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1784044177.309644:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044177.309722:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565151872 00000100:00100000:3.0:1784044177.309738:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565151872 00000100:00100000:3.0:1784044177.309846:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 73 00000100:00100000:3.0:1784044177.309862:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3943eb3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+57:11282:x1870705565151872:12345-192.168.202.40@tcp:54:lfs.0 00010000:00010000:3.0:1784044177.309974:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166ae00/0x89871fc3aba1850b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044177.309999:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166ae00/0x89871fc3aba1850b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044177.310017:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166ae00/0x89871fc3aba1850b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044177.310117:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166ae00/0x89871fc3aba1850b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044177.310127:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166ae00/0x89871fc3aba1850b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044177.310134:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166ae00/0x89871fc3aba1850b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044177.310142:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b394166ae00 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:3.0:1784044177.310148:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166ae00/0x89871fc3aba1850b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044177.310156:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166ae00/0x89871fc3aba1850b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044177.310201:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9b397aa61500) 00010000:00010000:3.0:1784044177.310205:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1784044177.310213:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166ae00/0x89871fc3aba1850b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044177.310220:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166ae00/0x89871fc3aba1850b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044177.310915:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3943eb3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+57:11282:x1870705565151872:12345-192.168.202.40@tcp:54:lfs.0 Request processed in 1048us (1261us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044177.310927:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 73 00000100:00100000:0.0:1784044177.311929:0:13182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565151744 00000100:00100000:0.0:1784044177.311946:0:13182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565151744 00000100:00100000:0.0:1784044177.312110:0:13182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 5 00000100:00100000:0.0:1784044177.312125:0:13182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3943eb2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a93fdf3c-d42f-420a-95ea-b0cbfe954363+57:2409:x1870705565151744:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784044177.312145:0:13182:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784044177.312203:0:13182:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166bc00/0x89871fc3aba184fd lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca66f5 expref: 57 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044177.312226:0:13182:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9b397aa61500) 00010000:00010000:0.0:1784044177.312231:0:13182:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784044177.312296:0:13182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3943eb2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a93fdf3c-d42f-420a-95ea-b0cbfe954363+56:2409:x1870705565151744:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 175us (2780us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044177.312304:0:13182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 5 00000100:00100000:1.0:1784044177.316442:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044177.316534:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565152128 00000100:00100000:3.0:1784044177.316553:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565152128 00000100:00100000:3.0:1784044177.316699:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 17 00000100:00100000:3.0:1784044177.316747:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3943eb3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+56:11282:x1870705565152128:12345-192.168.202.40@tcp:35:lfs.0 00000100:00100000:3.0:1784044177.317069:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3943eb3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+57:11282:x1870705565152128:12345-192.168.202.40@tcp:35:lfs.0 Request processed in 329us (642us total) trans 4294967350 rc 0/0 00000100:00100000:3.0:1784044177.317083:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 17 00000100:00100000:1.0:1784044177.497694:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044177.498725:0:13808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565152384 00000100:00100000:0.0:1784044177.498742:0:13808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565152384 00000100:00100000:0.0:1784044177.498914:0:13808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 74 00000100:00100000:0.0:1784044177.498928:0:13808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3943eb0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a93fdf3c-d42f-420a-95ea-b0cbfe954363+57:11300:x1870705565152384:12345-192.168.202.40@tcp:101:cat.0 00010000:00010000:0.0:1784044177.498967:0:13808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784044177.498997:0:13808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6a00/0x89871fc3aba18512 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcd3dffad52ca66fc expref: -99 pid: 13808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044177.499163:0:13808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7000/0x89871fc3aba18519 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044177.499200:0:13808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7000/0x89871fc3aba18519 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044177.499214:0:13808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7000/0x89871fc3aba18519 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784044177.499250:0:13808:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:0.0:1784044177.499418:0:13808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6a00/0x89871fc3aba18512 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca66fc expref: 60 pid: 13808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044177.499443:0:13808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7000/0x89871fc3aba18519 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca66fc expref: 59 pid: 13808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044177.499453:0:13808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9b397aa61500) 00010000:00010000:0.0:1784044177.499456:0:13808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1784044177.499461:0:13808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b38410b7000, rc 0) 00000100:00100000:0.0:1784044177.499575:0:13808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3943eb0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a93fdf3c-d42f-420a-95ea-b0cbfe954363+59:11300:x1870705565152384:12345-192.168.202.40@tcp:101:cat.0 Request processed in 649us (1898us total) trans 4294967351 rc 0/0 00000100:00100000:0.0:1784044177.499585:0:13808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 74 00000100:00100000:1.0:1784044177.530022:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044177.531449:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565152512 00000100:00100000:3.0:1784044177.531465:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565152512 00000100:00100000:3.0:1784044177.531552:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 75 00000100:00100000:3.0:1784044177.531566:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3943eb0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+59:11301:x1870705565152512:12345-192.168.202.40@tcp:101:lfs.0 00010000:00010000:3.0:1784044177.531597:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784044177.531627:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166ae00/0x89871fc3aba18527 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcd3dffad52ca6703 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044177.531742:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166ac00/0x89871fc3aba1852e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044177.531762:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166ac00/0x89871fc3aba1852e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044177.531777:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166ac00/0x89871fc3aba1852e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784044177.531837:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:3.0:1784044177.531842:0:6513:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1784044177.531868:0:6513:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166ac00/0x89871fc3aba1852e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044177.531901:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166ae00/0x89871fc3aba18527 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6703 expref: 61 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044177.531950:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166ac00/0x89871fc3aba1852e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6703 expref: 60 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044177.531960:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9b397aa61900) 00010000:00010000:3.0:1784044177.531963:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1784044177.531966:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b394166ac00, rc 0) 00000100:00100000:3.0:1784044177.532531:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3943eb0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+60:11301:x1870705565152512:12345-192.168.202.40@tcp:101:lfs.0 Request processed in 965us (2518us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044177.532538:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 75 00000100:00100000:1.0:1784044177.542161:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044177.542344:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565152896 00000100:00100000:3.0:1784044177.542361:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565152896 00000100:00100000:3.0:1784044177.542496:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 18 00000100:00100000:3.0:1784044177.542611:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3943eb1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+60:11301:x1870705565152896:12345-192.168.202.40@tcp:35:lfs.0 00000100:00100000:3.0:1784044177.543064:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3943eb1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+61:11301:x1870705565152896:12345-192.168.202.40@tcp:35:lfs.0 Request processed in 554us (921us total) trans 4294967352 rc 0/0 00000100:00100000:3.0:1784044177.543077:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 18 00000100:00100000:3.0:1784044177.551574:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044177.551778:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565153024 00000100:00100000:2.0:1784044177.551803:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565153024 00000100:00100000:2.0:1784044177.551955:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 6 00000100:00100000:2.0:1784044177.551969:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3944092450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+61:11301:x1870705565153024:12345-192.168.202.40@tcp:103:lfs.0 00010000:00010000:2.0:1784044177.551990:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1784044177.552025:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166b800/0x89871fc3aba184be lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca66e7 expref: 61 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044177.552054:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7000/0x89871fc3aba18519 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca66fc expref: 60 pid: 13808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044177.552070:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166a400/0x89871fc3aba183bb lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca66a1 expref: 59 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044177.552084:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9b397aa61500) 00010000:00010000:2.0:1784044177.552102:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784044177.552229:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3944092450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+58:11301:x1870705565153024:12345-192.168.202.40@tcp:103:lfs.0 Request processed in 262us (679us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044177.552238:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 6 00000001:00080000:1.0:1784044177.554760:0:6490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967352 is committed 00000004:00080000:1.0:1784044177.554858:0:6490:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000020:00080000:1.0:1784044177.554881:0:6490:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9b3843df7b40 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:1.0:1784044177.554888:0:6490:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9b39759ff700 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9b3843df7e40 00000020:00080000:1.0:1784044177.554891:0:6490:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9b39759ff500 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9b3946923600 00000020:00080000:1.0:1784044177.554974:0:6544:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:1.0:1784044177.555263:0:6544:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00010000:00010000:3.0:1784044177.555577:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3982054600/0x89871fc3aba182f7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044177.555592:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3982054600/0x89871fc3aba182f7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044177.555601:0:3625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3982054600/0x89871fc3aba182f7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044177.555609:0:3625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3982054600 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:3.0:1784044177.555622:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3982054600/0x89871fc3aba182f7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044177.555643:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3982054600/0x89871fc3aba182f7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044177.555666:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9b397aa61d00) 00010000:00010000:3.0:1784044177.555670:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784044177.555677:0:3625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3982054600/0x89871fc3aba182f7 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044177.555684:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3982054600/0x89871fc3aba182f7 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044177.555715:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166aa00/0x89871fc3aba182fe lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044177.555720:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166aa00/0x89871fc3aba182fe lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044177.555726:0:3625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166aa00/0x89871fc3aba182fe lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044177.555733:0:3625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b394166aa00 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:3.0:1784044177.555735:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166aa00/0x89871fc3aba182fe lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044177.555742:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166aa00/0x89871fc3aba182fe lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044177.555751:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9b397aa61900) 00010000:00010000:3.0:1784044177.555753:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784044177.555763:0:3625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166aa00/0x89871fc3aba182fe lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044177.555769:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166aa00/0x89871fc3aba182fe lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044177.555801:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fda00/0x89871fc3aba1833d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044177.555809:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fda00/0x89871fc3aba1833d lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044177.555816:0:3625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fda00/0x89871fc3aba1833d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044177.555821:0:3625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38426fda00 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:3.0:1784044177.555825:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fda00/0x89871fc3aba1833d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044177.555832:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fda00/0x89871fc3aba1833d lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044177.555841:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9b3842776700) 00010000:00010000:3.0:1784044177.555843:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784044177.555846:0:3625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fda00/0x89871fc3aba1833d lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044177.555852:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fda00/0x89871fc3aba1833d lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044177.555871:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7e00/0x89871fc3aba18447 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044177.555892:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7e00/0x89871fc3aba18447 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044177.555898:0:3625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7e00/0x89871fc3aba18447 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044177.555904:0:3625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38410b7e00 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:3.0:1784044177.555907:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7e00/0x89871fc3aba18447 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044177.555914:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7e00/0x89871fc3aba18447 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044177.555924:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9b397aa61500) 00010000:00010000:3.0:1784044177.555926:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784044177.555929:0:3625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7e00/0x89871fc3aba18447 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044177.555934:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7e00/0x89871fc3aba18447 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044177.555947:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7600/0x89871fc3aba1846a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044177.555953:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7600/0x89871fc3aba1846a lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044177.555960:0:3625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7600/0x89871fc3aba1846a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044177.555965:0:3625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38410b7600 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:3.0:1784044177.555973:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7600/0x89871fc3aba1846a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044177.555979:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7600/0x89871fc3aba1846a lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044177.555988:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9b397aa61500) 00010000:00010000:3.0:1784044177.555990:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784044177.555993:0:3625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7600/0x89871fc3aba1846a lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044177.555998:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7600/0x89871fc3aba1846a lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044177.556007:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7c00/0x89871fc3aba184b0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044177.556013:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7c00/0x89871fc3aba184b0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044177.556018:0:3625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7c00/0x89871fc3aba184b0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044177.556023:0:3625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38410b7c00 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:3.0:1784044177.556026:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7c00/0x89871fc3aba184b0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044177.556032:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7c00/0x89871fc3aba184b0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044177.556041:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9b397aa61500) 00010000:00010000:3.0:1784044177.556043:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784044177.556051:0:3625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7c00/0x89871fc3aba184b0 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044177.556058:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7c00/0x89871fc3aba184b0 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044177.556271:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3975b50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1870705580977536:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1784044177.556374:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044177.556470:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580977536 00000100:00100000:3.0:1784044177.556480:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580977536 00000100:00100000:3.0:1784044177.556550:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1784044177.556562:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3975b53100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3641:x1870705580977536:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1784044177.556603:0:8428:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2 count 1 00002000:00010000:3.0:1784044177.556658:0:8428:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2:0x0] initial LVB size: 13, mtime: 0x6a565a8e, atime: 0x6a565a8f, ctime: 0x6a565a8e, blocks: 0x8 00010000:00010000:3.0:1784044177.556667:0:8428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a96afc16/0x89871fc3aba18535 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044177.556686:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=370s v=(0 0) 00010000:00010000:3.0:1784044177.556692:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784044177.556700:0:8428:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a96afc16/0x89871fc3aba18535 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044177.556718:0:8428:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a96afc16/0x89871fc3aba18535 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044177.556728:0:8428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a96afc16/0x89871fc3aba18535 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044177.556735:0:8428:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a96afc16/0x89871fc3aba18535 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044177.556764:0:8428:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1784044177.556955:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3975b53100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3641:x1870705580977536:12345-0@lo:6:osp-syn-1-0.0 Request processed in 394us (581us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1784044177.556964:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000004:00080000:3.0:1784044177.557024:0:3641:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b3975b50380/2, rc 0, transno 4294967302 00000100:00100000:3.0:1784044177.557032:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3975b50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1870705580977536:0@lo:6:osp-syn-1-0.0 00000100:00080000:1.0:1784044177.557220:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1784044177.557234:0:10331:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784044177.557241:0:10331:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a96afc16/0x89871fc3aba18535 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044177.557260:0:10331:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b394166ae00 already unused, calling callback (ffffffffc0b56230) 00010000:00010000:1.0:1784044177.557265:0:10331:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a96afc16/0x89871fc3aba18535 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044177.557274:0:10331:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a96afc16/0x89871fc3aba18535 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044177.557291:0:10331:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a96afc16/0x89871fc3aba18535 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044177.557300:0:10331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a96afc16/0x89871fc3aba18535 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044177.557324:0:10331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784044177.557326:0:10331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784044177.557328:0:10331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784044177.557393:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044177.557903:0:9501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565153152 00000100:00100000:3.0:1784044177.557912:0:9501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565153152 00000100:00100000:3.0:1784044177.557963:0:9501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 76 00000100:00100000:3.0:1784044177.557973:0:9501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3943eb0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a93fdf3c-d42f-420a-95ea-b0cbfe954363+11:11301:x1870705565153152:12345-192.168.202.40@tcp:58:lfs.0 00010000:00010000:3.0:1784044177.558115:0:9501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166b600/0x89871fc3aba1853c lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044177.558339:0:9501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166b600/0x89871fc3aba1853c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044177.558355:0:9501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166b600/0x89871fc3aba1853c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1784044177.559481:0:9501:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1784044177.559727:0:9501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:3.0:1784044177.559913:0:9501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:3.0:1784044177.560259:0:9501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3943eb0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a93fdf3c-d42f-420a-95ea-b0cbfe954363+11:11301:x1870705565153152:12345-192.168.202.40@tcp:58:lfs.0 Request processed in 2279us (2860us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044177.560273:0:9501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 76 00000100:00100000:3.0:1784044177.589137:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044177.589339:0:13808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565153280 00000100:00100000:0.0:1784044177.589351:0:13808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565153280 00000100:00100000:0.0:1784044177.589447:0:13808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 77 00000100:00100000:0.0:1784044177.589459:0:13808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3975b52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a93fdf3c-d42f-420a-95ea-b0cbfe954363+11:11303:x1870705565153280:12345-192.168.202.40@tcp:101:lfs.0 00010000:00010000:0.0:1784044177.589488:0:13808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784044177.589513:0:13808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7a00/0x89871fc3aba18543 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcd3dffad52ca670a expref: -99 pid: 13808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044177.589744:0:13808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7c00/0x89871fc3aba1854a lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044177.589761:0:13808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7c00/0x89871fc3aba1854a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044177.589803:0:13808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7c00/0x89871fc3aba1854a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044177.589823:0:13808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7600/0x89871fc3aba18551 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044177.589831:0:13808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7600/0x89871fc3aba18551 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044177.589838:0:13808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7600/0x89871fc3aba18551 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044177.589940:0:13808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7e00/0x89871fc3aba18558 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044177.589947:0:13808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7e00/0x89871fc3aba18558 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044177.589952:0:13808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7e00/0x89871fc3aba18558 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784044177.590010:0:13808:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:0.0:1784044177.590015:0:13808:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1784044177.590040:0:13808:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7e00/0x89871fc3aba18558 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044177.590055:0:13808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7e00/0x89871fc3aba18558 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044177.590064:0:13808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7c00/0x89871fc3aba1854a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044177.590082:0:13808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7c00/0x89871fc3aba1854a lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044177.590090:0:13808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7c00/0x89871fc3aba1854a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044177.590098:0:13808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38410b7c00 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:0.0:1784044177.590104:0:13808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7c00/0x89871fc3aba1854a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044177.590113:0:13808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7c00/0x89871fc3aba1854a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044177.590128:0:13808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9b397aa61900) 00010000:00010000:0.0:1784044177.590131:0:13808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784044177.590137:0:13808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7c00/0x89871fc3aba1854a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044177.590143:0:13808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7c00/0x89871fc3aba1854a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044177.590161:0:13808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7600/0x89871fc3aba18551 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044177.590167:0:13808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7600/0x89871fc3aba18551 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044177.590172:0:13808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7600/0x89871fc3aba18551 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044177.590291:0:13808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38410b7600 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:0.0:1784044177.590301:0:13808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7600/0x89871fc3aba18551 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044177.590307:0:13808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7600/0x89871fc3aba18551 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044177.590315:0:13808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9b39758c1100) 00010000:00010000:0.0:1784044177.590318:0:13808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784044177.590321:0:13808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7600/0x89871fc3aba18551 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044177.590326:0:13808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7600/0x89871fc3aba18551 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044177.590365:0:13808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7a00/0x89871fc3aba18543 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca670a expref: 13 pid: 13808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044177.590392:0:13808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7e00/0x89871fc3aba18558 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca670a expref: 12 pid: 13808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044177.590401:0:13808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9b397aa61500) 00010000:00010000:0.0:1784044177.590403:0:13808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1784044177.590406:0:13808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b38410b7e00, rc 0) 00000100:00100000:0.0:1784044177.590638:0:13808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3975b52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a93fdf3c-d42f-420a-95ea-b0cbfe954363+12:11303:x1870705565153280:12345-192.168.202.40@tcp:101:lfs.0 Request processed in 1172us (1508us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044177.590650:0:13808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 77 00000040:00080000:0.0:1784044177.806000:0:13804:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1784044178.061528:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1784044178.126314:0:13763:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1784044178.126327:0:13763:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1784044178.126370:0:13763:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1784044178.126376:0:13763:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1784044178.126783:0:13763:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3943eb2680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13763:1870705580977664:192.168.202.40@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1784044178.126885:0:13763:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3960481d80 going to sleep for 11 seconds 00000100:00100000:3.0:1784044178.137963:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044178.138017:0:13763:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3943eb2680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13763:1870705580977664:192.168.202.40@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1784044178.138328:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565153408 00000100:00100000:3.0:1784044178.138340:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565153408 00000100:00080000:1.0:1784044178.138675:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784044178.138727:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 78 00000100:00100000:3.0:1784044178.138741:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3975b52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+12:11314:x1870705565153408:12345-192.168.202.40@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1784044178.138997:0:6513:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1784044178.139298:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3975b52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+12:11314:x1870705565153408:12345-192.168.202.40@tcp:53:lhsmtool_posix.0 Request processed in 557us (1352us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044178.141943:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 78 00000100:00100000:0.0:1784044178.148419:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044178.148793:0:9501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565153536 00000100:00100000:3.0:1784044178.148804:0:9501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565153536 00000100:00100000:3.0:1784044178.148872:0:9501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 79 00000100:00100000:3.0:1784044178.148883:0:9501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397f946680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a93fdf3c-d42f-420a-95ea-b0cbfe954363+12:11314:x1870705565153536:12345-192.168.202.40@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1784044178.148961:0:9501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166aa00/0x89871fc3aba1855f lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044178.148984:0:9501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166aa00/0x89871fc3aba1855f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044178.149000:0:9501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166aa00/0x89871fc3aba1855f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044178.149068:0:9501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166be00/0x89871fc3aba18566 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044178.149077:0:9501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166be00/0x89871fc3aba18566 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044178.149084:0:9501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166be00/0x89871fc3aba18566 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044178.149133:0:9501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166ae00/0x89871fc3aba1856d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044178.149143:0:9501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166ae00/0x89871fc3aba1856d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044178.149150:0:9501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166ae00/0x89871fc3aba1856d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784044178.149231:0:9501:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:3.0:1784044178.149236:0:9501:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1784044178.149251:0:9501:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166ae00/0x89871fc3aba1856d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044178.149264:0:9501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166aa00/0x89871fc3aba1855f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044178.149270:0:9501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166aa00/0x89871fc3aba1855f lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044178.149277:0:9501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166aa00/0x89871fc3aba1855f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044178.149283:0:9501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b394166aa00 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:3.0:1784044178.149288:0:9501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166aa00/0x89871fc3aba1855f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044178.149295:0:9501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166aa00/0x89871fc3aba1855f lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044178.149308:0:9501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9b396f2a8900) 00010000:00010000:3.0:1784044178.149318:0:9501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784044178.149324:0:9501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166aa00/0x89871fc3aba1855f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044178.149331:0:9501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166aa00/0x89871fc3aba1855f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044178.149347:0:9501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166be00/0x89871fc3aba18566 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044178.149353:0:9501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166be00/0x89871fc3aba18566 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044178.149358:0:9501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166be00/0x89871fc3aba18566 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044178.149363:0:9501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b394166be00 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:3.0:1784044178.149366:0:9501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166be00/0x89871fc3aba18566 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044178.149372:0:9501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166be00/0x89871fc3aba18566 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044178.149380:0:9501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x840cc931 (ffff9b397aa61d00) 00010000:00010000:3.0:1784044178.149382:0:9501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784044178.149385:0:9501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166be00/0x89871fc3aba18566 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044178.149391:0:9501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166be00/0x89871fc3aba18566 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044178.149407:0:9501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166ae00/0x89871fc3aba1856d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044178.149419:0:9501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166ae00/0x89871fc3aba1856d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044178.149425:0:9501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166ae00/0x89871fc3aba1856d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044178.149430:0:9501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b394166ae00 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:3.0:1784044178.149434:0:9501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166ae00/0x89871fc3aba1856d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044178.149440:0:9501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166ae00/0x89871fc3aba1856d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044178.149448:0:9501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9b397aa61500) 00010000:00010000:3.0:1784044178.149450:0:9501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784044178.149453:0:9501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166ae00/0x89871fc3aba1856d lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044178.149458:0:9501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166ae00/0x89871fc3aba1856d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044178.149544:0:9501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397f946680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a93fdf3c-d42f-420a-95ea-b0cbfe954363+12:11314:x1870705565153536:12345-192.168.202.40@tcp:34:lhsmtool_posix.0 Request processed in 661us (1134us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044178.149553:0:9501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 79 00000100:00100000:3.0:1784044178.150316:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044178.150365:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1784044178.150419:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565153792 00000100:00100000:3.0:1784044178.150420:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1784044178.150431:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565153792 00000100:00100000:3.0:1784044178.150460:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044178.150506:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1784044178.150518:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565154048 00000100:00100000:1.0:1784044178.150528:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565154048 00000100:00100000:1.0:1784044178.150562:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565154176 00000100:00100000:1.0:1784044178.150572:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565154176 00000100:00100000:3.0:1784044178.150886:0:13808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 312 00000100:00100000:3.0:1784044178.150907:0:13808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3975b50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a93fdf3c-d42f-420a-95ea-b0cbfe954363+5:2409:x1870705565153792:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:3.0:1784044178.151030:0:13808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3975b50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a93fdf3c-d42f-420a-95ea-b0cbfe954363+5:2409:x1870705565153792:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 130us (727us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044178.151039:0:13808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 312 00000100:00100000:3.0:1784044178.151077:0:13808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 313 00000100:00100000:3.0:1784044178.151095:0:13808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3975b51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:68dfcea6-5d83-4dbb-8fa3-e35542d621e5+5:2409:x1870705565154048:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:3.0:1784044178.151131:0:13808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3975b51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:68dfcea6-5d83-4dbb-8fa3-e35542d621e5+5:2409:x1870705565154048:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 38us (768us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044178.151141:0:13808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 313 00000100:00100000:3.0:1784044178.151155:0:13808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 314 00000100:00100000:3.0:1784044178.151163:0:13808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3975b52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:68dfcea6-5d83-4dbb-8fa3-e35542d621e5+5:2409:x1870705565154176:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:3.0:1784044178.151241:0:13808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3975b52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:68dfcea6-5d83-4dbb-8fa3-e35542d621e5+5:2409:x1870705565154176:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 79us (736us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044178.151248:0:13808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 314 00000100:00100000:3.0:1784044178.151308:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565153664 00000100:00100000:3.0:1784044178.151317:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565153664 00000100:00100000:3.0:1784044178.151388:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 410 00000100:00100000:3.0:1784044178.151398:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3950376c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4a09ad9-a185-4679-99bb-b6a07b865440+13:2409:x1870705565153664:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:3.0:1784044178.151428:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3950376c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4a09ad9-a185-4679-99bb-b6a07b865440+13:2409:x1870705565153664:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 33us (1010us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044178.151436:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 410 00000100:00100000:3.0:1784044178.151482:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565153920 00000100:00100000:3.0:1784044178.151486:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565153920 00000100:00100000:3.0:1784044178.151532:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 115 00000100:00100000:3.0:1784044178.151539:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3975b51500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+7:2409:x1870705565153920:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:3.0:1784044178.151567:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3975b51500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+7:2409:x1870705565153920:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 29us (1110us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044178.151573:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 115 00000100:00080000:3.0:1784044178.158250:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1784044178.158269:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1784044178.158275:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1784044178.158691:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1784044178.161785:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565154432 00000100:00100000:1.0:1784044178.161806:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565154432 00000100:00100000:1.0:1784044178.161891:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 80 00000100:00100000:1.0:1784044178.161904:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3975b53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+12:11314:x1870705565154432:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1784044178.161929:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784044178.161957:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fcc00/0x89871fc3aba18574 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcd3dffad52ca6711 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044178.162090:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc600/0x89871fc3aba1857b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044178.162106:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc600/0x89871fc3aba1857b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044178.162120:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc600/0x89871fc3aba1857b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784044178.162132:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:1.0:1784044178.162249:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc600/0x89871fc3aba1857b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044178.162258:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc600/0x89871fc3aba1857b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044178.162265:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc600/0x89871fc3aba1857b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044178.162271:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38426fc600 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:1.0:1784044178.162283:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc600/0x89871fc3aba1857b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044178.162291:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc600/0x89871fc3aba1857b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044178.162304:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9b397aa61500) 00010000:00010000:1.0:1784044178.162307:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1784044178.162312:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc600/0x89871fc3aba1857b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044178.162319:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc600/0x89871fc3aba1857b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044178.162362:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fcc00/0x89871fc3aba18574 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6711 expref: 14 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044178.162373:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9b396f2a8900) 00010000:00010000:1.0:1784044178.162375:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1784044178.162379:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fcc00/0x89871fc3aba18574 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6711 expref: 14 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044178.162388:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b38426fcc00, rc 0) 00000100:00100000:1.0:1784044178.162466:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3975b53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+13:11314:x1870705565154432:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 Request processed in 564us (3786us total) trans 4294967353 rc 301/301 00000100:00100000:1.0:1784044178.162473:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 80 00000100:00100000:3.0:1784044178.172038:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1784044178.172128:0:13808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565154560 00000100:00100000:1.0:1784044178.172145:0:13808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565154560 00000100:00100000:1.0:1784044178.172248:0:13808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 81 00000100:00100000:1.0:1784044178.172260:0:13808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3975b53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a93fdf3c-d42f-420a-95ea-b0cbfe954363+13:11314:x1870705565154560:12345-192.168.202.40@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1784044178.172311:0:13808:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1784044178.172453:0:13808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3975b53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a93fdf3c-d42f-420a-95ea-b0cbfe954363+13:11314:x1870705565154560:12345-192.168.202.40@tcp:53:lhsmtool_posix.0 Request processed in 196us (432us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044178.172461:0:13808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 81 00000100:00100000:3.0:1784044178.177468:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044178.177824:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565154816 00000100:00100000:2.0:1784044178.177844:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565154816 00000100:00100000:2.0:1784044178.177969:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 82 00000100:00100000:2.0:1784044178.177988:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39459b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+13:11314:x1870705565154816:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1784044178.178033:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784044178.178038:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1784044178.178081:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166ac00/0x89871fc3aba1852e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6703 expref: 13 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044178.178124:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9b397aa61900) 00010000:00010000:2.0:1784044178.178132:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784044178.178157:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799a00/0x89871fc3aba18589 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcd3dffad52ca6718 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1784044178.178947:0:6512:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x3:0x0], index 0: 0 00010000:00010000:2.0:1784044178.179220:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799c00/0x89871fc3aba18590 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044178.179239:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799c00/0x89871fc3aba18590 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044178.179254:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799c00/0x89871fc3aba18590 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044178.179344:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799a00/0x89871fc3aba18589 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6718 expref: 15 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044178.179369:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799c00/0x89871fc3aba18590 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6718 expref: 14 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044178.179378:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9b39494f7400) 00010000:00010000:2.0:1784044178.179391:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784044178.179395:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3843799c00, rc 0) 00000100:00100000:2.0:1784044178.179498:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39459b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+14:11314:x1870705565154816:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 Request processed in 1515us (2039us total) trans 4294967354 rc 0/0 00000100:00100000:2.0:1784044178.179510:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 82 00000100:00100000:0.0:1784044178.186674:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044178.186753:0:9501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565155072 00000100:00100000:3.0:1784044178.186764:0:9501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565155072 00000100:00100000:3.0:1784044178.186819:0:9501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 83 00000100:00100000:3.0:1784044178.186829:0:9501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397f947480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a93fdf3c-d42f-420a-95ea-b0cbfe954363+14:11314:x1870705565155072:12345-192.168.202.40@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1784044178.186899:0:9501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784044178.186932:0:9501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799c00/0x89871fc3aba18590 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6718 expref: 14 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044178.186953:0:9501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9b39494f7400) 00010000:00010000:3.0:1784044178.186974:0:9501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784044178.186999:0:9501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166ae00/0x89871fc3aba1859e lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044178.187014:0:9501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166ae00/0x89871fc3aba1859e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044178.187026:0:9501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166ae00/0x89871fc3aba1859e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044178.187050:0:9501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166be00/0x89871fc3aba185a5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0xba0b87a9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044178.187056:0:9501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166be00/0x89871fc3aba185a5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xba0b87a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044178.187062:0:9501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166be00/0x89871fc3aba185a5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xba0b87a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044178.187110:0:9501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166ae00/0x89871fc3aba1859e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044178.187117:0:9501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166ae00/0x89871fc3aba1859e lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044178.187124:0:9501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166ae00/0x89871fc3aba1859e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044178.187130:0:9501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b394166ae00 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:3.0:1784044178.187134:0:9501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166ae00/0x89871fc3aba1859e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044178.187141:0:9501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166ae00/0x89871fc3aba1859e lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044178.187150:0:9501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9b397aa61900) 00010000:00010000:3.0:1784044178.187152:0:9501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784044178.187156:0:9501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166ae00/0x89871fc3aba1859e lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044178.187162:0:9501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166ae00/0x89871fc3aba1859e lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044178.187205:0:9501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166be00/0x89871fc3aba185a5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xba0b87a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044178.187213:0:9501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166be00/0x89871fc3aba185a5 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xba0b87a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044178.187219:0:9501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166be00/0x89871fc3aba185a5 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xba0b87a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044178.187224:0:9501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b394166be00 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:3.0:1784044178.187227:0:9501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166be00/0x89871fc3aba185a5 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xba0b87a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044178.187233:0:9501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166be00/0x89871fc3aba185a5 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xba0b87a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044178.187240:0:9501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0xba0b87a9 (ffff9b397aa61d00) 00010000:00010000:3.0:1784044178.187243:0:9501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784044178.187246:0:9501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166be00/0x89871fc3aba185a5 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0xba0b87a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044178.187252:0:9501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166be00/0x89871fc3aba185a5 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0xba0b87a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044178.187337:0:9501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397f947480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a93fdf3c-d42f-420a-95ea-b0cbfe954363+13:11314:x1870705565155072:12345-192.168.202.40@tcp:36:lhsmtool_posix.0 Request processed in 509us (672us total) trans 0 rc -2/-2 00000100:00100000:3.0:1784044178.187345:0:9501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 83 00000100:00100000:1.0:1784044178.208811:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044178.208892:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565155200 00000100:00100000:2.0:1784044178.208910:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565155200 00000100:00100000:2.0:1784044178.209015:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 84 00000100:00100000:2.0:1784044178.209029:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3943eb2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+13:11314:x1870705565155200:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1784044178.209060:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784044178.209092:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798600/0x89871fc3aba185ac lrc: 2/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcd3dffad52ca671f expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044178.209144:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799000/0x89871fc3aba185b3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044178.209162:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799000/0x89871fc3aba185b3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044178.209202:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799000/0x89871fc3aba185b3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044178.209379:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798600/0x89871fc3aba185ac lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca671f expref: 15 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044178.209404:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799000/0x89871fc3aba185b3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca671f expref: 14 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044178.209415:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9b39494f7100) 00010000:00010000:2.0:1784044178.209425:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1784044178.209430:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3843799000, rc 0) 00000100:00100000:2.0:1784044178.209521:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3943eb2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+14:11314:x1870705565155200:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 Request processed in 494us (719us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044178.209529:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 84 00000100:00100000:3.0:1784044178.216055:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044178.216828:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565155456 00000100:00100000:0.0:1784044178.216847:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565155456 00000100:00100000:0.0:1784044178.216908:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 85 00000100:00100000:0.0:1784044178.216920:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39459b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+14:11314:x1870705565155456:12345-192.168.202.40@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1784044178.217008:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6a00/0x89871fc3aba185ba lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044178.217025:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6a00/0x89871fc3aba185ba lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044178.217039:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6a00/0x89871fc3aba185ba lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1784044178.217225:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 88 off8408 00000004:00080000:0.0:1784044178.217234:0:6512:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 371388059216ns, next at 372388057191ns, rc = 0 00000004:00010000:0.0:1784044178.217282:0:6512:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000255a1197 reply state 0000000027a97e27 transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6a00/0x89871fc3aba185ba lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044178.217295:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6a00/0x89871fc3aba185ba lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044178.217303:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9b39494f7100) 00010000:00010000:0.0:1784044178.217306:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1784044178.217310:0:6512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1784044178.217425:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39459b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+16:11314:x1870705565155456:12345-192.168.202.40@tcp:36:lhsmtool_posix.0 Request processed in 505us (1377us total) trans 4294967355 rc 0/0 00000100:00100000:0.0:1784044178.217433:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 85 00000100:00100000:0.0:1784044178.228034:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044178.228469:0:13808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565155584 00000100:00100000:3.0:1784044178.228479:0:13808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565155584 00000100:00100000:3.0:1784044178.228549:0:13808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 86 00000100:00100000:3.0:1784044178.228561:0:13808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397f944700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a93fdf3c-d42f-420a-95ea-b0cbfe954363+16:11314:x1870705565155584:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1784044178.228602:0:13808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784044178.228639:0:13808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166be00/0x89871fc3aba185c1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcd3dffad52ca6726 expref: -99 pid: 13808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044178.228712:0:13808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166be00/0x89871fc3aba185c1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6726 expref: 17 pid: 13808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044178.228729:0:13808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166be00/0x89871fc3aba185c1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6726 expref: 17 pid: 13808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044178.228752:0:13808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9b39494f7100) 00010000:00010000:3.0:1784044178.228755:0:13808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1784044178.228759:0:13808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b394166be00, rc 0) 00000100:00100000:3.0:1784044178.228821:0:13808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397f944700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a93fdf3c-d42f-420a-95ea-b0cbfe954363+17:11314:x1870705565155584:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 Request processed in 263us (797us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044178.228829:0:13808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 86 00000100:00100000:0.0:1784044178.232875:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044178.232982:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565155712 00000100:00100000:3.0:1784044178.232991:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565155712 00000100:00100000:3.0:1784044178.233070:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 35 00000100:00100000:3.0:1784044178.233079:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843e39500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2406:x1870705565155712:12345-192.168.202.40@tcp:8:lhsmtool_posix.0 00010000:00080000:3.0:1784044178.233114:0:8428:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from a93fdf3c-d42f-420a-95ea-b0cbfe954363@192.168.202.40@tcp t0 exp 0000000000000000 cur 371 last 0 00000020:00000080:3.0:1784044178.233146:0:8428:0:(genops.c:1406:class_connect()) connect: client a93fdf3c-d42f-420a-95ea-b0cbfe954363, cookie 0x89871fc3aba185c8 00002000:00100000:3.0:1784044178.233162:0:8428:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli a93fdf3c-d42f-420a-95ea-b0cbfe954363/ffff9b3944e99000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136a2 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1784044178.233202:0:8428:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type b7, return b7 00002000:00080000:3.0:1784044178.233297:0:8428:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1784044178.233327:0:8428:0:(import.c:65:import_set_state_nolock()) ffff9b3944e99800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1784044178.233468:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843e39500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+6:2406:x1870705565155712:12345-192.168.202.40@tcp:8:lhsmtool_posix.0 Request processed in 387us (603us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044178.233477:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 35 00000100:00100000:0.0:1784044178.237355:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044178.237411:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565155840 00000100:00100000:0.0:1784044178.237434:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565155840 00000100:00100000:0.0:1784044178.237528:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 36 00000100:00100000:0.0:1784044178.237540:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843e38700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+6:0:x1870705565155840:12345-192.168.202.40@tcp:2:lhsmtool_posix.0 00000100:00080000:0.0:1784044178.237797:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:0.0:1784044178.250131:0:8421:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000001:00100000:0.0:1784044178.250164:0:8421:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of a93fdf3c-d42f-420a-95ea-b0cbfe954363 00000100:00100000:3.0:1784044178.253074:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843e38700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+5:0:x1870705565155840:12345-192.168.202.40@tcp:2:lhsmtool_posix.0 Request processed in 15522us (15720us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1784044178.253103:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 36 00000100:00100000:2.0:1784044178.262994:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1784044178.263096:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565156096 00000100:00100000:1.0:1784044178.263114:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565156096 00000100:00100000:3.0:1784044178.263237:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 19 00000100:00100000:3.0:1784044178.263257:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397f9dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+17:11314:x1870705565156096:12345-192.168.202.40@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1784044178.263569:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397f9dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+18:11314:x1870705565156096:12345-192.168.202.40@tcp:35:lhsmtool_posix.0 Request processed in 319us (586us total) trans 4294967356 rc 0/0 00000100:00100000:3.0:1784044178.265300:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 19 00000100:00100000:0.0:1784044178.266144:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044178.266265:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565156352 00000100:00100000:2.0:1784044178.266274:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565156352 00000100:00100000:2.0:1784044178.266333:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 87 00000100:00100000:2.0:1784044178.266344:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397a8a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+18:11314:x1870705565156352:12345-192.168.202.40@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1784044178.266480:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397a8a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+18:11314:x1870705565156352:12345-192.168.202.40@tcp:57:lhsmtool_posix.0 Request processed in 138us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044178.266488:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 87 00000100:00100000:0.0:1784044178.271257:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044178.271420:0:9501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565156480 00000100:00100000:3.0:1784044178.271431:0:9501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565156480 00000100:00100000:3.0:1784044178.271513:0:9501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 88 00000100:00100000:3.0:1784044178.271526:0:9501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397a8a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a93fdf3c-d42f-420a-95ea-b0cbfe954363+18:11314:x1870705565156480:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1784044178.271545:0:9501:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784044178.271568:0:9501:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166ae00/0x89871fc3aba185cf lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcd3dffad52ca672d expref: -99 pid: 9501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044178.271786:0:9501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166aa00/0x89871fc3aba185d6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044178.271802:0:9501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166aa00/0x89871fc3aba185d6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044178.271826:0:9501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166aa00/0x89871fc3aba185d6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784044178.271875:0:9501:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1784044178.271897:0:9501:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166aa00/0x89871fc3aba185d6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044178.271925:0:9501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166ae00/0x89871fc3aba185cf lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca672d expref: 20 pid: 9501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044178.271946:0:9501:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166aa00/0x89871fc3aba185d6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca672d expref: 19 pid: 9501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044178.271957:0:9501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9b39494f7100) 00010000:00010000:3.0:1784044178.271959:0:9501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1784044178.271963:0:9501:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b394166aa00, rc 0) 00000100:00100000:3.0:1784044178.272059:0:9501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397a8a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a93fdf3c-d42f-420a-95ea-b0cbfe954363+19:11314:x1870705565156480:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 Request processed in 537us (811us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044178.272067:0:9501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 88 00000100:00100000:1.0:1784044178.286854:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044178.286972:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565156608 00000100:00100000:0.0:1784044178.286986:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565156608 00000100:00100000:0.0:1784044178.287072:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 37 00000100:00100000:0.0:1784044178.287097:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3943eb3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+5:2410:x1870705565156608:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1784044178.287117:0:8426:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784044178.287141:0:8426:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a21e3764/0x89871fc3aba185dd lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcd3dffad52ca6734 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784044178.287171:0:8426:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a565a91, blocks: 0x0 00010000:00010000:0.0:1784044178.289244:0:8426:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=371s v=(0 0) 00010000:00010000:0.0:1784044178.289250:0:8426:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784044178.289267:0:8426:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a21e3764/0x89871fc3aba185dd lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6734 expref: 6 pid: 8426 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044178.289294:0:8426:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a21e3764/0x89871fc3aba185dd lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6734 expref: 6 pid: 8426 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044178.289310:0:8426:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b38410b7c00, rc 0) 00000100:00100000:0.0:1784044178.289414:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3943eb3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+6:2410:x1870705565156608:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 Request processed in 2329us (2576us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044178.289423:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 37 00000100:00100000:0.0:1784044178.298959:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1784044178.299109:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565156864 00000100:00100000:1.0:1784044178.299128:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565156864 00000100:00100000:2.0:1784044178.299411:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 89 00000100:00100000:2.0:1784044178.299430:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397a8a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+19:11314:x1870705565156864:12345-192.168.202.40@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1784044178.299547:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397a8a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+19:11314:x1870705565156864:12345-192.168.202.40@tcp:57:lhsmtool_posix.0 Request processed in 125us (598us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044178.299556:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 89 00000100:00100000:0.0:1784044178.311470:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044178.312290:0:9822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565156992 00000100:00100000:3.0:1784044178.312301:0:9822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565156992 00000100:00100000:3.0:1784044178.312368:0:9822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 38 00000100:00100000:3.0:1784044178.312379:0:9822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397a8a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a93fdf3c-d42f-420a-95ea-b0cbfe954363+6:11314:x1870705565156992:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1784044178.312397:0:9822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784044178.312415:0:9822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a96afc16/0x89871fc3aba185e4 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcd3dffad52ca673b expref: -99 pid: 9822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044178.312463:0:9822:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a21e3764/0x89871fc3aba185dd lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6734 expref: 7 pid: 8426 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044178.312473:0:9822:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784044178.312477:0:9822:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784044178.312483:0:9822:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a96afc16/0x89871fc3aba185e4 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca673b expref: 7 pid: 9822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044178.312516:0:9822:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a21e3764/0x89871fc3aba185dd lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6734 expref: 7 pid: 8426 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044178.312529:0:9822:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a21e3764/0x89871fc3aba185dd lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6734 expref: 7 pid: 8426 timeout: 471 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044178.312543:0:9822:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39459b7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9822:1870705580977792:192.168.202.40@tcp:104: 00000100:00100000:3.0:1784044178.312658:0:9822:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3843150e40 going to sleep for 11 seconds 00000100:00100000:3.0:1784044178.326672:0:9822:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39459b7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9822:1870705580977792:192.168.202.40@tcp:104: 00010000:00010000:3.0:1784044178.326723:0:9822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a96afc16/0x89871fc3aba185e4 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca673b expref: 7 pid: 9822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044178.326749:0:9822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b394166ae00, rc 0) 00000100:00100000:3.0:1784044178.326835:0:9822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397a8a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a93fdf3c-d42f-420a-95ea-b0cbfe954363+7:11314:x1870705565156992:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 Request processed in 14456us (15373us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044178.326845:0:9822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 38 00000100:00100000:0.0:1784044178.332078:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044178.332162:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565157120 00000100:00100000:2.0:1784044178.332206:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565157120 00010000:00010000:2.0:1784044178.332256:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a21e3764/0x89871fc3aba185dd lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6734 expref: 7 pid: 8426 timeout: 471 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044178.332298:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 63 00000100:00100000:2.0:1784044178.332308:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397a8a7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+7:2409:x1870705565157120:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784044178.332340:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784044178.332363:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a21e3764/0x89871fc3aba185dd lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6734 expref: 7 pid: 8426 timeout: 471 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044178.332376:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a21e3764/0x89871fc3aba185dd lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6734 expref: 7 pid: 8426 timeout: 471 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044178.332402:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a21e3764/0x89871fc3aba185dd lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6734 expref: 7 pid: 8426 timeout: 471 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044178.332420:0:6498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784044178.332425:0:6498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784044178.332434:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a96afc16/0x89871fc3aba185e4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca673b expref: 6 pid: 9822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044178.332445:0:6498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a96afc16/0x89871fc3aba185e4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca673b expref: 6 pid: 9822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044178.332488:0:6498:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000a96afc16/0x89871fc3aba185e4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca673b expref: 6 pid: 9822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044178.332503:0:6498:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397f9e0e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6498:1870705580977920:192.168.202.40@tcp:105: 00000100:00100000:2.0:1784044178.332579:0:6498:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b395558c900 going to sleep for 11 seconds 00000100:00100000:3.0:1784044178.343401:0:6498:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397f9e0e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6498:1870705580977920:192.168.202.40@tcp:105: 00000100:00100000:0.0:1784044178.343401:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00010000:00010000:3.0:1784044178.343432:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784044178.343513:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397a8a7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+6:2409:x1870705565157120:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 11205us (11444us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044178.343528:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 63 00000100:00100000:2.0:1784044178.344502:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565157248 00000100:00100000:2.0:1784044178.344520:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565157248 00002000:00100000:2.0:1784044178.344573:0:8433:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff9b397a8a7800 x1870705565157248/t0(0) o4->a93fdf3c-d42f-420a-95ea-b0cbfe954363@192.168.202.40@tcp:329/0 lens 504/0 e 0 to 0 dl 1784044189 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784044178.344743:0:8433:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b397a8a7800 with x1870705565157248 ext(0->8) 00002000:00010000:2.0:1784044178.344749:0:8433:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b397a8a7800 00000100:00100000:2.0:1784044178.346491:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 0 00000100:00100000:2.0:1784044178.346515:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397a8a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+6:2409:x1870705565157248:12345-192.168.202.40@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1784044178.347538:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397a8a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+8:2409:x1870705565157248:12345-192.168.202.40@tcp:4:lhsmtool_posix.0 Request processed in 1030us (4145us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1784044178.347549:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 0 00002000:00100000:2.0:1784044178.347559:0:8433:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff9b397a8a7800 x1870705565157248/t4294967303(0) o4->a93fdf3c-d42f-420a-95ea-b0cbfe954363@192.168.202.40@tcp:329/0 lens 504/448 e 0 to 0 dl 1784044189 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784044178.347570:0:8433:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b397a8a7800 with x1870705565157248 ext(0->8) 00002000:00010000:2.0:1784044178.347577:0:8433:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b397a8a7800 00000100:00100000:0.0:1784044178.353248:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044178.353322:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565157376 00000100:00100000:2.0:1784044178.353336:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565157376 00000100:00100000:2.0:1784044178.353415:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 90 00000100:00100000:2.0:1784044178.353427:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39503bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+19:11314:x1870705565157376:12345-192.168.202.40@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1784044178.361532:0:6490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967356 is committed 00000004:00080000:1.0:1784044178.361561:0:6490:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:1.0:1784044178.361628:0:6490:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00010000:00010000:1.0:1784044178.361691:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6a00/0x89871fc3aba185ba lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044178.361715:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6a00/0x89871fc3aba185ba lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044178.361725:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6a00/0x89871fc3aba185ba lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044178.361732:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38410b6a00 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:1.0:1784044178.361739:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6a00/0x89871fc3aba185ba lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044178.361748:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6a00/0x89871fc3aba185ba lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044178.361770:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9b39494f7100) 00010000:00010000:1.0:1784044178.361782:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000020:00080000:3.0:1784044178.362293:0:6544:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000020:00080000:3.0:1784044178.362318:0:6544:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00010000:00010000:1.0:1784044178.362991:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6a00/0x89871fc3aba185ba lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044178.363006:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6a00/0x89871fc3aba185ba lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044178.364217:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3943eb2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1870705580978048:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1784044178.364338:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044178.364532:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580978048 00000100:00100000:3.0:1784044178.364543:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580978048 00000100:00100000:3.0:1784044178.365655:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1784044178.365670:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39459b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1870705580978048:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1784044178.365877:0:8428:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1784044178.365881:0:8428:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1784044177 00002000:00010000:3.0:1784044178.365884:0:8428:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1784044178.365886:0:8428:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1784044177 -> 1784044177 00002000:00010000:3.0:1784044178.365889:0:8428:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:3.0:1784044178.365962:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39459b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3638:x1870705580978048:12345-0@lo:2:osp-syn-0-0.0 Request processed in 296us (1623us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1784044178.365971:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000004:00080000:3.0:1784044178.366043:0:3638:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b3943eb2300/2, rc 0, transno 4294967304 00000100:00100000:3.0:1784044178.366051:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3943eb2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1870705580978048:0@lo:2:osp-syn-0-0.0 00000100:00080000:3.0:1784044178.368500:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784044178.369089:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39503bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+14:11314:x1870705565157376:12345-192.168.202.40@tcp:44:lhsmtool_posix.0 Request processed in 15651us (15838us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044178.369106:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 90 00000100:00100000:3.0:1784044178.384323:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044178.385746:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565157504 00000100:00100000:0.0:1784044178.385767:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565157504 00000100:00100000:0.0:1784044178.386016:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 40 00000100:00100000:0.0:1784044178.386031:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39459b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+8:2407:x1870705565157504:12345-192.168.202.40@tcp:16:lhsmtool_posix.0 00000001:00080000:1.0:1784044178.388519:0:8421:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967304 is committed 00000001:00080000:1.0:1784044178.388534:0:8421:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000100:00100000:0.0:1784044178.392353:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39459b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+6:2407:x1870705565157504:12345-192.168.202.40@tcp:16:lhsmtool_posix.0 Request processed in 6309us (8023us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044178.392372:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 40 00000100:00100000:1.0:1784044178.412228:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044178.412424:0:9501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565157760 00000100:00100000:0.0:1784044178.412444:0:9501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565157760 00000100:00100000:0.0:1784044178.412542:0:9501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 91 00000100:00100000:0.0:1784044178.412556:0:9501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3943eb2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a93fdf3c-d42f-420a-95ea-b0cbfe954363+14:11314:x1870705565157760:12345-192.168.202.40@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1784044178.412647:0:9501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784044178.412686:0:9501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166aa00/0x89871fc3aba185d6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca672d expref: 14 pid: 9501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044178.412712:0:9501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9b39494f7100) 00010000:00010000:0.0:1784044178.412718:0:9501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784044178.412764:0:9501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6a00/0x89871fc3aba185eb lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044178.412795:0:9501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6a00/0x89871fc3aba185eb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044178.412942:0:9501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6a00/0x89871fc3aba185eb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784044178.414201:0:9501:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000eb0bc06e reply state 00000000d8ca6a36 transno 4294967357 ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6a00/0x89871fc3aba185eb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044178.414241:0:9501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6a00/0x89871fc3aba185eb lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044178.414251:0:9501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9b39494f7100) 00010000:00010000:0.0:1784044178.414255:0:9501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1784044178.414261:0:9501:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1784044178.416148:0:9501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3943eb2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a93fdf3c-d42f-420a-95ea-b0cbfe954363+15:11314:x1870705565157760:12345-192.168.202.40@tcp:36:lhsmtool_posix.0 Request processed in 3578us (3914us total) trans 4294967357 rc 0/0 00000100:00100000:0.0:1784044178.416164:0:9501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 91 00000100:00100000:2.0:1784044178.420716:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1784044178.422403:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565157888 00000100:00100000:1.0:1784044178.422422:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565157888 00000100:00100000:1.0:1784044178.422549:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 41 00000100:00100000:1.0:1784044178.422563:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397f9e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+6:2410:x1870705565157888:12345-192.168.202.40@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1784044178.422792:0:8428:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:1.0:1784044178.422795:0:8428:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1784044177 -> 1784044176 00002000:00010000:1.0:1784044178.422798:0:8428:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 0 -> 1784044175 00002000:00010000:1.0:1784044178.422801:0:8428:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1784044177 -> 1784044176 00002000:00010000:1.0:1784044178.422803:0:8428:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:1.0:1784044178.422878:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397f9e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+7:2410:x1870705565157888:12345-192.168.202.40@tcp:2:lhsmtool_posix.0 Request processed in 318us (2171us total) trans 4294967305 rc 0/0 00000100:00100000:1.0:1784044178.422886:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 41 00000100:00100000:2.0:1784044178.433695:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044178.433783:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565158144 00000100:00100000:0.0:1784044178.433801:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565158144 00000100:00100000:0.0:1784044178.434402:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 92 00000100:00100000:0.0:1784044178.434424:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397f9e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+15:11314:x1870705565158144:12345-192.168.202.40@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1784044178.434642:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7c00/0x89871fc3aba185f2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044178.434668:0:6511:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799000/0x89871fc3aba185b3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca671f expref: 15 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044178.434681:0:6511:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7c00/0x89871fc3aba185f2 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044178.434754:0:6511:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799000/0x89871fc3aba185b3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca671f expref: 15 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044178.434770:0:6511:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799000/0x89871fc3aba185b3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca671f expref: 15 pid: 6511 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044178.434788:0:6511:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39503be300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6511:1870705580978176:192.168.202.40@tcp:104: 00000100:00100000:0.0:1784044178.435115:0:6511:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b384341b000 going to sleep for 11 seconds 00000100:00100000:2.0:1784044178.439845:0:6511:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39503be300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6511:1870705580978176:192.168.202.40@tcp:104: 00010000:00010000:2.0:1784044178.439885:0:6511:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7c00/0x89871fc3aba185f2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044178.439900:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1784044178.439967:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565158272 00000100:00100000:1.0:1784044178.439976:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565158272 00010000:00010000:1.0:1784044178.440014:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799000/0x89871fc3aba185b3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca671f expref: 16 pid: 6511 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044178.440067:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 64 00000100:00100000:1.0:1784044178.440076:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39503bea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+16:2409:x1870705565158272:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784044178.440093:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784044178.440100:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799000/0x89871fc3aba185b3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca671f expref: 16 pid: 6511 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044178.440113:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799000/0x89871fc3aba185b3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca671f expref: 16 pid: 6511 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044178.440138:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799000/0x89871fc3aba185b3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca671f expref: 16 pid: 6511 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044178.440152:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9b39494f7100) 00010000:00010000:1.0:1784044178.440157:0:6497:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7c00/0x89871fc3aba185f2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044178.440198:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7c00/0x89871fc3aba185f2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044178.440207:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7c00/0x89871fc3aba185f2 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044178.440230:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784044178.440355:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39503bea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+15:2409:x1870705565158272:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 279us (470us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044178.440363:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 64 00010000:00010000:2.0:1784044178.440677:0:6511:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7c00/0x89871fc3aba185f2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044178.440695:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7c00/0x89871fc3aba185f2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044178.440749:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7c00/0x89871fc3aba185f2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044178.440756:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7c00/0x89871fc3aba185f2 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044178.440764:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7c00/0x89871fc3aba185f2 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044178.440770:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38410b7c00 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:2.0:1784044178.440774:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7c00/0x89871fc3aba185f2 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044178.440781:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7c00/0x89871fc3aba185f2 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044178.440791:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9b39494f7100) 00010000:00010000:2.0:1784044178.440794:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1784044178.440798:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7c00/0x89871fc3aba185f2 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044178.440805:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7c00/0x89871fc3aba185f2 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044178.440897:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397f9e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+14:11314:x1870705565158144:12345-192.168.202.40@tcp:55:lhsmtool_posix.0 Request processed in 6481us (7211us total) trans 0 rc -22/-22 00000100:00100000:2.0:1784044178.440906:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 92 00000100:00100000:1.0:1784044178.446634:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044178.446764:0:9822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565158400 00000100:00100000:3.0:1784044178.446782:0:9822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565158400 00000100:00100000:3.0:1784044178.446901:0:9822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 42 00000100:00100000:3.0:1784044178.446912:0:9822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38436a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a93fdf3c-d42f-420a-95ea-b0cbfe954363+7:2409:x1870705565158400:12345-192.168.202.40@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1784044178.446966:0:9822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008c8b1a27/0x89871fc3aba185f9 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044178.447006:0:9822:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a96afc16/0x89871fc3aba185e4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca673b expref: 7 pid: 9822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044178.447016:0:9822:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784044178.447022:0:9822:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1784044178.447027:0:9822:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008c8b1a27/0x89871fc3aba185f9 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044178.447071:0:9822:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a96afc16/0x89871fc3aba185e4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca673b expref: 7 pid: 9822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044178.447087:0:9822:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a96afc16/0x89871fc3aba185e4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca673b expref: 7 pid: 9822 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044178.447101:0:9822:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39459b6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9822:1870705580978304:192.168.202.40@tcp:104: 00000100:00100000:3.0:1784044178.447239:0:9822:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3843703240 going to sleep for 11 seconds 00000100:00100000:2.0:1784044178.454020:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044178.454462:0:9822:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39459b6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9822:1870705580978304:192.168.202.40@tcp:104: 00010000:00010000:3.0:1784044178.454501:0:9822:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008c8b1a27/0x89871fc3aba185f9 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044178.454895:0:13182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565158528 00000100:00100000:0.0:1784044178.454906:0:13182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565158528 00010000:00010000:0.0:1784044178.454962:0:13182:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a96afc16/0x89871fc3aba185e4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca673b expref: 8 pid: 9822 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044178.455013:0:13182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 65 00000100:00100000:0.0:1784044178.455025:0:13182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397f9e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a93fdf3c-d42f-420a-95ea-b0cbfe954363+8:2409:x1870705565158528:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784044178.455048:0:13182:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784044178.455080:0:13182:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a96afc16/0x89871fc3aba185e4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca673b expref: 8 pid: 9822 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044178.455095:0:13182:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a96afc16/0x89871fc3aba185e4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca673b expref: 8 pid: 9822 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044178.455126:0:13182:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a96afc16/0x89871fc3aba185e4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca673b expref: 8 pid: 9822 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044178.455154:0:13182:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1784044178.455388:0:13182:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1784044178.455398:0:13182:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008c8b1a27/0x89871fc3aba185f9 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044178.455409:0:13182:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008c8b1a27/0x89871fc3aba185f9 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044178.455446:0:13182:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784044178.455544:0:13182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397f9e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a93fdf3c-d42f-420a-95ea-b0cbfe954363+7:2409:x1870705565158528:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 520us (1534us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044178.455553:0:13182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 65 00010000:00010000:3.0:1784044178.455557:0:9822:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008c8b1a27/0x89871fc3aba185f9 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044178.455565:0:9822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008c8b1a27/0x89871fc3aba185f9 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044178.455589:0:9822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008c8b1a27/0x89871fc3aba185f9 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044178.455597:0:9822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008c8b1a27/0x89871fc3aba185f9 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044178.455605:0:9822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008c8b1a27/0x89871fc3aba185f9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044178.455612:0:9822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b394166b800 already unused, calling callback (ffffffffc0b56230) 00010000:00010000:3.0:1784044178.455616:0:9822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008c8b1a27/0x89871fc3aba185f9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044178.455634:0:9822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008c8b1a27/0x89871fc3aba185f9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044178.455648:0:9822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008c8b1a27/0x89871fc3aba185f9 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044178.455667:0:9822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008c8b1a27/0x89871fc3aba185f9 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044178.455738:0:9822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38436a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a93fdf3c-d42f-420a-95ea-b0cbfe954363+6:2409:x1870705565158400:12345-192.168.202.40@tcp:1:lhsmtool_posix.0 Request processed in 8828us (9127us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044178.455747:0:9822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 42 00000100:00100000:3.0:1784044178.467030:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044178.467068:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565158784 00000100:00100000:3.0:1784044178.468475:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565158784 00000100:00100000:3.0:1784044178.468556:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 93 00000100:00100000:3.0:1784044178.468568:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39459b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+14:11314:x1870705565158784:12345-192.168.202.40@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1784044178.468663:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166b800/0x89871fc3aba18600 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044178.468683:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6600/0x89871fc3aba18440 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca66c4 expref: 14 pid: 13808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044178.469657:0:6512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166b800/0x89871fc3aba18600 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044178.469776:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6600/0x89871fc3aba18440 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca66c4 expref: 14 pid: 13808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044178.469791:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6600/0x89871fc3aba18440 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca66c4 expref: 14 pid: 13808 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044178.469818:0:6512:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39459b4380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6512:1870705580978432:192.168.202.40@tcp:104: 00000100:00100000:3.0:1784044178.469917:0:6512:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3843703240 going to sleep for 11 seconds 00000100:00100000:3.0:1784044178.474520:0:6512:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39459b4380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6512:1870705580978432:192.168.202.40@tcp:104: 00010000:00010000:3.0:1784044178.474567:0:6512:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166b800/0x89871fc3aba18600 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044178.479045:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1784044178.482704:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565158912 00000100:00100000:1.0:1784044178.482721:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565158912 00010000:00010000:1.0:1784044178.482821:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6600/0x89871fc3aba18440 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca66c4 expref: 15 pid: 13808 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044178.482906:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 66 00000100:00100000:1.0:1784044178.482917:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397f9e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+15:2409:x1870705565158912:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784044178.482932:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784044178.482940:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6600/0x89871fc3aba18440 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca66c4 expref: 15 pid: 13808 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044178.482956:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6600/0x89871fc3aba18440 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca66c4 expref: 15 pid: 13808 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044178.482979:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6600/0x89871fc3aba18440 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca66c4 expref: 15 pid: 13808 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044178.482995:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9b397aa61500) 00010000:00010000:1.0:1784044178.483001:0:6497:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166b800/0x89871fc3aba18600 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044178.483011:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166b800/0x89871fc3aba18600 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044178.483018:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166b800/0x89871fc3aba18600 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044178.483045:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784044178.483108:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397f9e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+14:2409:x1870705565158912:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 192us (4073us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044178.483124:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 66 00010000:00010000:0.0:1784044178.486422:0:6512:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166b800/0x89871fc3aba18600 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044178.486441:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166b800/0x89871fc3aba18600 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044178.486717:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6200/0x89871fc3aba18607 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044178.486746:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166be00/0x89871fc3aba185c1 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6726 expref: 14 pid: 13808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044178.486755:0:6512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6200/0x89871fc3aba18607 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044178.486801:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166be00/0x89871fc3aba185c1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6726 expref: 14 pid: 13808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044178.486824:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166be00/0x89871fc3aba185c1 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6726 expref: 14 pid: 13808 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044178.486839:0:6512:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39503be680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6512:1870705580978560:192.168.202.40@tcp:104: 00000100:00100000:0.0:1784044178.486935:0:6512:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b384341bb40 going to sleep for 11 seconds 00000100:00100000:2.0:1784044178.502123:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044178.502294:0:6512:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39503be680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6512:1870705580978560:192.168.202.40@tcp:104: 00010000:00010000:3.0:1784044178.502330:0:6512:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6200/0x89871fc3aba18607 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044178.502376:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565159040 00000100:00100000:3.0:1784044178.502382:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565159040 00010000:00010000:3.0:1784044178.502419:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166be00/0x89871fc3aba185c1 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6726 expref: 15 pid: 13808 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044178.502453:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 67 00000100:00100000:3.0:1784044178.502460:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397f9e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+15:2409:x1870705565159040:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784044178.502474:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784044178.502481:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166be00/0x89871fc3aba185c1 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6726 expref: 15 pid: 13808 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044178.502492:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166be00/0x89871fc3aba185c1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6726 expref: 15 pid: 13808 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044178.502513:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166be00/0x89871fc3aba185c1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6726 expref: 15 pid: 13808 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044178.502533:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9b39494f7100) 00010000:00010000:3.0:1784044178.502538:0:6498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6200/0x89871fc3aba18607 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044178.502548:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6200/0x89871fc3aba18607 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044178.502555:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6200/0x89871fc3aba18607 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044178.502576:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784044178.503045:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397f9e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+14:2409:x1870705565159040:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 582us (930us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044178.503053:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 67 00010000:00010000:3.0:1784044178.503202:0:6512:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6200/0x89871fc3aba18607 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044178.503210:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6200/0x89871fc3aba18607 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1784044178.503330:0:6512:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000001:00080000:3.0:1784044178.503452:0:6512:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000001:00080000:3.0:1784044178.503490:0:6512:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967360 00000100:00100000:3.0:1784044178.503573:0:6512:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39459b4380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6512:1870705580978688:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1784044178.503955:0:6512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044178.503983:0:6512:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3951e52840 going to sleep for 11 seconds 00000100:00100000:2.0:1784044178.504572:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580978688 00000100:00100000:2.0:1784044178.504581:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580978688 00000100:00100000:2.0:1784044178.504654:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1784044178.504664:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39459b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6512:x1870705580978688:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1784044178.504761:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39459b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6512:x1870705580978688:12345-0@lo:1000:mdt00_001.0 Request processed in 100us (807us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044178.504768:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1784044178.505300:0:6512:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:3.0:1784044178.505307:0:6512:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b3943eb2300, transno 4294967304 00000100:00100000:3.0:1784044178.505325:0:6512:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39459b4380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6512:1870705580978688:0@lo:1000:mdt00_001.0 00000001:00080000:3.0:1784044178.505497:0:6512:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00000100:00100000:3.0:1784044178.505565:0:6512:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39459b4380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6512:1870705580978816:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1784044178.505878:0:6512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044178.506348:0:6512:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b39450d8300 going to sleep for 11 seconds 00000100:00100000:2.0:1784044178.509627:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580978816 00000100:00100000:2.0:1784044178.509643:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580978816 00000100:00100000:2.0:1784044178.509731:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1784044178.509742:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39459b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6512:x1870705580978816:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1784044178.510107:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39459b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6512:x1870705580978816:12345-0@lo:1000:mdt00_001.0 Request processed in 367us (4499us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1784044178.510115:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1784044178.510320:0:6512:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39459b4380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6512:1870705580978816:0@lo:1000:mdt00_001.0 00010000:00010000:3.0:1784044178.510392:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6200/0x89871fc3aba18607 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044178.510403:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6200/0x89871fc3aba18607 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044178.510410:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6200/0x89871fc3aba18607 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044178.510427:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38410b6200 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:3.0:1784044178.510432:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6200/0x89871fc3aba18607 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044178.510438:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6200/0x89871fc3aba18607 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044178.510453:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9b39494f7100) 00010000:00010000:3.0:1784044178.510456:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1784044178.510460:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6200/0x89871fc3aba18607 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044178.510465:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6200/0x89871fc3aba18607 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044178.510494:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166b600/0x89871fc3aba1853c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044178.510509:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166b600/0x89871fc3aba1853c lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044178.510514:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166b600/0x89871fc3aba1853c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044178.510520:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b394166b600 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:3.0:1784044178.510523:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166b600/0x89871fc3aba1853c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044178.510529:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166b600/0x89871fc3aba1853c lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044178.510538:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9b397aa61500) 00010000:00010000:3.0:1784044178.510540:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1784044178.510544:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166b600/0x89871fc3aba1853c lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044178.510550:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166b600/0x89871fc3aba1853c lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044178.510575:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166bc00/0x89871fc3aba1860e lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044178.510591:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7e00/0x89871fc3aba18558 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca670a expref: 17 pid: 13808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044178.510601:0:6512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166bc00/0x89871fc3aba1860e lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044178.510719:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3943eb2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1870705580978944:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1784044178.510774:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1784044178.510832:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7e00/0x89871fc3aba18558 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca670a expref: 17 pid: 13808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044178.510852:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7e00/0x89871fc3aba18558 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca670a expref: 17 pid: 13808 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044178.510864:0:6512:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39459b7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6512:1870705580979072:192.168.202.40@tcp:104: 00000100:00100000:3.0:1784044178.510938:0:6512:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b39450d8300 going to sleep for 11 seconds 00000100:00100000:2.0:1784044178.510962:0:7768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580978944 00000100:00100000:2.0:1784044178.510968:0:7768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580978944 00000100:00100000:2.0:1784044178.511008:0:7768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1784044178.511015:0:7768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39503be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1870705580978944:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1784044178.511042:0:7768:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:2.0:1784044178.511083:0:7768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39503be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1870705580978944:12345-0@lo:41:osp-pre-0-1.0 Request processed in 69us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044178.511090:0:7768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1784044178.511122:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3943eb2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1870705580978944:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1784044178.521425:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044178.521462:0:6512:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39459b7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6512:1870705580979072:192.168.202.40@tcp:104: 00000100:00100000:2.0:1784044178.521481:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565159168 00000100:00100000:2.0:1784044178.521488:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565159168 00010000:00010000:0.0:1784044178.521500:0:6512:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166bc00/0x89871fc3aba1860e lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044178.521530:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7e00/0x89871fc3aba18558 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca670a expref: 18 pid: 13808 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044178.521578:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 68 00000100:00100000:2.0:1784044178.521590:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3943eb2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+18:2409:x1870705565159168:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784044178.521613:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784044178.521633:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7e00/0x89871fc3aba18558 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca670a expref: 18 pid: 13808 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044178.521646:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7e00/0x89871fc3aba18558 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca670a expref: 18 pid: 13808 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044178.521674:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7e00/0x89871fc3aba18558 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca670a expref: 18 pid: 13808 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044178.521689:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9b397aa61500) 00010000:00010000:2.0:1784044178.521695:0:6496:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166bc00/0x89871fc3aba1860e lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044178.521706:0:6496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166bc00/0x89871fc3aba1860e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044178.521713:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166bc00/0x89871fc3aba1860e lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044178.521748:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784044178.521797:0:6512:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166bc00/0x89871fc3aba1860e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044178.521802:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3943eb2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+17:2409:x1870705565159168:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 214us (392us total) trans 0 rc 0/0 00010000:00010000:0.0:1784044178.521805:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166bc00/0x89871fc3aba1860e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044178.521816:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 68 00010000:00010000:0.0:1784044178.521818:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166bc00/0x89871fc3aba1860e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044178.521824:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166bc00/0x89871fc3aba1860e lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044178.521830:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166bc00/0x89871fc3aba1860e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044178.521836:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b394166bc00 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:0.0:1784044178.521841:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166bc00/0x89871fc3aba1860e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044178.521855:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166bc00/0x89871fc3aba1860e lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044178.521865:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9b397aa61500) 00010000:00010000:0.0:1784044178.521868:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784044178.521872:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166bc00/0x89871fc3aba1860e lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044178.521877:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166bc00/0x89871fc3aba1860e lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044178.521890:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166b800/0x89871fc3aba18600 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044178.521895:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166b800/0x89871fc3aba18600 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044178.521900:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166b800/0x89871fc3aba18600 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044178.521904:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b394166b800 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:0.0:1784044178.521907:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166b800/0x89871fc3aba18600 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044178.521912:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166b800/0x89871fc3aba18600 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044178.521919:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9b397aa61500) 00010000:00010000:0.0:1784044178.521921:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1784044178.521923:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166b800/0x89871fc3aba18600 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044178.521939:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166b800/0x89871fc3aba18600 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044178.522106:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39459b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+16:11314:x1870705565158784:12345-192.168.202.40@tcp:57:lhsmtool_posix.0 Request processed in 53539us (55086us total) trans 4294967362 rc 0/0 00000100:00100000:0.0:1784044178.522115:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 93 00000020:00080000:0.0:1784044178.522119:0:6512:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1784044178.522971:0:13763:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1784044178.522981:0:13763:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1784044178.523001:0:13763:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1784044178.523007:0:13763:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1784044178.531364:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044178.531410:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565159424 00000100:00100000:2.0:1784044178.531419:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565159424 00000100:00100000:2.0:1784044178.531476:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 20 00000100:00100000:2.0:1784044178.531488:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843ca9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+16:11314:x1870705565159424:12345-192.168.202.40@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1784044178.531807:0:6515:0:(mdd_object.c:4016:mdd_close()) Object [0x200000402:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1784044178.531845:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967363 00010000:00010000:2.0:1784044178.531881:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798a00/0x89871fc3aba18615 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044178.531899:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798a00/0x89871fc3aba18615 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044178.531915:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798a00/0x89871fc3aba18615 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044178.531924:0:6515:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798a00/0x89871fc3aba18615 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044178.531931:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798a00/0x89871fc3aba18615 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044178.531938:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798a00/0x89871fc3aba18615 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044178.531976:0:6515:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1784044178.532074:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843ca9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+18:11314:x1870705565159424:12345-192.168.202.40@tcp:35:lhsmtool_posix.0 Request processed in 588us (720us total) trans 4294967364 rc 0/0 00000100:00100000:2.0:1784044178.532082:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 20 00000020:00080000:2.0:1784044178.532089:0:6515:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1784044178.532118:0:10330:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784044178.532126:0:10330:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798a00/0x89871fc3aba18615 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044178.532134:0:10330:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3843798a00 already unused, calling callback (ffffffffc0b56230) 00010000:00010000:2.0:1784044178.532139:0:10330:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798a00/0x89871fc3aba18615 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044178.532148:0:10330:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798a00/0x89871fc3aba18615 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044178.532217:0:10330:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9b39494f7100) 00010000:00010000:2.0:1784044178.532221:0:10330:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1784044178.532226:0:10330:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798a00/0x89871fc3aba18615 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044178.532232:0:10330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798a00/0x89871fc3aba18615 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044178.532243:0:10330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784044178.532452:0:10330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784044178.532455:0:10330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1784044178.541087:0:14212:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1784044178.541097:0:14212:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1784044178.541120:0:14212:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1784044178.541131:0:14212:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1784044178.678600:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044178.678690:0:9501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565159680 00000100:00100000:3.0:1784044178.678702:0:9501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565159680 00000100:00100000:3.0:1784044178.678768:0:9501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 94 00000100:00100000:3.0:1784044178.678778:0:9501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39503be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a93fdf3c-d42f-420a-95ea-b0cbfe954363+18:11323:x1870705565159680:12345-192.168.202.40@tcp:101:lfs.0 00010000:00010000:3.0:1784044178.678803:0:9501:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784044178.678824:0:9501:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166b600/0x89871fc3aba1861c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcd3dffad52ca6742 expref: -99 pid: 9501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044178.678919:0:9501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166be00/0x89871fc3aba18623 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044178.678930:0:9501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166be00/0x89871fc3aba18623 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044178.678938:0:9501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166be00/0x89871fc3aba18623 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784044178.678946:0:9501:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:3.0:1784044178.679049:0:9501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166b600/0x89871fc3aba1861c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6742 expref: 21 pid: 9501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044178.679062:0:9501:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166be00/0x89871fc3aba18623 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6742 expref: 20 pid: 9501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044178.679080:0:9501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9b397aa61900) 00010000:00010000:3.0:1784044178.679082:0:9501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1784044178.679084:0:9501:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b394166be00, rc 0) 00000100:00100000:3.0:1784044178.679132:0:9501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39503be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a93fdf3c-d42f-420a-95ea-b0cbfe954363+20:11323:x1870705565159680:12345-192.168.202.40@tcp:101:lfs.0 Request processed in 357us (542us total) trans 4294967365 rc 0/0 00000100:00100000:3.0:1784044178.679137:0:9501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 94 00000100:00100000:3.0:1784044178.681131:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044178.681240:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565159808 00000100:00100000:0.0:1784044178.681249:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565159808 00000100:00100000:0.0:1784044178.681329:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 95 00000100:00100000:0.0:1784044178.681339:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39459b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+20:11323:x1870705565159808:12345-192.168.202.40@tcp:34:lfs.0 00010000:00010000:0.0:1784044178.681414:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6800/0x89871fc3aba18631 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044178.681430:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6800/0x89871fc3aba18631 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044178.681443:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6800/0x89871fc3aba18631 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044178.681462:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7e00/0x89871fc3aba18638 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044178.681469:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7e00/0x89871fc3aba18638 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044178.681475:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7e00/0x89871fc3aba18638 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044178.681580:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7800/0x89871fc3aba1863f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044178.681589:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7800/0x89871fc3aba1863f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044178.681597:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7800/0x89871fc3aba1863f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784044178.681657:0:6511:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7800/0x89871fc3aba1863f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044178.681670:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6800/0x89871fc3aba18631 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044178.681677:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6800/0x89871fc3aba18631 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044178.681686:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6800/0x89871fc3aba18631 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044178.681693:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38410b6800 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:0.0:1784044178.681698:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6800/0x89871fc3aba18631 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044178.681705:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6800/0x89871fc3aba18631 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044178.681717:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9b397aa61900) 00010000:00010000:0.0:1784044178.681721:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784044178.681725:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6800/0x89871fc3aba18631 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044178.681739:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6800/0x89871fc3aba18631 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044178.681751:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7e00/0x89871fc3aba18638 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044178.681757:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7e00/0x89871fc3aba18638 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044178.681762:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7e00/0x89871fc3aba18638 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044178.681767:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38410b7e00 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:0.0:1784044178.681770:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7e00/0x89871fc3aba18638 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044178.681776:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7e00/0x89871fc3aba18638 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044178.681784:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9b39758c1100) 00010000:00010000:0.0:1784044178.681786:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784044178.681789:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7e00/0x89871fc3aba18638 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044178.681795:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7e00/0x89871fc3aba18638 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044178.681808:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7800/0x89871fc3aba1863f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044178.681813:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7800/0x89871fc3aba1863f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044178.681825:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7800/0x89871fc3aba1863f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044178.681829:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38410b7800 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:0.0:1784044178.681832:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7800/0x89871fc3aba1863f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044178.681837:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7800/0x89871fc3aba1863f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044178.681846:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9b39758c1b00) 00010000:00010000:0.0:1784044178.681848:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784044178.681850:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7800/0x89871fc3aba1863f lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044178.681856:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7800/0x89871fc3aba1863f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044178.681947:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39459b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+20:11323:x1870705565159808:12345-192.168.202.40@tcp:34:lfs.0 Request processed in 607us (824us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044178.681957:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 95 00000100:00100000:2.0:1784044178.728966:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044178.729226:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565160064 00000100:00100000:0.0:1784044178.729237:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565160064 00000100:00100000:0.0:1784044178.729307:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 96 00000100:00100000:0.0:1784044178.729322:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843ca8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+20:11327:x1870705565160064:12345-192.168.202.40@tcp:101:lfs.0 00010000:00010000:0.0:1784044178.729344:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784044178.729368:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7800/0x89871fc3aba18646 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcd3dffad52ca6749 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044178.729455:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7e00/0x89871fc3aba1864d lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044178.729471:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7e00/0x89871fc3aba1864d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044178.729482:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7e00/0x89871fc3aba1864d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044178.729493:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6800/0x89871fc3aba18654 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044178.729498:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6800/0x89871fc3aba18654 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044178.729502:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6800/0x89871fc3aba18654 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044178.729594:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6200/0x89871fc3aba1865b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044178.729599:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6200/0x89871fc3aba1865b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044178.729604:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6200/0x89871fc3aba1865b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784044178.729612:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:0.0:1784044178.729693:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7e00/0x89871fc3aba1864d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044178.729698:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7e00/0x89871fc3aba1864d lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044178.729707:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7e00/0x89871fc3aba1864d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044178.729712:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38410b7e00 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:0.0:1784044178.729715:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7e00/0x89871fc3aba1864d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044178.729720:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7e00/0x89871fc3aba1864d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044178.729731:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9b397aa61900) 00010000:00010000:0.0:1784044178.729734:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784044178.729739:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7e00/0x89871fc3aba1864d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044178.729745:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7e00/0x89871fc3aba1864d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044178.729755:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6800/0x89871fc3aba18654 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044178.729761:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6800/0x89871fc3aba18654 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044178.729766:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6800/0x89871fc3aba18654 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044178.729771:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38410b6800 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:0.0:1784044178.729775:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6800/0x89871fc3aba18654 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044178.729791:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6800/0x89871fc3aba18654 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044178.729798:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9b39758c1b00) 00010000:00010000:0.0:1784044178.729800:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784044178.729802:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6800/0x89871fc3aba18654 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044178.729805:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6800/0x89871fc3aba18654 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044178.729838:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7800/0x89871fc3aba18646 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6749 expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044178.729846:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6200/0x89871fc3aba1865b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6749 expref: 22 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044178.729851:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9b39758c1100) 00010000:00010000:0.0:1784044178.729852:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784044178.729854:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b38410b6200, rc 0) 00000100:00100000:0.0:1784044178.729914:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843ca8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+22:11327:x1870705565160064:12345-192.168.202.40@tcp:101:lfs.0 Request processed in 594us (960us total) trans 4294967366 rc 0/0 00000100:00100000:0.0:1784044178.729921:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 96 00000100:00100000:0.0:1784044178.732980:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044178.733068:0:13808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565160192 00000100:00100000:2.0:1784044178.733137:0:13808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565160192 00000100:00100000:2.0:1784044178.733214:0:13808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 97 00000100:00100000:2.0:1784044178.733225:0:13808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b384316f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a93fdf3c-d42f-420a-95ea-b0cbfe954363+22:11327:x1870705565160192:12345-192.168.202.40@tcp:54:lfs.0 00010000:00010000:2.0:1784044178.733358:0:13808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798400/0x89871fc3aba18669 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044178.733384:0:13808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798400/0x89871fc3aba18669 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044178.733396:0:13808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798400/0x89871fc3aba18669 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044178.733434:0:13808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798400/0x89871fc3aba18669 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044178.733441:0:13808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798400/0x89871fc3aba18669 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044178.733447:0:13808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798400/0x89871fc3aba18669 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044178.733452:0:13808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3843798400 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:2.0:1784044178.733456:0:13808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798400/0x89871fc3aba18669 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044178.733463:0:13808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798400/0x89871fc3aba18669 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044178.733474:0:13808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9b39758c1100) 00010000:00010000:2.0:1784044178.733482:0:13808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1784044178.733487:0:13808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798400/0x89871fc3aba18669 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044178.733492:0:13808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798400/0x89871fc3aba18669 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044178.733562:0:13808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b384316f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a93fdf3c-d42f-420a-95ea-b0cbfe954363+22:11327:x1870705565160192:12345-192.168.202.40@tcp:54:lfs.0 Request processed in 338us (588us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044178.733570:0:13808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 97 00000100:00100000:3.0:1784044178.735426:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044178.737662:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565160448 00000100:00100000:0.0:1784044178.737675:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565160448 00000100:00100000:0.0:1784044178.737743:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 21 00000100:00100000:0.0:1784044178.737753:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3974225450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+22:11327:x1870705565160448:12345-192.168.202.40@tcp:35:lfs.0 00000100:00100000:0.0:1784044178.737989:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3974225450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+23:11327:x1870705565160448:12345-192.168.202.40@tcp:35:lfs.0 Request processed in 237us (2572us total) trans 4294967367 rc 0/0 00000100:00100000:0.0:1784044178.737998:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 21 00000100:00100000:0.0:1784044178.787522:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044178.787576:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565160704 00000100:00100000:0.0:1784044178.787587:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565160704 00000100:00100000:0.0:1784044178.787697:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 98 00000100:00100000:0.0:1784044178.787710:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b384316fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+23:10854:x1870705565160704:12345-192.168.202.40@tcp:101:bash.0 00010000:00010000:0.0:1784044178.788832:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784044178.788860:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7800/0x89871fc3aba18670 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcd3dffad52ca6750 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044178.789000:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6800/0x89871fc3aba18677 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044178.789018:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6200/0x89871fc3aba1865b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6749 expref: 24 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044178.789028:0:6513:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6800/0x89871fc3aba18677 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044178.789061:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6200/0x89871fc3aba1865b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6749 expref: 24 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044178.789240:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6200/0x89871fc3aba1865b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6749 expref: 24 pid: 6512 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044178.789257:0:6513:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b384316c380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6513:1870705580979200:192.168.202.40@tcp:104: 00000100:00100000:0.0:1784044178.790542:0:6513:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b384341ba80 going to sleep for 11 seconds 00000100:00100000:0.0:1784044178.796588:0:6513:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b384316c380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6513:1870705580979200:192.168.202.40@tcp:104: 00010000:00010000:0.0:1784044178.796639:0:6513:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6800/0x89871fc3aba18677 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044178.798882:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044178.798955:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565160832 00000100:00100000:2.0:1784044178.798965:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565160832 00010000:00010000:2.0:1784044178.799003:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6200/0x89871fc3aba1865b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6749 expref: 25 pid: 6512 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044178.799073:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 69 00000100:00100000:2.0:1784044178.799084:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3944093c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+25:2409:x1870705565160832:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784044178.799102:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784044178.799109:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6200/0x89871fc3aba1865b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6749 expref: 25 pid: 6512 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044178.799123:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6200/0x89871fc3aba1865b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6749 expref: 25 pid: 6512 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044178.799144:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6200/0x89871fc3aba1865b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6749 expref: 25 pid: 6512 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044178.799159:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9b39758c1100) 00010000:00010000:2.0:1784044178.799164:0:6498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6800/0x89871fc3aba18677 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044178.799199:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6800/0x89871fc3aba18677 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044178.799207:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6800/0x89871fc3aba18677 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044178.799236:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784044178.799303:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3944093c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+24:2409:x1870705565160832:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 220us (430us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044178.799311:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 69 00010000:00010000:0.0:1784044178.800043:0:6513:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6800/0x89871fc3aba18677 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044178.800057:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6800/0x89871fc3aba18677 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784044178.800078:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:0.0:1784044178.800872:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7800/0x89871fc3aba18670 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6750 expref: 25 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044178.800895:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6800/0x89871fc3aba18677 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6750 expref: 24 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044178.800904:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9b39758c1100) 00010000:00010000:0.0:1784044178.800907:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1784044178.800910:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b38410b6800, rc 0) 00000100:00100000:0.0:1784044178.800964:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b384316fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+24:10854:x1870705565160704:12345-192.168.202.40@tcp:101:bash.0 Request processed in 13257us (13451us total) trans 4294967368 rc 0/0 00000100:00100000:0.0:1784044178.800973:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 98 00000100:00100000:3.0:1784044178.805919:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044178.806023:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565160960 00000100:00100000:0.0:1784044178.806033:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565160960 00000100:00100000:0.0:1784044178.806200:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 99 00000100:00100000:0.0:1784044178.806214:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39459b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+24:10854:x1870705565160960:12345-192.168.202.40@tcp:101:bash.0 00010000:00010000:0.0:1784044178.806248:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784044178.806271:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6600/0x89871fc3aba18685 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcd3dffad52ca6757 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044178.806309:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6000/0x89871fc3aba1868c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044178.806323:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6000/0x89871fc3aba1868c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044178.806334:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6000/0x89871fc3aba1868c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044178.806521:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6600/0x89871fc3aba18685 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6757 expref: 26 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044178.806536:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6000/0x89871fc3aba1868c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6757 expref: 25 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044178.806545:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9b39758c1100) 00010000:00010000:0.0:1784044178.806548:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1784044178.806551:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b38410b6000, rc 0) 00000100:00100000:0.0:1784044178.806632:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39459b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+25:10854:x1870705565160960:12345-192.168.202.40@tcp:101:bash.0 Request processed in 422us (723us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044178.806640:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 99 00000100:00100000:1.0:1784044178.811741:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044178.811788:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565161216 00000100:00100000:2.0:1784044178.811799:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565161216 00000100:00100000:0.0:1784044178.811900:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 100 00000100:00100000:0.0:1784044178.811925:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39759b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+25:10854:x1870705565161216:12345-192.168.202.40@tcp:36:bash.0 00010000:00010000:0.0:1784044178.812155:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7600/0x89871fc3aba18693 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044178.812221:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7600/0x89871fc3aba18693 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044178.812234:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7600/0x89871fc3aba18693 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1784044178.812283:0:6512:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967369 00000004:00010000:0.0:1784044178.812305:0:6512:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000001f10f3d1 reply state 00000000e1c273bc transno 4294967370 ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7600/0x89871fc3aba18693 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044178.812319:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7600/0x89871fc3aba18693 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044178.812326:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9b39758c1100) 00010000:00010000:0.0:1784044178.812330:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1784044178.812334:0:6512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:0.0:1784044178.812395:0:6512:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967370 00000100:00100000:0.0:1784044178.812500:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39759b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+29:10854:x1870705565161216:12345-192.168.202.40@tcp:36:bash.0 Request processed in 590us (776us total) trans 4294967371 rc 0/0 00000100:00100000:0.0:1784044178.812508:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 100 00000020:00080000:0.0:1784044178.812512:0:6512:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:2.0:1784044178.814220:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044178.814257:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565161344 00000100:00100000:0.0:1784044178.814265:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565161344 00000100:00100000:0.0:1784044178.814317:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 101 00000100:00100000:0.0:1784044178.814325:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843ca9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+29:10854:x1870705565161344:12345-192.168.202.40@tcp:101:bash.0 00010000:00010000:0.0:1784044178.814344:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784044178.814361:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7800/0x89871fc3aba1869a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcd3dffad52ca675e expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044178.814426:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7800/0x89871fc3aba1869a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca675e expref: 30 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044178.814440:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7800/0x89871fc3aba1869a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca675e expref: 30 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044178.814456:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9b39758c1100) 00010000:00010000:0.0:1784044178.814459:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1784044178.814463:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b38410b7800, rc 0) 00000100:00100000:0.0:1784044178.814545:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843ca9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+30:10854:x1870705565161344:12345-192.168.202.40@tcp:101:bash.0 Request processed in 220us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044178.814551:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 101 00000100:00100000:3.0:1784044178.817943:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044178.818026:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565161472 00000100:00100000:2.0:1784044178.818034:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565161472 00000100:00100000:1.0:1784044178.818106:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 43 00000100:00100000:1.0:1784044178.818119:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39459b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+6:10854:x1870705565161472:12345-192.168.202.40@tcp:101:bash.0 00010000:00010000:1.0:1784044178.818137:0:8428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784044178.818161:0:8428:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005040606c/0x89871fc3aba186a1 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcd3dffad52ca6765 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784044178.818273:0:8428:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 9, mtime: 0x6a565a90, atime: 0x6a565a8f, ctime: 0x6a565a90, blocks: 0x8 00010000:00010000:1.0:1784044178.818299:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=371s v=(0 0) 00010000:00010000:1.0:1784044178.818305:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784044178.818316:0:8428:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005040606c/0x89871fc3aba186a1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6765 expref: 7 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044178.818337:0:8428:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005040606c/0x89871fc3aba186a1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6765 expref: 7 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044178.818352:0:8428:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b38426fc800, rc 0) 00000100:00100000:1.0:1784044178.818417:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39459b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+7:10854:x1870705565161472:12345-192.168.202.40@tcp:101:bash.0 Request processed in 302us (485us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044178.818426:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 43 00000100:00100000:1.0:1784044178.820394:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044178.820506:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565161600 00000100:00100000:0.0:1784044178.820516:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565161600 00002000:00010000:0.0:1784044178.820557:0:8431:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/3 (0->18446744073709551615) 00002000:00100000:0.0:1784044178.820562:0:8431:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b39759b4a80 with x1870705565161600 ext(0->18446744073709551615) 00002000:00010000:0.0:1784044178.820572:0:8431:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b39759b4a80. 00000100:00100000:0.0:1784044178.820608:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 1 00000100:00100000:0.0:1784044178.820630:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39759b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+7:2410:x1870705565161600:12345-192.168.202.40@tcp:10:bash.0 00002000:00010000:0.0:1784044178.820933:0:8431:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:0.0:1784044178.820936:0:8431:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1784044176 -> 1784044178 00002000:00010000:0.0:1784044178.820938:0:8431:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 1784044175 -> 1784044175 00002000:00010000:0.0:1784044178.820939:0:8431:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1784044176 -> 1784044178 00002000:00010000:0.0:1784044178.820941:0:8431:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:0.0:1784044178.820987:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39759b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+8:2410:x1870705565161600:12345-192.168.202.40@tcp:10:bash.0 Request processed in 371us (602us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1784044178.821006:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 1 00002000:00010000:0.0:1784044178.821010:0:8431:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/3 (0->18446744073709551615) 00002000:00100000:0.0:1784044178.821012:0:8431:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b39759b4a80 with x1870705565161600 ext(0->18446744073709551615) 00002000:00010000:0.0:1784044178.821016:0:8431:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b39759b4a80. 00000100:00100000:2.0:1784044178.876717:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044178.876840:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565161728 00000100:00100000:0.0:1784044178.876852:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565161728 00000100:00100000:0.0:1784044178.876924:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 102 00000100:00100000:0.0:1784044178.876947:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843ca9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+30:11341:x1870705565161728:12345-192.168.202.40@tcp:34:lfs.0 00010000:00010000:0.0:1784044178.877041:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6600/0x89871fc3aba186a8 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044178.877061:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6600/0x89871fc3aba186a8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044178.877077:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6600/0x89871fc3aba186a8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044178.877097:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7c00/0x89871fc3aba186af lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044178.877105:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7c00/0x89871fc3aba186af lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044178.877111:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7c00/0x89871fc3aba186af lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044178.877224:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7a00/0x89871fc3aba186b6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044178.877234:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7a00/0x89871fc3aba186b6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044178.877446:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7a00/0x89871fc3aba186b6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784044178.877497:0:6511:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7a00/0x89871fc3aba186b6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044178.877509:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6600/0x89871fc3aba186a8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044178.877515:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6600/0x89871fc3aba186a8 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044178.877521:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6600/0x89871fc3aba186a8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044178.877528:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38410b6600 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:0.0:1784044178.877533:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6600/0x89871fc3aba186a8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044178.877542:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6600/0x89871fc3aba186a8 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044178.877555:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9b397aa61900) 00010000:00010000:0.0:1784044178.877558:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784044178.877562:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6600/0x89871fc3aba186a8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044178.877568:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6600/0x89871fc3aba186a8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044178.877581:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7c00/0x89871fc3aba186af lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044178.877593:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7c00/0x89871fc3aba186af lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044178.877599:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7c00/0x89871fc3aba186af lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044178.877604:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38410b7c00 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:0.0:1784044178.877607:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7c00/0x89871fc3aba186af lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044178.877613:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7c00/0x89871fc3aba186af lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044178.877634:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9b39758c1b00) 00010000:00010000:0.0:1784044178.877636:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784044178.877639:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7c00/0x89871fc3aba186af lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044178.877645:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7c00/0x89871fc3aba186af lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044178.877658:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7a00/0x89871fc3aba186b6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044178.877664:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7a00/0x89871fc3aba186b6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044178.877669:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7a00/0x89871fc3aba186b6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044178.877674:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38410b7a00 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:0.0:1784044178.877683:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7a00/0x89871fc3aba186b6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044178.877689:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7a00/0x89871fc3aba186b6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044178.877697:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9b39758c1100) 00010000:00010000:0.0:1784044178.877699:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784044178.877702:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7a00/0x89871fc3aba186b6 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044178.877708:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7a00/0x89871fc3aba186b6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044178.877785:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843ca9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+30:11341:x1870705565161728:12345-192.168.202.40@tcp:34:lfs.0 Request processed in 850us (1084us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044178.877795:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 102 00000100:00100000:3.0:1784044178.936221:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044178.937963:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565161984 00000100:00100000:0.0:1784044178.937987:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565161984 00000100:00100000:0.0:1784044178.938094:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 103 00000100:00100000:0.0:1784044178.938106:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39459b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+30:11344:x1870705565161984:12345-192.168.202.40@tcp:101:lfs.0 00010000:00010000:0.0:1784044178.938128:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784044178.938151:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7a00/0x89871fc3aba186bd lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcd3dffad52ca676c expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044178.938278:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7c00/0x89871fc3aba186c4 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044178.938578:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7c00/0x89871fc3aba186c4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044178.938613:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7c00/0x89871fc3aba186c4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044178.938642:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6600/0x89871fc3aba186cb lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044178.938649:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6600/0x89871fc3aba186cb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044178.938655:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6600/0x89871fc3aba186cb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044178.938777:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6200/0x89871fc3aba186d2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044178.938787:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6200/0x89871fc3aba186d2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044178.938793:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6200/0x89871fc3aba186d2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784044178.938803:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:0.0:1784044178.938886:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7c00/0x89871fc3aba186c4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044178.938892:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7c00/0x89871fc3aba186c4 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044178.938897:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7c00/0x89871fc3aba186c4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044178.938901:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38410b7c00 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:0.0:1784044178.938909:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7c00/0x89871fc3aba186c4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044178.938914:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7c00/0x89871fc3aba186c4 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044178.938924:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9b397aa61900) 00010000:00010000:0.0:1784044178.938926:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784044178.938929:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7c00/0x89871fc3aba186c4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044178.938935:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7c00/0x89871fc3aba186c4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044178.938950:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6600/0x89871fc3aba186cb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044178.938956:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6600/0x89871fc3aba186cb lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044178.938961:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6600/0x89871fc3aba186cb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044178.938967:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38410b6600 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:0.0:1784044178.938970:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6600/0x89871fc3aba186cb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044178.938976:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6600/0x89871fc3aba186cb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044178.938983:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9b39758c1b00) 00010000:00010000:0.0:1784044178.938986:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784044178.938995:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6600/0x89871fc3aba186cb lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044178.939002:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6600/0x89871fc3aba186cb lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044178.939044:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7a00/0x89871fc3aba186bd lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca676c expref: 33 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044178.939055:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6200/0x89871fc3aba186d2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca676c expref: 32 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044178.939060:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9b39758c1100) 00010000:00010000:0.0:1784044178.939062:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1784044178.939063:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b38410b6200, rc 0) 00000100:00100000:0.0:1784044178.939697:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39459b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+32:11344:x1870705565161984:12345-192.168.202.40@tcp:101:lfs.0 Request processed in 1589us (3517us total) trans 4294967372 rc 0/0 00000100:00100000:0.0:1784044178.939706:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 103 00000100:00100000:1.0:1784044178.946789:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044178.950432:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565162112 00000100:00100000:0.0:1784044178.950449:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565162112 00000100:00100000:1.0:1784044178.950601:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 104 00000100:00100000:1.0:1784044178.950614:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843e0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+32:11344:x1870705565162112:12345-192.168.202.40@tcp:54:lfs.0 00010000:00010000:1.0:1784044178.950710:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fdc00/0x89871fc3aba186e0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044178.950727:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6800/0x89871fc3aba18677 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6750 expref: 32 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044178.950738:0:6513:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fdc00/0x89871fc3aba186e0 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044178.950774:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6800/0x89871fc3aba18677 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6750 expref: 32 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044178.950788:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6800/0x89871fc3aba18677 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6750 expref: 32 pid: 6513 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044178.950802:0:6513:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843e0dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6513:1870705580979328:192.168.202.40@tcp:104: 00000100:00100000:1.0:1784044178.950922:0:6513:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b397f923480 going to sleep for 11 seconds 00000100:00100000:1.0:1784044178.956551:0:6513:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843e0dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6513:1870705580979328:192.168.202.40@tcp:104: 00010000:00010000:1.0:1784044178.956599:0:6513:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fdc00/0x89871fc3aba186e0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044178.959930:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044178.960207:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565162368 00000100:00100000:0.0:1784044178.960218:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565162368 00000100:00100000:0.0:1784044178.960281:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 22 00000100:00100000:0.0:1784044178.960291:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843e0dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+33:6177:x1870705565162368:12345-192.168.202.40@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1784044178.960604:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843e0dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+34:6177:x1870705565162368:12345-192.168.202.40@tcp:35:ldlm_bl.0 Request processed in 313us (686us total) trans 4294967373 rc 0/0 00000100:00100000:0.0:1784044178.960612:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 22 00000100:00100000:2.0:1784044178.967378:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044178.967885:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565162496 00000100:00100000:0.0:1784044178.967918:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565162496 00010000:00010000:0.0:1784044178.967965:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6800/0x89871fc3aba18677 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6750 expref: 34 pid: 6513 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044178.968013:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 70 00000100:00100000:0.0:1784044178.968024:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397a8a7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+34:2410:x1870705565162496:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784044178.968043:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784044178.968051:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6800/0x89871fc3aba18677 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6750 expref: 34 pid: 6513 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044178.968066:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6800/0x89871fc3aba18677 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6750 expref: 34 pid: 6513 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044178.968533:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6800/0x89871fc3aba18677 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6750 expref: 34 pid: 6513 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044178.968555:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9b39758c1100) 00010000:00010000:0.0:1784044178.968560:0:6497:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fdc00/0x89871fc3aba186e0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044178.968570:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fdc00/0x89871fc3aba186e0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044178.968579:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fdc00/0x89871fc3aba186e0 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044178.969758:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784044178.969865:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397a8a7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+33:2410:x1870705565162496:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 1836us (2492us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044178.969877:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 70 00010000:00010000:0.0:1784044178.971797:0:6513:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fdc00/0x89871fc3aba186e0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044178.971816:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fdc00/0x89871fc3aba186e0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044178.971978:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fdc00/0x89871fc3aba186e0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044178.971998:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fdc00/0x89871fc3aba186e0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044178.972005:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fdc00/0x89871fc3aba186e0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044178.972011:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38426fdc00 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:1.0:1784044178.972015:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fdc00/0x89871fc3aba186e0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044178.972023:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fdc00/0x89871fc3aba186e0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044178.972042:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9b39758c1100) 00010000:00010000:1.0:1784044178.972046:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1784044178.972051:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fdc00/0x89871fc3aba186e0 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044178.972057:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fdc00/0x89871fc3aba186e0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044178.972316:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843e0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+32:11344:x1870705565162112:12345-192.168.202.40@tcp:54:lfs.0 Request processed in 21700us (25537us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044178.972326:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 104 00000100:00100000:2.0:1784044178.974495:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044178.974554:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565162752 00000100:00100000:0.0:1784044178.974563:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565162752 00000100:00100000:0.0:1784044178.974607:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 23 00000100:00100000:0.0:1784044178.974626:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39503bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+32:11344:x1870705565162752:12345-192.168.202.40@tcp:35:lfs.0 00000100:00100000:0.0:1784044178.974854:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39503bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+33:11344:x1870705565162752:12345-192.168.202.40@tcp:35:lfs.0 Request processed in 239us (367us total) trans 4294967374 rc 0/0 00000100:00100000:0.0:1784044178.974860:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 23 00000100:00100000:3.0:1784044179.070438:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044179.070599:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565163008 00000100:00100000:0.0:1784044179.070610:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565163008 00000100:00100000:0.0:1784044179.070689:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 105 00000100:00100000:0.0:1784044179.070700:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39459b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+33:11355:x1870705565163008:12345-192.168.202.40@tcp:101:cat.0 00010000:00010000:0.0:1784044179.070727:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784044179.070751:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6800/0x89871fc3aba186e7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcd3dffad52ca6773 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044179.070833:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7a00/0x89871fc3aba186ee lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044179.070849:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7a00/0x89871fc3aba186ee lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044179.070860:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7a00/0x89871fc3aba186ee lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044179.070875:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6600/0x89871fc3aba186f5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044179.070883:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6600/0x89871fc3aba186f5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044179.070905:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6600/0x89871fc3aba186f5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044179.071039:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7c00/0x89871fc3aba186fc lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044179.071048:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7c00/0x89871fc3aba186fc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044179.071056:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7c00/0x89871fc3aba186fc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784044179.071066:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 8 00010000:00010000:0.0:1784044179.071146:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7a00/0x89871fc3aba186ee lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044179.071154:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7a00/0x89871fc3aba186ee lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044179.071160:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7a00/0x89871fc3aba186ee lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044179.071167:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38410b7a00 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:0.0:1784044179.071171:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7a00/0x89871fc3aba186ee lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044179.071215:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7a00/0x89871fc3aba186ee lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044179.071226:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9b397aa61900) 00010000:00010000:0.0:1784044179.071230:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784044179.071241:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7a00/0x89871fc3aba186ee lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044179.071248:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7a00/0x89871fc3aba186ee lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044179.071262:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6600/0x89871fc3aba186f5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044179.071269:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6600/0x89871fc3aba186f5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044179.071274:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6600/0x89871fc3aba186f5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044179.071279:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38410b6600 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:0.0:1784044179.071282:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6600/0x89871fc3aba186f5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044179.071288:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6600/0x89871fc3aba186f5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044179.071295:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9b39758c1b00) 00010000:00010000:0.0:1784044179.071297:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784044179.071299:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6600/0x89871fc3aba186f5 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044179.071305:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6600/0x89871fc3aba186f5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044179.071343:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6800/0x89871fc3aba186e7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6773 expref: 36 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044179.071596:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7c00/0x89871fc3aba186fc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6773 expref: 35 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044179.071604:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9b39758c1100) 00010000:00010000:0.0:1784044179.071607:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784044179.071610:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b38410b7c00, rc 0) 00000100:00100000:0.0:1784044179.071797:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39459b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+35:11355:x1870705565163008:12345-192.168.202.40@tcp:101:cat.0 Request processed in 1099us (1372us total) trans 4294967375 rc 0/0 00000100:00100000:0.0:1784044179.071806:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 105 00010000:00010000:3.0:1784044179.086600:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784044179.093999:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044179.094097:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565163264 00000100:00100000:0.0:1784044179.094106:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565163264 00000100:00100000:0.0:1784044179.094152:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 24 00000100:00100000:0.0:1784044179.094162:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843e0ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+35:11355:x1870705565163264:12345-192.168.202.40@tcp:35:cat.0 00000100:00100000:0.0:1784044179.094741:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843e0ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+36:11355:x1870705565163264:12345-192.168.202.40@tcp:35:cat.0 Request processed in 578us (747us total) trans 4294967376 rc 0/0 00000100:00100000:0.0:1784044179.094749:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 24 00000100:00100000:2.0:1784044179.125777:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044179.125920:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565163520 00000100:00100000:0.0:1784044179.125929:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565163520 00000100:00100000:0.0:1784044179.125976:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 106 00000100:00100000:0.0:1784044179.125984:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397f9e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+36:11356:x1870705565163520:12345-192.168.202.40@tcp:36:rm.0 00010000:00010000:0.0:1784044179.126047:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:0.0:1784044179.126076:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7800/0x89871fc3aba1869a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca675e expref: 36 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044179.126098:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7c00/0x89871fc3aba186fc lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6773 expref: 35 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044179.126127:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6200/0x89871fc3aba186d2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca676c expref: 34 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044179.126139:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6000/0x89871fc3aba1868c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6757 expref: 33 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044179.126146:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9b39758c1100) 00010000:00010000:0.0:1784044179.126149:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784044179.126167:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6800/0x89871fc3aba1870a lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044179.126198:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6800/0x89871fc3aba1870a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044179.126206:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6800/0x89871fc3aba1870a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044179.126215:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6600/0x89871fc3aba18711 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044179.126221:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6600/0x89871fc3aba18711 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044179.126228:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6600/0x89871fc3aba18711 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044179.126315:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7a00/0x89871fc3aba18718 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044179.126325:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7a00/0x89871fc3aba18718 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044179.126339:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7a00/0x89871fc3aba18718 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1784044179.126552:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8472 00010000:00010000:0.0:1784044179.126591:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7000/0x89871fc3aba1871f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044179.126598:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7000/0x89871fc3aba1871f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044179.126602:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7000/0x89871fc3aba1871f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044179.126608:0:6512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7000/0x89871fc3aba1871f lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044179.126611:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7000/0x89871fc3aba1871f lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044179.126628:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7000/0x89871fc3aba1871f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044179.126644:0:6512:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784044179.126663:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7a00/0x89871fc3aba18718 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044179.126669:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7a00/0x89871fc3aba18718 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044179.126674:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7a00/0x89871fc3aba18718 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044179.126691:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38410b7a00 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:0.0:1784044179.126695:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7a00/0x89871fc3aba18718 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044179.126702:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7a00/0x89871fc3aba18718 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044179.126710:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9b39758c1100) 00010000:00010000:0.0:1784044179.126713:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1784044179.126716:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7a00/0x89871fc3aba18718 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044179.126722:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7a00/0x89871fc3aba18718 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044179.126737:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6800/0x89871fc3aba1870a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044179.126742:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6800/0x89871fc3aba1870a lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044179.126747:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6800/0x89871fc3aba1870a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044179.126751:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38410b6800 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:0.0:1784044179.126754:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6800/0x89871fc3aba1870a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044179.126759:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6800/0x89871fc3aba1870a lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044179.126777:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9b397aa61900) 00010000:00010000:0.0:1784044179.126779:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784044179.126782:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6800/0x89871fc3aba1870a lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044179.126793:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6800/0x89871fc3aba1870a lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784044179.126802:0:6512:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f883dda4 reply state 000000003f50a3df transno 4294967377 ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6600/0x89871fc3aba18711 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044179.126813:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6600/0x89871fc3aba18711 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044179.126823:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9b39758c1b00) 00010000:00010000:0.0:1784044179.126825:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1784044179.126827:0:6512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1784044179.126896:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397f9e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+34:11356:x1870705565163520:12345-192.168.202.40@tcp:36:rm.0 Request processed in 911us (1132us total) trans 4294967377 rc 0/0 00000100:00100000:0.0:1784044179.126904:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 106 00010000:00010000:3.0:1784044179.127582:0:10331:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784044179.127590:0:10331:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7000/0x89871fc3aba1871f lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044179.127597:0:10331:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38410b7000 already unused, calling callback (ffffffffc0b56230) 00010000:00010000:3.0:1784044179.127600:0:10331:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7000/0x89871fc3aba1871f lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044179.127607:0:10331:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7000/0x89871fc3aba1871f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044179.127629:0:10331:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9b39758c1100) 00010000:00010000:3.0:1784044179.127632:0:10331:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1784044179.127635:0:10331:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7000/0x89871fc3aba1871f lrc: 1/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044179.127649:0:10331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7000/0x89871fc3aba1871f lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044179.127660:0:10331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784044179.127661:0:10331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784044179.127663:0:10331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784044179.191919:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1784044179.192016:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565163776 00000100:00100000:1.0:1784044179.192028:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565163776 00000100:00100000:1.0:1784044179.192102:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 107 00000100:00100000:1.0:1784044179.192113:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3842705f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+34:11362:x1870705565163776:12345-192.168.202.40@tcp:101:bash.0 00010000:00010000:1.0:1784044179.192169:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784044179.192232:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fdc00/0x89871fc3aba18726 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcd3dffad52ca677a expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044179.192368:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd000/0x89871fc3aba1872d lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044179.192385:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd000/0x89871fc3aba1872d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044179.192397:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd000/0x89871fc3aba1872d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044179.192410:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc400/0x89871fc3aba18734 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044179.192416:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc400/0x89871fc3aba18734 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044179.192422:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc400/0x89871fc3aba18734 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1784044179.192765:0:6513:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x3:0x0], index 1: 0 00010000:00010000:1.0:1784044179.192911:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd400/0x89871fc3aba1873b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044179.192921:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd400/0x89871fc3aba1873b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044179.192929:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd400/0x89871fc3aba1873b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044179.192974:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd000/0x89871fc3aba1872d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044179.192981:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd000/0x89871fc3aba1872d lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044179.192988:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd000/0x89871fc3aba1872d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044179.192995:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38426fd000 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:1.0:1784044179.192999:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd000/0x89871fc3aba1872d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044179.193006:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd000/0x89871fc3aba1872d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044179.193018:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9b397aa61900) 00010000:00010000:1.0:1784044179.193021:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784044179.193026:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd000/0x89871fc3aba1872d lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044179.193032:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd000/0x89871fc3aba1872d lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784044179.193045:0:6513:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000e70a06ef reply state 000000006ae3a902 transno 4294967378 ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc400/0x89871fc3aba18734 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044179.193056:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc400/0x89871fc3aba18734 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044179.193062:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9b39758c1b00) 00010000:00010000:1.0:1784044179.193072:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784044179.193075:0:6513:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1784044179.193105:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fdc00/0x89871fc3aba18726 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca677a expref: 37 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044179.193119:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd400/0x89871fc3aba1873b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca677a expref: 36 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044179.193127:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9b3842777e00) 00010000:00010000:1.0:1784044179.193129:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784044179.193131:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b38426fd400, rc 0) 00000100:00100000:1.0:1784044179.193258:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3842705f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+37:11362:x1870705565163776:12345-192.168.202.40@tcp:101:bash.0 Request processed in 1146us (1349us total) trans 4294967378 rc 0/0 00000100:00100000:1.0:1784044179.193267:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 107 00000100:00100000:0.0:1784044179.199796:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044179.199898:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565163904 00000100:00100000:3.0:1784044179.199911:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565163904 00000100:00100000:3.0:1784044179.199980:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 44 00000100:00100000:3.0:1784044179.199990:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b384316c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+7:2409:x1870705565163904:12345-192.168.202.40@tcp:101:bash.0 00010000:00010000:3.0:1784044179.200011:0:8427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784044179.200032:0:8427:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009e35d841/0x89871fc3aba18749 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcd3dffad52ca6781 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784044179.200059:0:8427:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784044179.200081:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=372s v=(0 0) 00010000:00010000:3.0:1784044179.200086:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784044179.200096:0:8427:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009e35d841/0x89871fc3aba18749 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6781 expref: 8 pid: 8427 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044179.200116:0:8427:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009e35d841/0x89871fc3aba18749 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6781 expref: 8 pid: 8427 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044179.200130:0:8427:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b394166a400, rc 0) 00000100:00100000:3.0:1784044179.200226:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b384316c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+8:2409:x1870705565163904:12345-192.168.202.40@tcp:101:bash.0 Request processed in 237us (439us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044179.200249:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 44 00000100:00100000:0.0:1784044179.203717:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044179.203820:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565164032 00000100:00100000:2.0:1784044179.203830:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565164032 00000100:00100000:2.0:1784044179.203898:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 45 00000100:00100000:2.0:1784044179.203909:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3943eb2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+8:11362:x1870705565164032:12345-192.168.202.40@tcp:101:bash.0 00010000:00010000:2.0:1784044179.203929:0:8426:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784044179.203952:0:8426:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000068cd6ac/0x89871fc3aba18750 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcd3dffad52ca6788 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044179.203994:0:8426:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009e35d841/0x89871fc3aba18749 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6781 expref: 9 pid: 8427 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044179.204019:0:8426:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784044179.204024:0:8426:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784044179.204029:0:8426:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000068cd6ac/0x89871fc3aba18750 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6788 expref: 9 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044179.204064:0:8426:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009e35d841/0x89871fc3aba18749 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6781 expref: 9 pid: 8427 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044179.204078:0:8426:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009e35d841/0x89871fc3aba18749 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6781 expref: 9 pid: 8427 timeout: 472 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044179.204092:0:8426:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397f9e2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8426:1870705580979456:192.168.202.40@tcp:104: 00000100:00100000:2.0:1784044179.204310:0:8426:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b397b8d33c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784044179.208147:0:8426:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397f9e2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8426:1870705580979456:192.168.202.40@tcp:104: 00010000:00010000:2.0:1784044179.208832:0:8426:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000068cd6ac/0x89871fc3aba18750 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6788 expref: 9 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044179.208861:0:8426:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3843798a00, rc 0) 00000100:00100000:2.0:1784044179.208942:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3943eb2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+9:11362:x1870705565164032:12345-192.168.202.40@tcp:101:bash.0 Request processed in 5035us (5234us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044179.208952:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 45 00000100:00100000:3.0:1784044179.209635:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044179.209987:0:13182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565164160 00000100:00100000:2.0:1784044179.209994:0:13182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565164160 00010000:00010000:2.0:1784044179.210028:0:13182:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009e35d841/0x89871fc3aba18749 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6781 expref: 9 pid: 8427 timeout: 472 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044179.210070:0:13182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 71 00000100:00100000:2.0:1784044179.210076:0:13182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3842706a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a93fdf3c-d42f-420a-95ea-b0cbfe954363+9:2410:x1870705565164160:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784044179.210089:0:13182:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784044179.210108:0:13182:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009e35d841/0x89871fc3aba18749 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6781 expref: 9 pid: 8427 timeout: 472 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044179.210118:0:13182:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009e35d841/0x89871fc3aba18749 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6781 expref: 9 pid: 8427 timeout: 472 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044179.210139:0:13182:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009e35d841/0x89871fc3aba18749 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6781 expref: 9 pid: 8427 timeout: 472 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044179.210153:0:13182:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784044179.210158:0:13182:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784044179.210166:0:13182:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000068cd6ac/0x89871fc3aba18750 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6788 expref: 8 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044179.210242:0:13182:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000068cd6ac/0x89871fc3aba18750 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6788 expref: 8 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044179.210688:0:13182:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000068cd6ac/0x89871fc3aba18750 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6788 expref: 8 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044179.210705:0:13182:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397f9e2a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:13182:1870705580979584:192.168.202.40@tcp:105: 00000100:00100000:2.0:1784044179.210983:0:13182:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b397b8d33c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784044179.216022:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044179.216098:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565164416 00000100:00100000:0.0:1784044179.216107:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565164416 00000100:00100000:2.0:1784044179.216224:0:13182:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397f9e2a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:13182:1870705580979584:192.168.202.40@tcp:105: 00010000:00010000:2.0:1784044179.216248:0:13182:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784044179.216313:0:13182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3842706a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a93fdf3c-d42f-420a-95ea-b0cbfe954363+8:2410:x1870705565164160:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 6234us (6679us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044179.216322:0:13182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 71 00000100:00100000:0.0:1784044179.216380:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 25 00000100:00100000:0.0:1784044179.216390:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397aa57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+37:11362:x1870705565164416:12345-192.168.202.40@tcp:35:bash.0 00000100:00100000:0.0:1784044179.216678:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397aa57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+38:11362:x1870705565164416:12345-192.168.202.40@tcp:35:bash.0 Request processed in 288us (662us total) trans 4294967379 rc 0/0 00000100:00100000:0.0:1784044179.216705:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 25 00000100:00100000:3.0:1784044179.504581:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044179.504701:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565164544 00000100:00100000:0.0:1784044179.504713:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565164544 00000100:00100000:0.0:1784044179.504783:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 108 00000100:00100000:0.0:1784044179.504797:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397aa57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+38:11379:x1870705565164544:12345-192.168.202.40@tcp:101:lfs.0 00010000:00010000:0.0:1784044179.504829:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784044179.504855:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7c00/0x89871fc3aba18757 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcd3dffad52ca678f expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044179.504949:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7800/0x89871fc3aba1875e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044179.504965:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7800/0x89871fc3aba1875e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044179.504977:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7800/0x89871fc3aba1875e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784044179.505029:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:0.0:1784044179.505033:0:6511:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1784044179.505057:0:6511:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7800/0x89871fc3aba1875e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044179.505085:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7c00/0x89871fc3aba18757 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca678f expref: 40 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044179.505105:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7800/0x89871fc3aba1875e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca678f expref: 39 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044179.505137:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9b397aa61900) 00010000:00010000:0.0:1784044179.505141:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1784044179.505144:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b38410b7800, rc 0) 00000100:00100000:0.0:1784044179.505522:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397aa57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+39:11379:x1870705565164544:12345-192.168.202.40@tcp:101:lfs.0 Request processed in 727us (951us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044179.505530:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 108 00000100:00100000:3.0:1784044179.511128:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1784044179.511585:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565164800 00000100:00100000:1.0:1784044179.511595:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565164800 00000100:00100000:1.0:1784044179.511677:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 109 00000100:00100000:1.0:1784044179.511688:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397aa54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+39:11379:x1870705565164800:12345-192.168.202.40@tcp:101:lfs.0 00010000:00010000:1.0:1784044179.511714:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784044179.511739:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fdc00/0x89871fc3aba18765 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcd3dffad52ca6796 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044179.511858:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd000/0x89871fc3aba1876c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044179.511875:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd000/0x89871fc3aba1876c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044179.511887:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd000/0x89871fc3aba1876c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784044179.511926:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:1.0:1784044179.512044:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fdc00/0x89871fc3aba18765 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6796 expref: 42 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044179.512065:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd000/0x89871fc3aba1876c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6796 expref: 41 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044179.512086:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9b3842777e00) 00010000:00010000:1.0:1784044179.512088:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784044179.512092:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b38426fd000, rc 0) 00000100:00100000:1.0:1784044179.512163:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397aa54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+41:11379:x1870705565164800:12345-192.168.202.40@tcp:101:lfs.0 Request processed in 477us (1048us total) trans 4294967380 rc 0/0 00000100:00100000:1.0:1784044179.512171:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 109 00000100:00100000:3.0:1784044179.517241:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044179.517406:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565165184 00000100:00100000:2.0:1784044179.517420:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565165184 00000100:00100000:2.0:1784044179.517503:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 7 00000100:00100000:2.0:1784044179.517514:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397aa55500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+41:2410:x1870705565165184:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784044179.517532:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784044179.517560:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd000/0x89871fc3aba1876c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6796 expref: 41 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044179.517579:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9b3842777e00) 00010000:00010000:2.0:1784044179.517585:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784044179.517667:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397aa55500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+40:2410:x1870705565165184:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 155us (435us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044179.517676:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 7 00000100:00100000:3.0:1784044179.519435:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1784044179.519580:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565165056 00000100:00100000:1.0:1784044179.519588:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565165056 00000100:00100000:1.0:1784044179.519647:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 110 00000100:00100000:1.0:1784044179.519655:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397aa55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+40:11379:x1870705565165056:12345-192.168.202.40@tcp:101:lfs.0 00010000:00010000:1.0:1784044179.519678:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784044179.519697:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fda00/0x89871fc3aba1877a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcd3dffad52ca679d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044179.519808:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fde00/0x89871fc3aba18781 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044179.519823:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fde00/0x89871fc3aba18781 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044179.519851:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fde00/0x89871fc3aba18781 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784044179.519864:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:1.0:1784044179.519985:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fda00/0x89871fc3aba1877a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca679d expref: 43 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044179.520003:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fde00/0x89871fc3aba18781 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca679d expref: 42 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044179.520012:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9b3842777e00) 00010000:00010000:1.0:1784044179.520016:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1784044179.520019:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b38426fde00, rc 0) 00000100:00100000:1.0:1784044179.520083:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397aa55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+42:11379:x1870705565165056:12345-192.168.202.40@tcp:101:lfs.0 Request processed in 429us (657us total) trans 4294967381 rc 0/0 00000100:00100000:1.0:1784044179.520440:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 110 00000100:00100000:0.0:1784044179.534254:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843e0d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1870705580979712:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1784044179.534332:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1784044179.534673:0:8450:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 372705497452ns, next at 373705494585ns, rc = 0 00000100:00100000:2.0:1784044179.534697:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1784044179.534707:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397f9e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1870705580979968:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784044179.534741:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044179.534773:0:10713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580979712 00000100:00100000:2.0:1784044179.534781:0:10713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580979712 00000100:00100000:2.0:1784044179.534837:0:10713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580979968 00000100:00100000:2.0:1784044179.534856:0:10713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580979968 00000100:00100000:2.0:1784044179.534877:0:10713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1784044179.534885:0:10713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3943eb1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1870705580979712:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1784044179.534908:0:10713:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923529728 avail 3691978752 00000100:00100000:2.0:1784044179.534954:0:10713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3943eb1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1870705580979712:12345-0@lo:13:osp-pre-0-1.0 Request processed in 69us (622us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044179.534962:0:10713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1784044179.534979:0:10713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1784044179.534985:0:10713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397f9e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3639:x1870705580979968:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1784044179.534995:0:10713:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923529728 avail 3691978752 00000100:00100000:2.0:1784044179.535024:0:10713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397f9e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3639:x1870705580979968:12345-0@lo:13:osp-pre-0-0.0 Request processed in 39us (282us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044179.535031:0:10713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1784044179.535095:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397f9e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1870705580979968:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784044179.535588:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d46680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1870705580979840:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1784044179.535641:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1784044179.535683:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784044179.535782:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044179.535881:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843e0d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1870705580979712:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1784044179.535986:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565165312 00000100:00100000:3.0:1784044179.535992:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565165312 00000100:00100000:3.0:1784044179.536035:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 46 00000100:00100000:3.0:1784044179.536042:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843caf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+8:2407:x1870705565165312:12345-192.168.202.40@tcp:1:lfs.0 00010000:00010000:3.0:1784044179.536089:0:8427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009e35d841/0x89871fc3aba1878f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044179.536110:0:8427:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000068cd6ac/0x89871fc3aba18750 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6788 expref: 8 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044179.536119:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784044179.536124:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1784044179.536129:0:8427:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009e35d841/0x89871fc3aba1878f lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044179.536162:0:8427:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000068cd6ac/0x89871fc3aba18750 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6788 expref: 8 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044179.536427:0:8427:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000068cd6ac/0x89871fc3aba18750 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6788 expref: 8 pid: 8426 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044179.536437:0:8427:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b38435eca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8427:1870705580980096:192.168.202.40@tcp:104: 00000100:00100000:2.0:1784044179.536547:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580979840 00000100:00100000:2.0:1784044179.536552:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580979840 00000100:00100000:2.0:1784044179.536583:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1784044179.536590:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3975b88380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1870705580979840:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1784044179.536626:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1784044179.536668:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3975b88380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1870705580979840:12345-0@lo:41:osp-pre-1-0.0 Request processed in 79us (1027us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044179.536673:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1784044179.536712:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d46680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1870705580979840:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1784044179.536771:0:8427:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b38436173c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784044179.539520:0:8427:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b38435eca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8427:1870705580980096:192.168.202.40@tcp:104: 00010000:00010000:3.0:1784044179.539554:0:8427:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000009e35d841/0x89871fc3aba1878f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044179.542382:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044179.543782:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565165440 00000100:00100000:2.0:1784044179.543794:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565165440 00002000:00100000:2.0:1784044179.543923:0:8433:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff9b3843cae300 x1870705565165440/t0(0) o4->a93fdf3c-d42f-420a-95ea-b0cbfe954363@192.168.202.40@tcp:330/0 lens 504/0 e 0 to 0 dl 1784044190 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784044179.543949:0:8433:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b3843cae300 with x1870705565165440 ext(0->8) 00010000:00010000:2.0:1784044179.543960:0:8433:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000068cd6ac/0x89871fc3aba18750 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6788 expref: 9 pid: 8426 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044179.543983:0:8433:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000068cd6ac/0x89871fc3aba18750 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6788 expref: 9 pid: 8426 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784044179.543993:0:8433:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9b3843cae300 00000100:00100000:2.0:1784044179.544112:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 1 00000100:00100000:2.0:1784044179.544124:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843cae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+9:2409:x1870705565165440:12345-192.168.202.40@tcp:4:lfs.0 00000100:00100000:2.0:1784044179.546291:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843cae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+11:2409:x1870705565165440:12345-192.168.202.40@tcp:4:lfs.0 Request processed in 2158us (3907us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1784044179.546305:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 1 00002000:00100000:2.0:1784044179.546317:0:8433:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff9b3843cae300 x1870705565165440/t4294967303(0) o4->a93fdf3c-d42f-420a-95ea-b0cbfe954363@192.168.202.40@tcp:330/0 lens 504/448 e 0 to 0 dl 1784044190 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784044179.546327:0:8433:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b3843cae300 with x1870705565165440 ext(0->8) 00010000:00010000:2.0:1784044179.546338:0:8433:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000068cd6ac/0x89871fc3aba18750 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6788 expref: 11 pid: 8426 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044179.546357:0:8433:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000068cd6ac/0x89871fc3aba18750 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6788 expref: 11 pid: 8426 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784044179.546365:0:8433:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9b3843cae300 00000100:00100000:0.0:1784044179.549663:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044179.549844:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565165568 00000100:00100000:3.0:1784044179.549909:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565165568 00010000:00010000:3.0:1784044179.549956:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000068cd6ac/0x89871fc3aba18750 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6788 expref: 11 pid: 8426 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044179.550048:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 72 00000100:00100000:3.0:1784044179.550059:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3943eb3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+11:2408:x1870705565165568:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784044179.550089:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1784044179.550112:0:6498:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1784044179.550115:0:6498:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1784044178 00002000:00010000:3.0:1784044179.550117:0:6498:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb atime from disk: 0 -> 1784044179 00002000:00010000:3.0:1784044179.550119:0:6498:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb ctime from disk: 0 -> 1784044178 00002000:00010000:3.0:1784044179.550121:0:6498:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1784044179.550128:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000068cd6ac/0x89871fc3aba18750 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6788 expref: 11 pid: 8426 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044179.550167:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000068cd6ac/0x89871fc3aba18750 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6788 expref: 11 pid: 8426 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044179.550221:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000068cd6ac/0x89871fc3aba18750 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6788 expref: 11 pid: 8426 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044179.550240:0:6498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1784044179.550244:0:6498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1784044179.550250:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009e35d841/0x89871fc3aba1878f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044179.550260:0:6498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009e35d841/0x89871fc3aba1878f lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044179.550288:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784044179.550439:0:8427:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000009e35d841/0x89871fc3aba1878f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044179.550450:0:8427:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009e35d841/0x89871fc3aba1878f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044179.550471:0:8427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009e35d841/0x89871fc3aba1878f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044179.550479:0:8427:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009e35d841/0x89871fc3aba1878f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044179.550486:0:8427:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009e35d841/0x89871fc3aba1878f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044179.550505:0:8427:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b394166a400 already unused, calling callback (ffffffffc0b56230) 00010000:00010000:0.0:1784044179.550509:0:8427:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009e35d841/0x89871fc3aba1878f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044179.550517:0:8427:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009e35d841/0x89871fc3aba1878f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044179.550529:0:8427:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009e35d841/0x89871fc3aba1878f lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044179.550537:0:8427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009e35d841/0x89871fc3aba1878f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044179.550580:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843caf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+10:2407:x1870705565165312:12345-192.168.202.40@tcp:1:lfs.0 Request processed in 14539us (14801us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044179.550587:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 46 00000100:00100000:3.0:1784044179.550671:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3943eb3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+10:2408:x1870705565165568:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 289us (699us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044179.550679:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 72 00000100:00100000:1.0:1784044179.556515:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044179.556597:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565165824 00000100:00100000:0.0:1784044179.556606:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565165824 00000100:00100000:0.0:1784044179.556700:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 26 00000100:00100000:0.0:1784044179.556708:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3974224050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+42:11379:x1870705565165824:12345-192.168.202.40@tcp:35:lfs.0 00000004:00010000:0.0:1784044179.556775:0:6515:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fde00/0x89871fc3aba18781 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca679d expref: 42 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1784044179.557021:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00000001:00080000:0.0:1784044179.557051:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:0.0:1784044179.557469:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00010000:00010000:0.0:1784044179.557505:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7a00/0x89871fc3aba18796 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044179.557519:0:6515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd400/0x89871fc3aba1873b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca677a expref: 46 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044179.557527:0:6515:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7a00/0x89871fc3aba18796 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044179.557574:0:6515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd400/0x89871fc3aba1873b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca677a expref: 46 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044179.557588:0:6515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd400/0x89871fc3aba1873b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca677a expref: 46 pid: 6513 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044179.557601:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3943eb1880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6515:1870705580980224:192.168.202.40@tcp:104: 00000100:00100000:0.0:1784044179.557698:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b384341b000 going to sleep for 11 seconds 00000100:00100000:1.0:1784044179.560954:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044179.561074:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565165952 00000100:00100000:2.0:1784044179.561096:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565165952 00010000:00010000:2.0:1784044179.561141:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd400/0x89871fc3aba1873b lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca677a expref: 47 pid: 6513 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044179.561204:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 73 00000100:00100000:2.0:1784044179.561215:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843cadc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+47:2410:x1870705565165952:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784044179.561233:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784044179.561240:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd400/0x89871fc3aba1873b lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca677a expref: 47 pid: 6513 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044179.561254:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd400/0x89871fc3aba1873b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca677a expref: 47 pid: 6513 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044179.561278:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9b3842777e00) 00010000:00010000:2.0:1784044179.561467:0:6496:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7a00/0x89871fc3aba18796 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044179.561477:0:6496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7a00/0x89871fc3aba18796 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044179.561482:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7a00/0x89871fc3aba18796 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044179.561503:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784044179.561581:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843cadc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+47:2410:x1870705565165952:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 368us (637us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044179.561586:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 73 00010000:00010000:0.0:1784044179.561791:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd400/0x89871fc3aba1873b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca677a expref: 46 pid: 6513 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044179.561808:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3943eb1880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6515:1870705580980224:192.168.202.40@tcp:104: 00010000:00010000:0.0:1784044179.561830:0:6515:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7a00/0x89871fc3aba18796 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044179.561839:0:6515:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7a00/0x89871fc3aba18796 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044179.561845:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7a00/0x89871fc3aba18796 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1784044179.561968:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000001:00080000:0.0:1784044179.562072:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00000100:00100000:0.0:1784044179.562168:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3943eb1880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6515:1870705580980352:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1784044179.562249:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044179.562273:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b384341bd80 going to sleep for 11 seconds 00000100:00100000:3.0:1784044179.562428:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580980352 00000100:00100000:3.0:1784044179.562432:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580980352 00000100:00100000:3.0:1784044179.562473:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1784044179.562479:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843e0d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:6515:x1870705580980352:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1784044179.562549:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843e0d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:6515:x1870705580980352:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 70us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044179.562553:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00080000:0.0:1784044179.562741:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784044179.562770:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3943eb1880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6515:1870705580980352:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1784044179.562876:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00000100:00100000:0.0:1784044179.562917:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3943eb1880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6515:1870705580980480:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1784044179.562945:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044179.563230:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b384341bcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1784044179.564149:0:7768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580980480 00000100:00100000:2.0:1784044179.564156:0:7768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580980480 00000100:00100000:2.0:1784044179.564242:0:7768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1784044179.564251:0:7768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397f9dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:6515:x1870705580980480:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1784044179.564417:0:7768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397f9dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+8:6515:x1870705580980480:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 168us (1471us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1784044179.564423:0:7768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1784044179.564677:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3943eb1880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6515:1870705580980480:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1784044179.564733:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967388 00010000:00010000:0.0:1784044179.564773:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7a00/0x89871fc3aba18796 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044179.564783:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7a00/0x89871fc3aba18796 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044179.564790:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7a00/0x89871fc3aba18796 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044179.564797:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38410b7a00 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:0.0:1784044179.564802:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7a00/0x89871fc3aba18796 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044179.564809:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7a00/0x89871fc3aba18796 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044179.564831:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9b3842777e00) 00010000:00010000:0.0:1784044179.564834:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1784044179.564839:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7a00/0x89871fc3aba18796 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044179.564846:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7a00/0x89871fc3aba18796 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1784044179.564948:0:6515:0:(mdd_object.c:4016:mdd_close()) Object [0x200000402:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1784044179.565020:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 64 off8384 00000004:00080000:0.0:1784044179.565032:0:6515:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 372735856854ns, next at 373735854552ns, rc = 0 00000001:00080000:0.0:1784044179.565040:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967389 00010000:00010000:0.0:1784044179.565062:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9b3842777e00) 00010000:00010000:0.0:1784044179.565065:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1784044179.565073:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fde00/0x89871fc3aba18781 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca679d expref: 50 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044179.565251:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3974224050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+49:11379:x1870705565165824:12345-192.168.202.40@tcp:35:lfs.0 Request processed in 8543us (8745us total) trans 4294967390 rc 0/0 00000100:00100000:0.0:1784044179.565260:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 26 00000020:00080000:0.0:1784044179.565264:0:6515:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1784044179.568986:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044179.569088:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565166080 00000100:00100000:0.0:1784044179.569097:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565166080 00000100:00100000:0.0:1784044179.569226:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 111 00000100:00100000:0.0:1784044179.569237:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39412e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+49:11379:x1870705565166080:12345-192.168.202.40@tcp:101:lfs.0 00010000:00010000:0.0:1784044179.569272:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784044179.569297:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6800/0x89871fc3aba1879d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcd3dffad52ca67a4 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044179.569396:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6800/0x89871fc3aba1879d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca67a4 expref: 50 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044179.569411:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6800/0x89871fc3aba1879d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca67a4 expref: 50 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044179.569428:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9b39758c1600) 00010000:00010000:0.0:1784044179.569432:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1784044179.569435:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b38410b6800, rc 0) 00000100:00100000:0.0:1784044179.569495:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39412e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+50:11379:x1870705565166080:12345-192.168.202.40@tcp:101:lfs.0 Request processed in 260us (518us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044179.569501:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 111 00000100:00100000:3.0:1784044179.573166:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044179.573236:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565166336 00000100:00100000:2.0:1784044179.573245:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565166336 00000100:00100000:2.0:1784044179.573676:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 27 00000100:00100000:2.0:1784044179.573690:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38435eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+50:11379:x1870705565166336:12345-192.168.202.40@tcp:35:lfs.0 00000100:00100000:2.0:1784044179.573996:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38435eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+51:11379:x1870705565166336:12345-192.168.202.40@tcp:35:lfs.0 Request processed in 309us (837us total) trans 4294967391 rc 0/0 00000100:00100000:2.0:1784044179.574005:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 27 00000100:00100000:3.0:1784044179.671305:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044179.671513:0:13808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565166464 00000100:00100000:2.0:1784044179.671523:0:13808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565166464 00000100:00100000:2.0:1784044179.671590:0:13808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 112 00000100:00100000:2.0:1784044179.671601:0:13808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843c54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a93fdf3c-d42f-420a-95ea-b0cbfe954363+51:11389:x1870705565166464:12345-192.168.202.40@tcp:34:lfs.0 00010000:00010000:2.0:1784044179.671693:0:13808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799400/0x89871fc3aba187a4 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044179.671710:0:13808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799400/0x89871fc3aba187a4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044179.671722:0:13808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799400/0x89871fc3aba187a4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044179.671733:0:13808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799a00/0x89871fc3aba187ab lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044179.671760:0:13808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799a00/0x89871fc3aba187ab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044179.671767:0:13808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799a00/0x89871fc3aba187ab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044179.671838:0:13808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799c00/0x89871fc3aba187b2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044179.671844:0:13808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799c00/0x89871fc3aba187b2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044179.671848:0:13808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799c00/0x89871fc3aba187b2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784044179.671886:0:13808:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799c00/0x89871fc3aba187b2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044179.671895:0:13808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799400/0x89871fc3aba187a4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044179.671899:0:13808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799400/0x89871fc3aba187a4 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044179.671904:0:13808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799400/0x89871fc3aba187a4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044179.671907:0:13808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3843799400 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:2.0:1784044179.671910:0:13808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799400/0x89871fc3aba187a4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044179.671915:0:13808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799400/0x89871fc3aba187a4 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044179.671929:0:13808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9b397aa61900) 00010000:00010000:2.0:1784044179.671931:0:13808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784044179.671933:0:13808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799400/0x89871fc3aba187a4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044179.671937:0:13808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799400/0x89871fc3aba187a4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044179.671946:0:13808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799a00/0x89871fc3aba187ab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044179.671950:0:13808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799a00/0x89871fc3aba187ab lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044179.671953:0:13808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799a00/0x89871fc3aba187ab lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044179.671956:0:13808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3843799a00 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:2.0:1784044179.671958:0:13808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799a00/0x89871fc3aba187ab lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044179.672075:0:13808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799a00/0x89871fc3aba187ab lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044179.672080:0:13808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9b39758c1b00) 00010000:00010000:2.0:1784044179.672082:0:13808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784044179.672084:0:13808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799a00/0x89871fc3aba187ab lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044179.672088:0:13808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799a00/0x89871fc3aba187ab lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044179.672102:0:13808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799c00/0x89871fc3aba187b2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044179.672106:0:13808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799c00/0x89871fc3aba187b2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044179.672109:0:13808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799c00/0x89871fc3aba187b2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044179.672112:0:13808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3843799c00 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:2.0:1784044179.672114:0:13808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799c00/0x89871fc3aba187b2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044179.672117:0:13808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799c00/0x89871fc3aba187b2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044179.672121:0:13808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9b39758c1600) 00010000:00010000:2.0:1784044179.672122:0:13808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784044179.672123:0:13808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799c00/0x89871fc3aba187b2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044179.672126:0:13808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799c00/0x89871fc3aba187b2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044179.672257:0:13808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843c54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a93fdf3c-d42f-420a-95ea-b0cbfe954363+51:11389:x1870705565166464:12345-192.168.202.40@tcp:34:lfs.0 Request processed in 658us (972us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044179.672263:0:13808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 112 00000100:00100000:1.0:1784044179.709332:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044179.709503:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565166720 00000100:00100000:2.0:1784044179.709515:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565166720 00000100:00100000:2.0:1784044179.709586:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 113 00000100:00100000:2.0:1784044179.709641:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39412eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+51:11392:x1870705565166720:12345-192.168.202.40@tcp:101:lfs.0 00010000:00010000:2.0:1784044179.709672:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784044179.709698:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799c00/0x89871fc3aba187b9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcd3dffad52ca67ab expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044179.709781:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799a00/0x89871fc3aba187c0 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044179.709798:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799a00/0x89871fc3aba187c0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044179.709808:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799a00/0x89871fc3aba187c0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044179.709818:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799400/0x89871fc3aba187c7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044179.709825:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799400/0x89871fc3aba187c7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044179.709831:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799400/0x89871fc3aba187c7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044179.709952:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799000/0x89871fc3aba187ce lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044179.709961:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799000/0x89871fc3aba187ce lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044179.709968:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799000/0x89871fc3aba187ce lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784044179.709990:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:2.0:1784044179.710085:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799a00/0x89871fc3aba187c0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044179.710094:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799a00/0x89871fc3aba187c0 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044179.710101:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799a00/0x89871fc3aba187c0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044179.710108:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3843799a00 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:2.0:1784044179.710112:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799a00/0x89871fc3aba187c0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044179.710122:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799a00/0x89871fc3aba187c0 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044179.710136:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9b397aa61900) 00010000:00010000:2.0:1784044179.710139:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784044179.710144:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799a00/0x89871fc3aba187c0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044179.710150:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799a00/0x89871fc3aba187c0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044179.710165:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799400/0x89871fc3aba187c7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044179.710171:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799400/0x89871fc3aba187c7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044179.710258:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799400/0x89871fc3aba187c7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044179.710264:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3843799400 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:2.0:1784044179.710267:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799400/0x89871fc3aba187c7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044179.710274:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799400/0x89871fc3aba187c7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044179.710283:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9b39758c1b00) 00010000:00010000:2.0:1784044179.710286:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784044179.710289:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799400/0x89871fc3aba187c7 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044179.710294:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799400/0x89871fc3aba187c7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044179.710342:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799c00/0x89871fc3aba187b9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca67ab expref: 54 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044179.710356:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799000/0x89871fc3aba187ce lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca67ab expref: 53 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044179.710364:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9b39758c1600) 00010000:00010000:2.0:1784044179.710366:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784044179.710369:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3843799000, rc 0) 00000100:00100000:2.0:1784044179.710428:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39412eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+53:11392:x1870705565166720:12345-192.168.202.40@tcp:101:lfs.0 Request processed in 818us (1106us total) trans 4294967392 rc 0/0 00000100:00100000:2.0:1784044179.710444:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 113 00000100:00100000:3.0:1784044179.716637:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044179.716749:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565166848 00000100:00100000:0.0:1784044179.716761:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565166848 00000100:00100000:0.0:1784044179.716833:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 114 00000100:00100000:0.0:1784044179.716843:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843c54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+53:11392:x1870705565166848:12345-192.168.202.40@tcp:54:lfs.0 00010000:00010000:0.0:1784044179.716943:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7e00/0x89871fc3aba187dc lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044179.716963:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7e00/0x89871fc3aba187dc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044179.716979:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7e00/0x89871fc3aba187dc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044179.717030:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7e00/0x89871fc3aba187dc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044179.717058:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7e00/0x89871fc3aba187dc lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044179.717066:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7e00/0x89871fc3aba187dc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044179.717072:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38410b7e00 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:0.0:1784044179.717077:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7e00/0x89871fc3aba187dc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044179.717085:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7e00/0x89871fc3aba187dc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044179.717100:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9b39758c1600) 00010000:00010000:0.0:1784044179.717103:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1784044179.717109:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7e00/0x89871fc3aba187dc lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044179.717115:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7e00/0x89871fc3aba187dc lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044179.717493:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843c54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+53:11392:x1870705565166848:12345-192.168.202.40@tcp:54:lfs.0 Request processed in 649us (864us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044179.717502:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 114 00000100:00100000:0.0:1784044179.730716:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044179.731330:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565167104 00000100:00100000:2.0:1784044179.731343:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565167104 00000100:00100000:2.0:1784044179.731422:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 28 00000100:00100000:2.0:1784044179.731432:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39503bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+53:11392:x1870705565167104:12345-192.168.202.40@tcp:35:lfs.0 00000100:00100000:2.0:1784044179.731715:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39503bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+54:11392:x1870705565167104:12345-192.168.202.40@tcp:35:lfs.0 Request processed in 283us (1010us total) trans 4294967393 rc 0/0 00000100:00100000:2.0:1784044179.731724:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 28 00000100:00100000:1.0:1784044179.828816:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044179.828932:0:13808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565167360 00000100:00100000:2.0:1784044179.828943:0:13808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565167360 00000100:00100000:2.0:1784044179.829013:0:13808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 115 00000100:00100000:2.0:1784044179.829025:0:13808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39412ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a93fdf3c-d42f-420a-95ea-b0cbfe954363+54:11402:x1870705565167360:12345-192.168.202.40@tcp:101:bash.0 00010000:00010000:2.0:1784044179.829053:0:13808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784044179.829057:0:13808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1784044179.829089:0:13808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7800/0x89871fc3aba1875e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca678f expref: 54 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044179.829111:0:13808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9b397aa61900) 00010000:00010000:2.0:1784044179.829116:0:13808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784044179.829130:0:13808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799c00/0x89871fc3aba187e3 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcd3dffad52ca67b2 expref: -99 pid: 13808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044179.829329:0:13808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799400/0x89871fc3aba187ea lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044179.829343:0:13808:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799000/0x89871fc3aba187ce lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca67ab expref: 54 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044179.829521:0:13808:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799400/0x89871fc3aba187ea lrc: 4/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044179.829555:0:13808:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799000/0x89871fc3aba187ce lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca67ab expref: 54 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044179.829569:0:13808:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799000/0x89871fc3aba187ce lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca67ab expref: 54 pid: 6513 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044179.829584:0:13808:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397f9e2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13808:1870705580980608:192.168.202.40@tcp:104: 00000100:00100000:2.0:1784044179.829685:0:13808:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b397b8d36c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784044179.835484:0:13808:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397f9e2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13808:1870705580980608:192.168.202.40@tcp:104: 00010000:00010000:2.0:1784044179.835515:0:13808:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799400/0x89871fc3aba187ea lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044179.836643:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044179.836729:0:13182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565167488 00000100:00100000:2.0:1784044179.836738:0:13182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565167488 00010000:00010000:2.0:1784044179.836779:0:13182:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799000/0x89871fc3aba187ce lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca67ab expref: 55 pid: 6513 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044179.836827:0:13182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 74 00000100:00100000:2.0:1784044179.836836:0:13182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39412ea300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a93fdf3c-d42f-420a-95ea-b0cbfe954363+55:2410:x1870705565167488:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784044179.836858:0:13182:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784044179.836865:0:13182:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799000/0x89871fc3aba187ce lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca67ab expref: 55 pid: 6513 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044179.836899:0:13182:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799000/0x89871fc3aba187ce lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca67ab expref: 55 pid: 6513 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044179.836927:0:13182:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799000/0x89871fc3aba187ce lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca67ab expref: 55 pid: 6513 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044179.836946:0:13182:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9b39758c1600) 00010000:00010000:2.0:1784044179.836950:0:13182:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799400/0x89871fc3aba187ea lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044179.836959:0:13182:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799400/0x89871fc3aba187ea lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044179.836968:0:13182:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799400/0x89871fc3aba187ea lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044179.837002:0:13182:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784044179.837062:0:13182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39412ea300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a93fdf3c-d42f-420a-95ea-b0cbfe954363+54:2410:x1870705565167488:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 226us (425us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044179.837078:0:13182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 74 00010000:00010000:0.0:1784044179.837766:0:13808:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799400/0x89871fc3aba187ea lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044179.837777:0:13808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799400/0x89871fc3aba187ea lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784044179.837808:0:13808:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:0.0:1784044179.837943:0:13808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799c00/0x89871fc3aba187e3 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca67b2 expref: 55 pid: 13808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044179.837962:0:13808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799400/0x89871fc3aba187ea lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca67b2 expref: 54 pid: 13808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044179.837972:0:13808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9b39758c1600) 00010000:00010000:0.0:1784044179.837974:0:13808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1784044179.837977:0:13808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3843799400, rc 0) 00000100:00100000:0.0:1784044179.838021:0:13808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39412ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a93fdf3c-d42f-420a-95ea-b0cbfe954363+54:11402:x1870705565167360:12345-192.168.202.40@tcp:101:bash.0 Request processed in 8997us (9215us total) trans 4294967394 rc 0/0 00000100:00100000:0.0:1784044179.838029:0:13808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 115 00000100:00100000:1.0:1784044179.854029:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044179.854127:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565167616 00000100:00100000:3.0:1784044179.854139:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565167616 00000100:00100000:3.0:1784044179.854219:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 116 00000100:00100000:3.0:1784044179.854231:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39412ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+54:11402:x1870705565167616:12345-192.168.202.40@tcp:101:bash.0 00010000:00010000:3.0:1784044179.854256:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784044179.854278:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166b600/0x89871fc3aba187f8 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcd3dffad52ca67b9 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044179.854313:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166b800/0x89871fc3aba187ff lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044179.854328:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166b800/0x89871fc3aba187ff lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044179.854340:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166b800/0x89871fc3aba187ff lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044179.854481:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166b600/0x89871fc3aba187f8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca67b9 expref: 56 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044179.854500:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166b800/0x89871fc3aba187ff lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca67b9 expref: 55 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044179.854510:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9b39758c1600) 00010000:00010000:3.0:1784044179.854513:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1784044179.854517:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b394166b800, rc 0) 00000100:00100000:3.0:1784044179.854596:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39412ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+55:11402:x1870705565167616:12345-192.168.202.40@tcp:101:bash.0 Request processed in 368us (580us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044179.854604:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 116 00000100:00100000:0.0:1784044179.857932:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044179.858047:0:9501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565167872 00000100:00100000:2.0:1784044179.858057:0:9501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565167872 00000100:00100000:2.0:1784044179.858125:0:9501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 117 00000100:00100000:2.0:1784044179.858135:0:9501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843e0dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a93fdf3c-d42f-420a-95ea-b0cbfe954363+55:11402:x1870705565167872:12345-192.168.202.40@tcp:36:bash.0 00010000:00010000:2.0:1784044179.858403:0:9501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799000/0x89871fc3aba18806 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044179.858421:0:9501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799000/0x89871fc3aba18806 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044179.858446:0:9501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799000/0x89871fc3aba18806 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1784044179.858494:0:9501:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967395 00000004:00010000:2.0:1784044179.858522:0:9501:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000000772fd3b reply state 00000000a5947204 transno 4294967396 ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799000/0x89871fc3aba18806 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044179.858535:0:9501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799000/0x89871fc3aba18806 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044179.858544:0:9501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9b39758c1600) 00010000:00010000:2.0:1784044179.858547:0:9501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1784044179.858551:0:9501:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1784044179.858660:0:9501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843e0dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a93fdf3c-d42f-420a-95ea-b0cbfe954363+58:11402:x1870705565167872:12345-192.168.202.40@tcp:36:bash.0 Request processed in 526us (743us total) trans 4294967396 rc 0/0 00000100:00100000:2.0:1784044179.858668:0:9501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 117 00000020:00080000:2.0:1784044179.858674:0:9501:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1784044179.861664:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044179.861767:0:13808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565168000 00000100:00100000:0.0:1784044179.861777:0:13808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565168000 00000100:00100000:0.0:1784044179.861877:0:13808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 118 00000100:00100000:0.0:1784044179.861891:0:13808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39412e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a93fdf3c-d42f-420a-95ea-b0cbfe954363+58:11402:x1870705565168000:12345-192.168.202.40@tcp:101:bash.0 00010000:00010000:0.0:1784044179.861923:0:13808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784044179.861948:0:13808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7000/0x89871fc3aba1880d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcd3dffad52ca67c0 expref: -99 pid: 13808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044179.862105:0:13808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7800/0x89871fc3aba18814 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044179.862121:0:13808:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799400/0x89871fc3aba187ea lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca67b2 expref: 59 pid: 13808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044179.862142:0:13808:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7800/0x89871fc3aba18814 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044179.862220:0:13808:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799400/0x89871fc3aba187ea lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca67b2 expref: 59 pid: 13808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044179.862234:0:13808:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799400/0x89871fc3aba187ea lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca67b2 expref: 59 pid: 13808 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044179.862250:0:13808:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843e0ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13808:1870705580980736:192.168.202.40@tcp:104: 00000100:00100000:0.0:1784044179.862338:0:13808:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b384341bb40 going to sleep for 11 seconds 00000100:00100000:2.0:1784044179.865659:0:13808:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843e0ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13808:1870705580980736:192.168.202.40@tcp:104: 00010000:00010000:2.0:1784044179.865691:0:13808:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7800/0x89871fc3aba18814 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044179.867723:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044179.867972:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565168128 00000100:00100000:2.0:1784044179.867982:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565168128 00010000:00010000:2.0:1784044179.868029:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799400/0x89871fc3aba187ea lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca67b2 expref: 60 pid: 13808 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044179.868081:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 75 00000100:00100000:2.0:1784044179.868091:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3944091c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+60:2409:x1870705565168128:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784044179.868117:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784044179.868126:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799400/0x89871fc3aba187ea lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca67b2 expref: 60 pid: 13808 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044179.868141:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799400/0x89871fc3aba187ea lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca67b2 expref: 60 pid: 13808 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044179.868168:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799400/0x89871fc3aba187ea lrc: 0/0,0 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca67b2 expref: 60 pid: 13808 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044179.868234:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9b39758c1600) 00010000:00010000:2.0:1784044179.868239:0:6497:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7800/0x89871fc3aba18814 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044179.868250:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7800/0x89871fc3aba18814 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044179.868259:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7800/0x89871fc3aba18814 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044179.868286:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784044179.868341:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3944091c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+59:2409:x1870705565168128:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 251us (629us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044179.868359:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 75 00010000:00010000:1.0:1784044179.868717:0:13808:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7800/0x89871fc3aba18814 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044179.868726:0:13808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7800/0x89871fc3aba18814 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784044179.868786:0:13808:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:1.0:1784044179.868792:0:13808:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1784044179.868820:0:13808:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7800/0x89871fc3aba18814 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044179.868857:0:13808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7000/0x89871fc3aba1880d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca67c0 expref: 59 pid: 13808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044179.868873:0:13808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7800/0x89871fc3aba18814 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca67c0 expref: 58 pid: 13808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044179.868881:0:13808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9b39758c1600) 00010000:00010000:1.0:1784044179.868884:0:13808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784044179.868887:0:13808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b38410b7800, rc 0) 00000100:00100000:1.0:1784044179.868931:0:13808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39412e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a93fdf3c-d42f-420a-95ea-b0cbfe954363+58:11402:x1870705565168000:12345-192.168.202.40@tcp:101:bash.0 Request processed in 7046us (7279us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044179.868939:0:13808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 118 00000100:00100000:1.0:1784044179.874642:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044179.875075:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565168384 00000100:00100000:2.0:1784044179.875088:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565168384 00000100:00100000:2.0:1784044179.875212:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 29 00000100:00100000:2.0:1784044179.875226:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39412e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+58:11402:x1870705565168384:12345-192.168.202.40@tcp:35:bash.0 00000100:00100000:2.0:1784044179.875509:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39412e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+59:11402:x1870705565168384:12345-192.168.202.40@tcp:35:bash.0 Request processed in 285us (899us total) trans 4294967397 rc 0/0 00000100:00100000:2.0:1784044179.875517:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 29 00000100:00100000:2.0:1784044179.945675:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044179.945785:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565168512 00000100:00100000:0.0:1784044179.945795:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565168512 00000100:00100000:0.0:1784044179.945855:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 119 00000100:00100000:0.0:1784044179.945866:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397f9e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+59:11408:x1870705565168512:12345-192.168.202.40@tcp:101:lfs.0 00010000:00010000:0.0:1784044179.945891:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784044179.945914:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7e00/0x89871fc3aba1881b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcd3dffad52ca67c7 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044179.945994:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7a00/0x89871fc3aba18822 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044179.946007:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7a00/0x89871fc3aba18822 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044179.946016:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7a00/0x89871fc3aba18822 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784044179.946080:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:0.0:1784044179.946085:0:6511:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1784044179.946112:0:6511:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7a00/0x89871fc3aba18822 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044179.946137:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7e00/0x89871fc3aba1881b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca67c7 expref: 61 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044179.946157:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7a00/0x89871fc3aba18822 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca67c7 expref: 60 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044179.946166:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9b397aa61900) 00010000:00010000:0.0:1784044179.946168:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1784044179.946231:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b38410b7a00, rc 0) 00000100:00100000:0.0:1784044179.946309:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397f9e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+60:11408:x1870705565168512:12345-192.168.202.40@tcp:101:lfs.0 Request processed in 444us (643us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044179.946316:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 119 00000100:00100000:3.0:1784044179.951356:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1784044179.951616:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565168640 00000100:00100000:1.0:1784044179.951625:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565168640 00000100:00100000:1.0:1784044179.951684:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 120 00000100:00100000:1.0:1784044179.951695:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843c56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+60:11408:x1870705565168640:12345-192.168.202.40@tcp:101:lfs.0 00010000:00010000:1.0:1784044179.951716:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784044179.951756:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc200/0x89871fc3aba18829 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcd3dffad52ca67ce expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044179.951826:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fcc00/0x89871fc3aba18830 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044179.951841:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fcc00/0x89871fc3aba18830 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044179.951851:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fcc00/0x89871fc3aba18830 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044179.951862:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc600/0x89871fc3aba18837 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044179.951869:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc600/0x89871fc3aba18837 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044179.951875:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc600/0x89871fc3aba18837 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044179.951945:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc000/0x89871fc3aba1883e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044179.951954:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc000/0x89871fc3aba1883e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044179.951974:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc000/0x89871fc3aba1883e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784044179.952017:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:1.0:1784044179.952021:0:6513:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1784044179.952039:0:6513:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc000/0x89871fc3aba1883e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044179.952057:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc000/0x89871fc3aba1883e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044179.952065:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fcc00/0x89871fc3aba18830 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044179.952072:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fcc00/0x89871fc3aba18830 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044179.952079:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fcc00/0x89871fc3aba18830 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044179.952085:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38426fcc00 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:1.0:1784044179.952090:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fcc00/0x89871fc3aba18830 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044179.952098:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fcc00/0x89871fc3aba18830 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044179.952111:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9b397aa61900) 00010000:00010000:1.0:1784044179.952114:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784044179.952118:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fcc00/0x89871fc3aba18830 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044179.952124:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fcc00/0x89871fc3aba18830 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044179.952137:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc600/0x89871fc3aba18837 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044179.952143:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc600/0x89871fc3aba18837 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044179.952157:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc600/0x89871fc3aba18837 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044179.952162:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38426fc600 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:1.0:1784044179.952165:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc600/0x89871fc3aba18837 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044179.952171:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc600/0x89871fc3aba18837 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044179.952232:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9b39758c1b00) 00010000:00010000:1.0:1784044179.952235:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784044179.952238:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc600/0x89871fc3aba18837 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044179.952243:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc600/0x89871fc3aba18837 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044179.952270:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc200/0x89871fc3aba18829 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca67ce expref: 62 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044179.952284:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc000/0x89871fc3aba1883e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca67ce expref: 61 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044179.952291:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9b39758c1600) 00010000:00010000:1.0:1784044179.952293:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784044179.952296:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b38426fc000, rc 0) 00000100:00100000:1.0:1784044179.952362:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843c56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+61:11408:x1870705565168640:12345-192.168.202.40@tcp:101:lfs.0 Request processed in 669us (1025us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044179.952378:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 120 00000100:00100000:1.0:1784044179.962787:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044179.962846:0:13808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565168896 00000100:00100000:3.0:1784044179.962858:0:13808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565168896 00000100:00100000:3.0:1784044179.962922:0:13808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 121 00000100:00100000:3.0:1784044179.962932:0:13808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39412e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a93fdf3c-d42f-420a-95ea-b0cbfe954363+61:11408:x1870705565168896:12345-192.168.202.40@tcp:101:lfs.0 00010000:00010000:3.0:1784044179.962959:0:13808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784044179.963245:0:13808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166b600/0x89871fc3aba18845 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcd3dffad52ca67d5 expref: -99 pid: 13808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044179.963384:0:13808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166bc00/0x89871fc3aba1884c lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044179.963400:0:13808:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7800/0x89871fc3aba18814 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca67c0 expref: 62 pid: 13808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044179.963409:0:13808:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc000/0x89871fc3aba1883e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca67ce expref: 62 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044179.963417:0:13808:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166bc00/0x89871fc3aba1884c lrc: 5/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044179.963449:0:13808:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc000/0x89871fc3aba1883e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca67ce expref: 62 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044179.963463:0:13808:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc000/0x89871fc3aba1883e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca67ce expref: 62 pid: 6513 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044179.963495:0:13808:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843c55500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13808:1870705580980864:192.168.202.40@tcp:104: 00010000:00010000:3.0:1784044179.963706:0:13808:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7800/0x89871fc3aba18814 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca67c0 expref: 62 pid: 13808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044179.963716:0:13808:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7800/0x89871fc3aba18814 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca67c0 expref: 62 pid: 13808 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044179.963726:0:13808:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843c55180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13808:1870705580980992:192.168.202.40@tcp:104: 00000100:00100000:3.0:1784044179.963752:0:13808:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b38436173c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784044179.965555:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044179.965663:0:13182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565169024 00000100:00100000:0.0:1784044179.965671:0:13182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565169024 00010000:00010000:0.0:1784044179.965713:0:13182:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc000/0x89871fc3aba1883e lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca67ce expref: 63 pid: 6513 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044179.965805:0:13182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 76 00000100:00100000:0.0:1784044179.965815:0:13182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397a8a7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a93fdf3c-d42f-420a-95ea-b0cbfe954363+63:2407:x1870705565169024:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784044179.965830:0:13182:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784044179.965837:0:13182:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc000/0x89871fc3aba1883e lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca67ce expref: 63 pid: 6513 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044179.965868:0:13182:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc000/0x89871fc3aba1883e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca67ce expref: 63 pid: 6513 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044179.965892:0:13182:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9b39758c1600) 00010000:00010000:0.0:1784044179.965898:0:13182:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166bc00/0x89871fc3aba1884c lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044179.965908:0:13182:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166bc00/0x89871fc3aba1884c lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044179.965914:0:13182:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784044179.965980:0:13182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397a8a7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a93fdf3c-d42f-420a-95ea-b0cbfe954363+63:2407:x1870705565169024:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 165us (430us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044179.965988:0:13182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 76 00000100:00100000:2.0:1784044179.970659:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1784044179.970746:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565169152 00000100:00100000:1.0:1784044179.970755:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565169152 00010000:00010000:1.0:1784044179.970797:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7800/0x89871fc3aba18814 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca67c0 expref: 63 pid: 13808 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044179.970840:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 77 00000100:00100000:1.0:1784044179.970850:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3842706a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+63:2410:x1870705565169152:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784044179.970864:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784044179.970872:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7800/0x89871fc3aba18814 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca67c0 expref: 63 pid: 13808 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044179.970886:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7800/0x89871fc3aba18814 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca67c0 expref: 63 pid: 13808 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044179.970910:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9b39758c1600) 00010000:00010000:1.0:1784044179.970916:0:6497:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166bc00/0x89871fc3aba1884c lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044179.970926:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166bc00/0x89871fc3aba1884c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044179.970933:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166bc00/0x89871fc3aba1884c lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044179.970954:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784044179.971010:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3842706a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+63:2410:x1870705565169152:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 161us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044179.971031:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 77 00010000:00010000:3.0:1784044179.972015:0:13808:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.202.40@tcp) returned -22 from blocking AST (req@00000000d9c85a27 x1870705580980864) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc000/0x89871fc3aba1883e lrc: 1/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca67ce expref: 62 pid: 6513 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044179.972034:0:13808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc000/0x89871fc3aba1883e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca67ce expref: 62 pid: 6513 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044179.972052:0:13808:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843c55500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13808:1870705580980864:192.168.202.40@tcp:104: 00010000:00010000:3.0:1784044179.972125:0:13808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7800/0x89871fc3aba18814 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca67c0 expref: 61 pid: 13808 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044179.972140:0:13808:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843c55180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13808:1870705580980992:192.168.202.40@tcp:104: 00010000:00010000:3.0:1784044179.972160:0:13808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9b39758c1600) 00010000:00010000:3.0:1784044179.972168:0:13808:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166bc00/0x89871fc3aba1884c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044179.972476:0:13808:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166bc00/0x89871fc3aba1884c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044179.972482:0:13808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166bc00/0x89871fc3aba1884c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784044179.972504:0:13808:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:3.0:1784044179.972674:0:13808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166b600/0x89871fc3aba18845 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca67d5 expref: 62 pid: 13808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044179.972690:0:13808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166bc00/0x89871fc3aba1884c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca67d5 expref: 61 pid: 13808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044179.972698:0:13808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9b39758c1600) 00010000:00010000:3.0:1784044179.972701:0:13808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1784044179.972703:0:13808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b394166bc00, rc 0) 00000100:00100000:3.0:1784044179.972770:0:13808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39412e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a93fdf3c-d42f-420a-95ea-b0cbfe954363+61:11408:x1870705565168896:12345-192.168.202.40@tcp:101:lfs.0 Request processed in 9839us (9991us total) trans 4294967398 rc 0/0 00000100:00100000:3.0:1784044179.972778:0:13808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 121 00000100:00100000:2.0:1784044179.977539:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044179.977645:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565169408 00000100:00100000:3.0:1784044179.977662:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565169408 00000100:00100000:3.0:1784044179.977751:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 8 00000100:00100000:3.0:1784044179.977764:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3943eb3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+61:11408:x1870705565169408:12345-192.168.202.40@tcp:103:lfs.0 00010000:00010000:3.0:1784044179.977785:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784044179.977821:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6800/0x89871fc3aba1879d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca67a4 expref: 61 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044179.977867:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9b39758c1600) 00010000:00010000:3.0:1784044179.977872:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784044179.977935:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3943eb3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+60:11408:x1870705565169408:12345-192.168.202.40@tcp:103:lfs.0 Request processed in 174us (412us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044179.977943:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 8 00000100:00100000:0.0:1784044179.981496:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044179.981616:0:9501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565169536 00000100:00100000:2.0:1784044179.981626:0:9501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565169536 00000100:00100000:2.0:1784044179.981699:0:9501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 122 00000100:00100000:2.0:1784044179.981711:0:9501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843e0ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a93fdf3c-d42f-420a-95ea-b0cbfe954363+60:11408:x1870705565169536:12345-192.168.202.40@tcp:58:lfs.0 00010000:00010000:2.0:1784044179.981829:0:9501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798600/0x89871fc3aba1885a lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044179.981849:0:9501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798600/0x89871fc3aba1885a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044179.981863:0:9501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798600/0x89871fc3aba1885a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1784044179.981968:0:9501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:2.0:1784044179.982058:0:9501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843e0ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a93fdf3c-d42f-420a-95ea-b0cbfe954363+60:11408:x1870705565169536:12345-192.168.202.40@tcp:58:lfs.0 Request processed in 349us (574us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044179.982066:0:9501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 122 00000100:00100000:2.0:1784044179.986376:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1784044179.986503:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565169664 00000100:00100000:1.0:1784044179.986527:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565169664 00000100:00100000:1.0:1784044179.986636:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 123 00000100:00100000:1.0:1784044179.986647:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843cadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+60:11408:x1870705565169664:12345-192.168.202.40@tcp:101:lfs.0 00010000:00010000:1.0:1784044179.986684:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784044179.986776:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc600/0x89871fc3aba18861 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcd3dffad52ca67dc expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044179.986921:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798600/0x89871fc3aba1885a lrc: 2/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044179.986946:0:6513:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc600/0x89871fc3aba18861 lrc: 4/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca67dc expref: 61 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044179.987004:0:6513:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798600/0x89871fc3aba1885a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044179.987061:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc600/0x89871fc3aba18861 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca67dc expref: 61 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044179.987088:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9b39758c1600) 00010000:00010000:1.0:1784044179.987092:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1784044179.987097:0:6513:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc600/0x89871fc3aba18861 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca67dc expref: 61 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044179.987105:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b38426fc600, rc 0) 00000100:00100000:1.0:1784044179.987325:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843cadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+61:11408:x1870705565169664:12345-192.168.202.40@tcp:101:lfs.0 Request processed in 679us (958us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044179.987334:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 123 00010000:00010000:2.0:1784044180.111052:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1784044180.557545:0:13763:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1784044180.557555:0:13763:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1784044180.557610:0:13763:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:2.0:1784044180.557620:0:13763:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1784044180.557760:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784044180.557786:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843c55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1870705580981120:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784044180.557850:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044180.557935:0:10713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580981120 00000100:00100000:3.0:1784044180.557942:0:10713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580981120 00000100:00100000:3.0:1784044180.557999:0:10713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1784044180.558008:0:10713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843c55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3638:x1870705580981120:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1784044180.558032:0:10713:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25591488 pending 57344 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784044180.558089:0:10713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843c55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3638:x1870705580981120:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044180.558096:0:10713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1784044180.558140:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843c55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1870705580981120:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784044180.558298:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784044180.558308:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397aa55500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1870705580981248:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1784044180.558338:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044180.558395:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580981248 00000100:00100000:0.0:1784044180.558400:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580981248 00000100:00100000:0.0:1784044180.558432:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1784044180.558439:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397aa57800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1870705580981248:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1784044180.558449:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25591488 pending 57344 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784044180.558485:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397aa57800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1870705580981248:12345-0@lo:13:osp-pre-1-1.0 Request processed in 46us (146us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044180.558491:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00080000:0.0:1784044180.558514:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784044180.558536:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397aa55500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1870705580981248:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1784044180.559226:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1870705580981632:0@lo:400:kworker.0 00000100:00100000:3.0:1784044180.559260:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044180.559272:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843c55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:3641:1870705580981376:0@lo:400:kworker.0 00000100:00100000:0.0:1784044180.559306:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044180.559334:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1870705580981888:0@lo:400:kworker.0 00000100:00100000:3.0:1784044180.559342:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1870705580982144:0@lo:400:kworker.0 00000100:00100000:0.0:1784044180.559356:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044180.559364:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044180.559374:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3641:1870705580982400:0@lo:400:kworker.0 00000100:00100000:2.0:1784044180.559381:0:13763:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d46680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13763:1870705580982784:192.168.202.40@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1784044180.559439:0:13763:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b397b8d3000 going to sleep for 11 seconds 00000100:00100000:2.0:1784044180.559475:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1870705580981504:0@lo:400:kworker.0 00000100:00100000:1.0:1784044180.559643:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580982144 00000100:00100000:1.0:1784044180.559648:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580982144 00000100:00100000:1.0:1784044180.559703:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1784044180.559711:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d4df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3639:x1870705580982144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784044180.560080:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044180.560108:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1784044180.560116:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3641:1870705580981760:0@lo:400:kworker.0 00000100:00100000:2.0:1784044180.560130:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044180.560154:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580981376 00000100:00100000:0.0:1784044180.560160:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580981376 00000100:00100000:2.0:1784044180.560170:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1870705580982016:0@lo:400:kworker.0 00000100:00100000:2.0:1784044180.560228:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044180.560250:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3638:1870705580982528:0@lo:400:kworker.0 00000100:00100000:0.0:1784044180.560373:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 411 00000100:00100000:0.0:1784044180.560381:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3950375850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+24:3641:x1870705580981376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044180.560448:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3639:1870705580982656:0@lo:400:kworker.0 00000100:00100000:3.0:1784044180.560474:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044180.560517:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580981632 00000100:00100000:0.0:1784044180.560520:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3950375850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+24:3641:x1870705580981376:12345-0@lo:400:kworker.0 Request processed in 141us (1213us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044180.560521:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580981632 00000100:00100000:0.0:1784044180.560527:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 411 00000100:00100000:3.0:1784044180.560543:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580981888 00000100:00100000:3.0:1784044180.560545:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580981888 00000100:00100000:0.0:1784044180.560555:0:9822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580982016 00000100:00100000:0.0:1784044180.560557:0:9822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580982016 00000100:00100000:3.0:1784044180.560558:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1784044180.560563:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1870705580981632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784044180.560576:0:9822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1784044180.560582:0:9822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843ce7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3638:x1870705580982016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044180.560599:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1870705580981632:12345-0@lo:400:kworker.0 Request processed in 35us (1339us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044180.560619:0:9822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843ce7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3638:x1870705580982016:12345-0@lo:400:kworker.0 Request processed in 37us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044180.560626:0:9822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1784044180.560645:0:7768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1784044180.560651:0:7768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397aa55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1870705580981888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784044180.560687:0:7768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397aa55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1870705580981888:12345-0@lo:400:kworker.0 Request processed in 37us (1330us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044180.560693:0:7768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1784044180.560707:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1784044180.560712:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044180.560731:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3641:1870705580982272:0@lo:400:kworker.0 00000100:00100000:3.0:1784044180.560739:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1870705580981632:0@lo:400:kworker.0 00000100:00100000:0.0:1784044180.560750:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044180.560759:0:13808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580982400 00000100:00100000:3.0:1784044180.560762:0:13808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580982400 00000100:00100000:0.0:1784044180.560769:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843c55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:3641:1870705580981376:0@lo:400:kworker.0 00000100:00100000:0.0:1784044180.560779:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1870705580981888:0@lo:400:kworker.0 00000100:00100000:2.0:1784044180.560801:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044180.560808:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580981504 00000100:00100000:0.0:1784044180.560813:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580981504 00000100:00100000:2.0:1784044180.560835:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1870705580982016:0@lo:400:kworker.0 00000100:00100000:0.0:1784044180.560836:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580982656 00000100:00100000:0.0:1784044180.560841:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580982656 00000100:00100000:3.0:1784044180.560907:0:13808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580981760 00000100:00100000:3.0:1784044180.560913:0:13808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580981760 00000100:00100000:1.0:1784044180.560922:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d4df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3639:x1870705580982144:12345-0@lo:400:kworker.0 Request processed in 1212us (1556us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044180.560929:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1784044180.560931:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1870705580982144:0@lo:400:kworker.0 00000100:00100000:0.0:1784044180.561088:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580982272 00000100:00100000:0.0:1784044180.561092:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580982272 00000100:00100000:0.0:1784044180.561111:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580982528 00000100:00100000:0.0:1784044180.561113:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580982528 00000100:00100000:0.0:1784044180.561153:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 315 00000100:00100000:3.0:1784044180.561159:0:13808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 316 00000100:00100000:0.0:1784044180.561160:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843ce7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1870705580981504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044180.561165:0:13808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1870705580982400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044180.561219:0:13808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1870705580982400:12345-0@lo:400:kworker.0 Request processed in 53us (1139us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044180.561769:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843ce7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1870705580981504:12345-0@lo:400:kworker.0 Request processed in 608us (1639us total) trans 0 rc 0/0 00000100:00080000:1.0:1784044180.561954:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1784044180.561958:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1784044180.561960:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784044180.564079:0:9501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 317 00000100:00100000:3.0:1784044180.564117:0:13808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 316 00000100:00100000:0.0:1784044180.564141:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 315 00000100:00100000:1.0:1784044180.564162:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 318 00000100:00100000:0.0:1784044180.564388:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1870705580981504:0@lo:400:kworker.0 00000100:00100000:0.0:1784044180.564544:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 319 00000100:00100000:0.0:1784044180.564555:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1870705580982272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784044180.564638:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1870705580982272:12345-0@lo:400:kworker.0 Request processed in 87us (3886us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044180.564660:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 319 00000100:00100000:0.0:1784044180.564673:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 320 00000100:00100000:0.0:1784044180.564679:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843ce4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1870705580982528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784044180.564720:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843ce4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1870705580982528:12345-0@lo:400:kworker.0 Request processed in 41us (3920us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044180.564726:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 320 00000100:00100000:0.0:1784044180.564752:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3638:1870705580982528:0@lo:400:kworker.0 00000100:00100000:0.0:1784044180.564803:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1870705580981760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784044180.564837:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1870705580981760:12345-0@lo:400:kworker.0 Request processed in 668us (4123us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044180.564965:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 318 00000100:00100000:0.0:1784044180.565033:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3641:1870705580981760:0@lo:400:kworker.0 00000100:00100000:2.0:1784044180.565047:0:9501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1870705580982656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784044180.565048:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3641:1870705580982272:0@lo:400:kworker.0 00010000:00080000:0.0:1784044180.565072:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b3843d4ce00 x1870705580982400/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044196 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784044180.565083:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3641:1870705580982400:0@lo:400:kworker.0 00000100:00100000:2.0:1784044180.565111:0:9501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1870705580982656:12345-0@lo:400:kworker.0 Request processed in 72us (4635us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044180.565121:0:9501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 317 00010000:00080000:0.0:1784044180.565132:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b3843d4e300 x1870705580982656/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044196 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784044180.565143:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3639:1870705580982656:0@lo:400:kworker.0 00000001:00080000:0.0:1784044180.565817:0:9505:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967304 is committed 00000001:00080000:0.0:1784044180.565827:0:9505:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000100:00100000:2.0:1784044180.576690:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1784044180.576727:0:13763:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d46680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13763:1870705580982784:192.168.202.40@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1784044180.576944:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565169792 00000100:00100000:0.0:1784044180.576965:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565169792 00000100:00100000:0.0:1784044180.577057:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 124 00000100:00100000:0.0:1784044180.577080:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843ce4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+61:11409:x1870705565169792:12345-192.168.202.40@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1784044180.577115:0:6511:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1784044180.577261:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843ce4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+61:11409:x1870705565169792:12345-192.168.202.40@tcp:53:lhsmtool_posix.0 Request processed in 184us (580us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044180.577269:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 124 00000100:00080000:1.0:1784044180.577456:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784044180.588299:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044180.588422:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565169920 00000100:00100000:3.0:1784044180.588432:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565169920 00000100:00100000:3.0:1784044180.588491:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 125 00000100:00100000:3.0:1784044180.588502:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+61:11409:x1870705565169920:12345-192.168.202.40@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1784044180.588573:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166b600/0x89871fc3aba18868 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044180.588590:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166b600/0x89871fc3aba18868 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044180.588653:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166b600/0x89871fc3aba18868 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044180.588800:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166ae00/0x89871fc3aba1886f lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044180.588809:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166ae00/0x89871fc3aba1886f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044180.588816:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166ae00/0x89871fc3aba1886f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044180.588841:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166aa00/0x89871fc3aba18876 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044180.588850:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166aa00/0x89871fc3aba18876 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044180.588856:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166aa00/0x89871fc3aba18876 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784044180.588904:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:3.0:1784044180.588910:0:6512:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1784044180.588923:0:6512:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166aa00/0x89871fc3aba18876 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044180.588933:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166b600/0x89871fc3aba18868 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044180.588939:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166b600/0x89871fc3aba18868 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044180.588955:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166b600/0x89871fc3aba18868 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044180.588960:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b394166b600 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:3.0:1784044180.588963:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166b600/0x89871fc3aba18868 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044180.588970:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166b600/0x89871fc3aba18868 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044180.588982:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9b396f2a8900) 00010000:00010000:3.0:1784044180.588985:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784044180.588990:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166b600/0x89871fc3aba18868 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044180.588996:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166b600/0x89871fc3aba18868 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044180.589009:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166ae00/0x89871fc3aba1886f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044180.589014:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166ae00/0x89871fc3aba1886f lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044180.589019:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166ae00/0x89871fc3aba1886f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044180.589023:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b394166ae00 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:3.0:1784044180.589025:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166ae00/0x89871fc3aba1886f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044180.589038:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166ae00/0x89871fc3aba1886f lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044180.589045:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x444bc3cd (ffff9b397aa61700) 00010000:00010000:3.0:1784044180.589047:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784044180.589050:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166ae00/0x89871fc3aba1886f lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044180.589056:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166ae00/0x89871fc3aba1886f lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044180.589071:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166aa00/0x89871fc3aba18876 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044180.589077:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166aa00/0x89871fc3aba18876 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044180.589082:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166aa00/0x89871fc3aba18876 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044180.589087:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b394166aa00 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:3.0:1784044180.589090:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166aa00/0x89871fc3aba18876 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044180.589096:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166aa00/0x89871fc3aba18876 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044180.589103:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9b39758c1600) 00010000:00010000:3.0:1784044180.589105:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784044180.589108:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166aa00/0x89871fc3aba18876 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044180.589125:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166aa00/0x89871fc3aba18876 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044180.589288:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+61:11409:x1870705565169920:12345-192.168.202.40@tcp:34:lhsmtool_posix.0 Request processed in 787us (999us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044180.589297:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 125 00000100:00100000:2.0:1784044180.592562:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044180.592657:0:13808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565170176 00000100:00100000:3.0:1784044180.592721:0:13808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565170176 00000100:00100000:3.0:1784044180.592814:0:13808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 126 00000100:00100000:3.0:1784044180.592824:0:13808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a93fdf3c-d42f-420a-95ea-b0cbfe954363+61:11409:x1870705565170176:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1784044180.592847:0:13808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784044180.592870:0:13808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166ac00/0x89871fc3aba1887d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcd3dffad52ca67e3 expref: -99 pid: 13808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044180.592980:0:13808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166a400/0x89871fc3aba18884 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044180.592996:0:13808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166a400/0x89871fc3aba18884 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044180.593008:0:13808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166a400/0x89871fc3aba18884 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784044180.593020:0:13808:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:3.0:1784044180.593117:0:13808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166a400/0x89871fc3aba18884 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044180.593125:0:13808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166a400/0x89871fc3aba18884 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044180.593149:0:13808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166a400/0x89871fc3aba18884 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044180.593155:0:13808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b394166a400 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:3.0:1784044180.593159:0:13808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166a400/0x89871fc3aba18884 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044180.593167:0:13808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166a400/0x89871fc3aba18884 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044180.593224:0:13808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9b39758c1600) 00010000:00010000:3.0:1784044180.593227:0:13808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1784044180.593232:0:13808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166a400/0x89871fc3aba18884 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044180.593239:0:13808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166a400/0x89871fc3aba18884 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044180.593282:0:13808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166ac00/0x89871fc3aba1887d lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca67e3 expref: 63 pid: 13808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044180.593293:0:13808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9b396f2a8900) 00010000:00010000:3.0:1784044180.593295:0:13808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1784044180.593299:0:13808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166ac00/0x89871fc3aba1887d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca67e3 expref: 63 pid: 13808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044180.593308:0:13808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b394166ac00, rc 0) 00000100:00100000:3.0:1784044180.593366:0:13808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a93fdf3c-d42f-420a-95ea-b0cbfe954363+62:11409:x1870705565170176:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 Request processed in 543us (813us total) trans 4294967399 rc 301/301 00000100:00100000:3.0:1784044180.593382:0:13808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 126 00000100:00100000:2.0:1784044180.599215:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044180.599563:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565170304 00000100:00100000:0.0:1784044180.599573:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565170304 00000100:00100000:0.0:1784044180.599655:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 127 00000100:00100000:0.0:1784044180.599665:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397bbbe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+62:11409:x1870705565170304:12345-192.168.202.40@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1784044180.599723:0:6511:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1784044180.599863:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397bbbe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+62:11409:x1870705565170304:12345-192.168.202.40@tcp:53:lhsmtool_posix.0 Request processed in 199us (704us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044180.599872:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 127 00000100:00100000:0.0:1784044180.606056:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044180.606152:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565170560 00000100:00100000:3.0:1784044180.606162:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565170560 00000100:00100000:2.0:1784044180.606319:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 128 00000100:00100000:2.0:1784044180.606333:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+62:11409:x1870705565170560:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1784044180.606355:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784044180.606358:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1784044180.606386:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7a00/0x89871fc3aba18822 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca67c7 expref: 62 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044180.606432:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9b397aa61900) 00010000:00010000:2.0:1784044180.606437:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784044180.606451:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799e00/0x89871fc3aba18892 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcd3dffad52ca67ea expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1784044180.606881:0:6513:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x4:0x0], index 0: 0 00010000:00010000:2.0:1784044180.608548:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798000/0x89871fc3aba18899 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044180.608571:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798000/0x89871fc3aba18899 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044180.608582:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798000/0x89871fc3aba18899 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044180.609081:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799e00/0x89871fc3aba18892 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca67ea expref: 64 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044180.609102:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798000/0x89871fc3aba18899 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca67ea expref: 63 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044180.609111:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9b39494f7a00) 00010000:00010000:2.0:1784044180.609114:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784044180.609117:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3843798000, rc 0) 00000100:00100000:2.0:1784044180.609595:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+63:11409:x1870705565170560:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 Request processed in 3263us (3857us total) trans 4294967400 rc 0/0 00000100:00100000:2.0:1784044180.609615:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 128 00000100:00100000:3.0:1784044180.616620:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044180.617065:0:13808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565170816 00000100:00100000:0.0:1784044180.617075:0:13808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565170816 00000100:00100000:0.0:1784044180.617202:0:13808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 129 00000100:00100000:0.0:1784044180.617214:0:13808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a93fdf3c-d42f-420a-95ea-b0cbfe954363+63:11409:x1870705565170816:12345-192.168.202.40@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1784044180.617274:0:13808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784044180.617301:0:13808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798000/0x89871fc3aba18899 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca67ea expref: 63 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044180.617320:0:13808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9b39494f7a00) 00010000:00010000:0.0:1784044180.617344:0:13808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784044180.617364:0:13808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6800/0x89871fc3aba188a7 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044180.617379:0:13808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6800/0x89871fc3aba188a7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044180.617388:0:13808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6800/0x89871fc3aba188a7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044180.617413:0:13808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7800/0x89871fc3aba188ae lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0xb5bd8cf2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044180.617420:0:13808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7800/0x89871fc3aba188ae lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xb5bd8cf2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044180.617427:0:13808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7800/0x89871fc3aba188ae lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xb5bd8cf2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044180.617474:0:13808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6800/0x89871fc3aba188a7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044180.617481:0:13808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6800/0x89871fc3aba188a7 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044180.617488:0:13808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6800/0x89871fc3aba188a7 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044180.617494:0:13808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38410b6800 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:0.0:1784044180.617497:0:13808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6800/0x89871fc3aba188a7 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044180.617505:0:13808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6800/0x89871fc3aba188a7 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044180.617519:0:13808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9b397aa61900) 00010000:00010000:0.0:1784044180.617521:0:13808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784044180.617525:0:13808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6800/0x89871fc3aba188a7 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044180.617531:0:13808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6800/0x89871fc3aba188a7 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044180.617541:0:13808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7800/0x89871fc3aba188ae lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xb5bd8cf2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044180.617547:0:13808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7800/0x89871fc3aba188ae lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xb5bd8cf2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044180.617552:0:13808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7800/0x89871fc3aba188ae lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xb5bd8cf2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044180.617557:0:13808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38410b7800 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:0.0:1784044180.617560:0:13808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7800/0x89871fc3aba188ae lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xb5bd8cf2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044180.617566:0:13808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7800/0x89871fc3aba188ae lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xb5bd8cf2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044180.617573:0:13808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0xb5bd8cf2 (ffff9b39758c1a00) 00010000:00010000:0.0:1784044180.617575:0:13808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784044180.617578:0:13808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7800/0x89871fc3aba188ae lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0xb5bd8cf2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044180.617585:0:13808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7800/0x89871fc3aba188ae lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0xb5bd8cf2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044180.617687:0:13808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a93fdf3c-d42f-420a-95ea-b0cbfe954363+62:11409:x1870705565170816:12345-192.168.202.40@tcp:36:lhsmtool_posix.0 Request processed in 475us (1086us total) trans 0 rc -2/-2 00000100:00100000:0.0:1784044180.617694:0:13808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 129 00000100:00100000:3.0:1784044180.621455:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044180.625376:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565170944 00000100:00100000:2.0:1784044180.625390:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565170944 00000100:00100000:2.0:1784044180.625462:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 130 00000100:00100000:2.0:1784044180.625472:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+62:11409:x1870705565170944:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1784044180.625491:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784044180.625511:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799e00/0x89871fc3aba188b5 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcd3dffad52ca67f1 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044180.625545:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798400/0x89871fc3aba188bc lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044180.625558:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798400/0x89871fc3aba188bc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044180.625570:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798400/0x89871fc3aba188bc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044180.625692:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799e00/0x89871fc3aba188b5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca67f1 expref: 64 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044180.625709:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798400/0x89871fc3aba188bc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca67f1 expref: 63 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044180.625718:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9b39494f7700) 00010000:00010000:2.0:1784044180.625721:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1784044180.625724:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3843798400, rc 0) 00000100:00100000:2.0:1784044180.625809:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+63:11409:x1870705565170944:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 Request processed in 338us (4362us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044180.625816:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 130 00000100:00100000:1.0:1784044180.634108:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044180.634261:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565171200 00000100:00100000:2.0:1784044180.634273:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565171200 00000100:00100000:2.0:1784044180.634336:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 131 00000100:00100000:2.0:1784044180.634346:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39412ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+63:11409:x1870705565171200:12345-192.168.202.40@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1784044180.634429:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798200/0x89871fc3aba188c3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044180.634446:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798200/0x89871fc3aba188c3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044180.634457:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798200/0x89871fc3aba188c3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1784044180.634645:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 88 off8560 00000004:00080000:2.0:1784044180.634655:0:6513:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 373805479673ns, next at 374805477210ns, rc = 0 00000004:00010000:2.0:1784044180.634719:0:6513:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000aff0a00e reply state 00000000ac5ddf51 transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798200/0x89871fc3aba188c3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044180.634733:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798200/0x89871fc3aba188c3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044180.634740:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9b39494f7700) 00010000:00010000:2.0:1784044180.634744:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1784044180.634752:0:6513:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1784044180.635107:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39412ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+65:11409:x1870705565171200:12345-192.168.202.40@tcp:36:lhsmtool_posix.0 Request processed in 759us (1002us total) trans 4294967401 rc 0/0 00000100:00100000:2.0:1784044180.635115:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 131 00000100:00100000:3.0:1784044180.637038:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044180.637822:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565171328 00000100:00100000:2.0:1784044180.637831:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565171328 00000100:00100000:2.0:1784044180.637890:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 132 00000100:00100000:2.0:1784044180.637900:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+65:11409:x1870705565171328:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1784044180.637940:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784044180.637960:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799e00/0x89871fc3aba188ca lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcd3dffad52ca67f8 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044180.638015:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799e00/0x89871fc3aba188ca lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca67f8 expref: 66 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044180.638027:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799e00/0x89871fc3aba188ca lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca67f8 expref: 66 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044180.638040:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9b39494f7700) 00010000:00010000:2.0:1784044180.638042:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1784044180.638045:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3843799e00, rc 0) 00000100:00100000:2.0:1784044180.638103:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+66:11409:x1870705565171328:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 Request processed in 204us (1069us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044180.638111:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 132 00000100:00100000:3.0:1784044180.640685:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044180.640765:0:9822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565171456 00000100:00100000:0.0:1784044180.640773:0:9822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565171456 00000100:00100000:0.0:1784044180.640839:0:9822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 47 00000100:00100000:0.0:1784044180.640856:0:9822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a93fdf3c-d42f-420a-95ea-b0cbfe954363+8:2409:x1870705565171456:12345-192.168.202.40@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1784044180.641050:0:9822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a93fdf3c-d42f-420a-95ea-b0cbfe954363+9:2409:x1870705565171456:12345-192.168.202.40@tcp:2:lhsmtool_posix.0 Request processed in 196us (372us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1784044180.641056:0:9822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 47 00000100:00080000:1.0:1784044180.641502:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784044180.643727:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044180.643813:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565171712 00000100:00100000:0.0:1784044180.643820:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565171712 00000100:00100000:0.0:1784044180.643923:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 30 00000100:00100000:0.0:1784044180.643934:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+66:11409:x1870705565171712:12345-192.168.202.40@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1784044180.644403:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+67:11409:x1870705565171712:12345-192.168.202.40@tcp:35:lhsmtool_posix.0 Request processed in 470us (683us total) trans 4294967402 rc 0/0 00000100:00100000:0.0:1784044180.644409:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 30 00000100:00100000:3.0:1784044180.646081:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044180.646142:0:13808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565171968 00000100:00100000:0.0:1784044180.646152:0:13808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565171968 00000100:00100000:3.0:1784044180.646490:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 133 00000100:00100000:3.0:1784044180.646501:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+67:11409:x1870705565171968:12345-192.168.202.40@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1784044180.646614:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+67:11409:x1870705565171968:12345-192.168.202.40@tcp:57:lhsmtool_posix.0 Request processed in 104us (530us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044180.646622:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 133 00000100:00100000:3.0:1784044180.648631:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044180.648687:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565172096 00000100:00100000:2.0:1784044180.648696:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565172096 00000100:00100000:2.0:1784044180.648796:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 134 00000100:00100000:2.0:1784044180.648806:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+67:11409:x1870705565172096:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1784044180.648826:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784044180.648849:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798000/0x89871fc3aba188d1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcd3dffad52ca67ff expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044180.648915:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798a00/0x89871fc3aba188d8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044180.648946:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798a00/0x89871fc3aba188d8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044180.648955:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798a00/0x89871fc3aba188d8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784044180.648991:0:6513:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1784044180.649004:0:6513:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798a00/0x89871fc3aba188d8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044180.649022:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798000/0x89871fc3aba188d1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca67ff expref: 69 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044180.649035:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798a00/0x89871fc3aba188d8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca67ff expref: 68 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044180.649041:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9b39494f7700) 00010000:00010000:2.0:1784044180.649043:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1784044180.649045:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3843798a00, rc 0) 00000100:00100000:2.0:1784044180.649088:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+68:11409:x1870705565172096:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 Request processed in 283us (464us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044180.649094:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 134 00000100:00100000:0.0:1784044180.651669:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1784044180.651773:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565172224 00000100:00100000:1.0:1784044180.651782:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565172224 00000100:00100000:1.0:1784044180.651860:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 48 00000100:00100000:1.0:1784044180.651870:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397ba9e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+9:2409:x1870705565172224:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1784044180.651888:0:8428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784044180.651908:0:8428:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000007089f14/0x89871fc3aba188df lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcd3dffad52ca6806 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784044180.651934:0:8428:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a565a94, blocks: 0x0 00010000:00010000:1.0:1784044180.651963:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=373s v=(0 0) 00010000:00010000:1.0:1784044180.651967:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784044180.651974:0:8428:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000007089f14/0x89871fc3aba188df lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6806 expref: 10 pid: 8428 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044180.651987:0:8428:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000007089f14/0x89871fc3aba188df lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6806 expref: 10 pid: 8428 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044180.651997:0:8428:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b38426fce00, rc 0) 00000100:00100000:1.0:1784044180.652093:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397ba9e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+10:2409:x1870705565172224:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 Request processed in 224us (436us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044180.652101:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 48 00000100:00100000:3.0:1784044180.654994:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044180.655081:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565172480 00000100:00100000:2.0:1784044180.655089:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565172480 00000100:00100000:2.0:1784044180.655146:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 135 00000100:00100000:2.0:1784044180.655155:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+68:11409:x1870705565172480:12345-192.168.202.40@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1784044180.655298:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+68:11409:x1870705565172480:12345-192.168.202.40@tcp:57:lhsmtool_posix.0 Request processed in 142us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044180.655320:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 135 00000100:00100000:1.0:1784044180.657913:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044180.658667:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565172608 00000100:00100000:2.0:1784044180.658679:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565172608 00000100:00100000:2.0:1784044180.658787:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 49 00000100:00100000:2.0:1784044180.658801:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d46d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+10:11409:x1870705565172608:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1784044180.658823:0:8427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784044180.658854:0:8427:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a8ed0f0e/0x89871fc3aba188e6 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcd3dffad52ca680d expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044180.658896:0:8427:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000007089f14/0x89871fc3aba188df lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6806 expref: 11 pid: 8428 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044180.658907:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784044180.658912:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784044180.658918:0:8427:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a8ed0f0e/0x89871fc3aba188e6 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca680d expref: 11 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044180.658957:0:8427:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000007089f14/0x89871fc3aba188df lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6806 expref: 11 pid: 8428 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044180.658973:0:8427:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000007089f14/0x89871fc3aba188df lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6806 expref: 11 pid: 8428 timeout: 473 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044180.658988:0:8427:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397bbbca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8427:1870705580982912:192.168.202.40@tcp:104: 00000100:00100000:2.0:1784044180.659095:0:8427:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b397b8d3780 going to sleep for 11 seconds 00000100:00100000:3.0:1784044180.662766:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1784044180.662969:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565172736 00000100:00100000:1.0:1784044180.662977:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565172736 00010000:00010000:1.0:1784044180.663011:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000007089f14/0x89871fc3aba188df lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6806 expref: 12 pid: 8428 timeout: 473 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044180.663045:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 78 00000100:00100000:1.0:1784044180.663052:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d4df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+12:2409:x1870705565172736:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784044180.663065:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784044180.663087:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000007089f14/0x89871fc3aba188df lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6806 expref: 12 pid: 8428 timeout: 473 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044180.663101:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000007089f14/0x89871fc3aba188df lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6806 expref: 12 pid: 8428 timeout: 473 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044180.663145:0:6497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784044180.663150:0:6497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784044180.663159:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a8ed0f0e/0x89871fc3aba188e6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca680d expref: 12 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044180.663169:0:6497:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a8ed0f0e/0x89871fc3aba188e6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca680d expref: 12 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044180.663235:0:6497:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000a8ed0f0e/0x89871fc3aba188e6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca680d expref: 12 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044180.663250:0:6497:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b38427b5500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6497:1870705580983040:192.168.202.40@tcp:105: 00000100:00100000:1.0:1784044180.663436:0:6497:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b397ab38180 going to sleep for 11 seconds 00010000:00010000:2.0:1784044180.663782:0:8427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000007089f14/0x89871fc3aba188df lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6806 expref: 12 pid: 8428 timeout: 473 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044180.663799:0:8427:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397bbbca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8427:1870705580982912:192.168.202.40@tcp:104: 00010000:00010000:2.0:1784044180.663821:0:8427:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a8ed0f0e/0x89871fc3aba188e6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca680d expref: 11 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044180.663836:0:8427:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3843798000, rc 0) 00000100:00100000:2.0:1784044180.663876:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d46d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+11:11409:x1870705565172608:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 Request processed in 5079us (5971us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044180.663883:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 49 00000100:00100000:2.0:1784044180.668552:0:6497:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b38427b5500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6497:1870705580983040:192.168.202.40@tcp:105: 00010000:00010000:2.0:1784044180.668593:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784044180.668721:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d4df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+10:2409:x1870705565172736:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 5666us (5961us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044180.668733:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 78 00000100:00100000:1.0:1784044180.676486:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044180.676528:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565172864 00000100:00100000:0.0:1784044180.676538:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565172864 00002000:00100000:0.0:1784044180.676593:0:8431:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff9b38427b7100 x1870705565172864/t0(0) o4->a93fdf3c-d42f-420a-95ea-b0cbfe954363@192.168.202.40@tcp:331/0 lens 504/0 e 0 to 0 dl 1784044191 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784044180.676614:0:8431:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b38427b7100 with x1870705565172864 ext(0->12) 00002000:00010000:0.0:1784044180.676634:0:8431:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b38427b7100 00000100:00100000:0.0:1784044180.676663:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 2 00000100:00100000:0.0:1784044180.676670:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38427b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+10:2409:x1870705565172864:12345-192.168.202.40@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1784044180.677661:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38427b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+12:2409:x1870705565172864:12345-192.168.202.40@tcp:4:lhsmtool_posix.0 Request processed in 984us (1179us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1784044180.677674:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 2 00002000:00100000:0.0:1784044180.677684:0:8431:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff9b38427b7100 x1870705565172864/t4294967309(0) o4->a93fdf3c-d42f-420a-95ea-b0cbfe954363@192.168.202.40@tcp:331/0 lens 504/448 e 0 to 0 dl 1784044191 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784044180.677694:0:8431:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b38427b7100 with x1870705565172864 ext(0->12) 00002000:00010000:0.0:1784044180.677698:0:8431:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b38427b7100 00000100:00100000:1.0:1784044180.680827:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044180.681042:0:13808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565172992 00000100:00100000:3.0:1784044180.681053:0:13808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565172992 00000100:00100000:3.0:1784044180.681138:0:13808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 136 00000100:00100000:3.0:1784044180.681148:0:13808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38427b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a93fdf3c-d42f-420a-95ea-b0cbfe954363+68:11409:x1870705565172992:12345-192.168.202.40@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1784044180.683928:0:6490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967402 is committed 00010000:00010000:2.0:1784044180.683998:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6a00/0x89871fc3aba185eb lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044180.684013:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6a00/0x89871fc3aba185eb lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1784044180.684022:0:6490:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00010000:00010000:2.0:1784044180.684022:0:3625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6a00/0x89871fc3aba185eb lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044180.684028:0:3625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38410b6a00 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:2.0:1784044180.684034:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6a00/0x89871fc3aba185eb lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044180.684056:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6a00/0x89871fc3aba185eb lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044180.684074:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9b39494f7100) 00010000:00010000:2.0:1784044180.684078:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784044180.684082:0:3625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6a00/0x89871fc3aba185eb lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044180.684089:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6a00/0x89871fc3aba185eb lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044180.684115:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7600/0x89871fc3aba18693 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044180.684121:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7600/0x89871fc3aba18693 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044180.684127:0:3625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7600/0x89871fc3aba18693 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044180.684132:0:3625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38410b7600 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:2.0:1784044180.684136:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7600/0x89871fc3aba18693 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044180.684142:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7600/0x89871fc3aba18693 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1784044180.684203:0:6490:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000020:00080000:3.0:1784044180.684228:0:6490:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9b384341bd80 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:3.0:1784044180.684232:0:6490:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9b397b970100 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9b384341b540 00000020:00080000:3.0:1784044180.684242:0:6490:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9b397b970700 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9b397f940000 00000004:00080000:3.0:1784044180.684262:0:6490:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00010000:00010000:2.0:1784044180.684385:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9b39758c1100) 00010000:00010000:2.0:1784044180.684389:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784044180.684393:0:3625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7600/0x89871fc3aba18693 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044180.684405:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1870705580983168:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1784044180.684408:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7600/0x89871fc3aba18693 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044180.684425:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6600/0x89871fc3aba18711 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044180.684431:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6600/0x89871fc3aba18711 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044180.684436:0:3625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6600/0x89871fc3aba18711 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044180.684441:0:3625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38410b6600 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:2.0:1784044180.684444:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6600/0x89871fc3aba18711 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044180.684449:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6600/0x89871fc3aba18711 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044180.684457:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9b39758c1b00) 00010000:00010000:2.0:1784044180.684460:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784044180.684463:0:3625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6600/0x89871fc3aba18711 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044180.684467:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6600/0x89871fc3aba18711 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044180.684476:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc400/0x89871fc3aba18734 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044180.684481:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc400/0x89871fc3aba18734 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044180.684488:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1784044180.684492:0:3625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc400/0x89871fc3aba18734 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044180.684498:0:3625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38426fc400 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:2.0:1784044180.684501:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc400/0x89871fc3aba18734 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044180.684507:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc400/0x89871fc3aba18734 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044180.684516:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9b39758c1b00) 00010000:00010000:2.0:1784044180.684518:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784044180.684521:0:3625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc400/0x89871fc3aba18734 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044180.684526:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc400/0x89871fc3aba18734 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044180.684539:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799000/0x89871fc3aba18806 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044180.684544:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799000/0x89871fc3aba18806 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044180.684550:0:3625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799000/0x89871fc3aba18806 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044180.684555:0:3625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3843799000 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:2.0:1784044180.684557:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799000/0x89871fc3aba18806 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044180.684564:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580983168 00010000:00010000:2.0:1784044180.684571:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799000/0x89871fc3aba18806 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044180.684573:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580983168 00010000:00010000:2.0:1784044180.684580:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9b39758c1600) 00010000:00010000:2.0:1784044180.684582:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784044180.684584:0:3625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799000/0x89871fc3aba18806 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044180.684589:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799000/0x89871fc3aba18806 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044180.684615:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798200/0x89871fc3aba188c3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044180.684622:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798200/0x89871fc3aba188c3 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044180.684628:0:3625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798200/0x89871fc3aba188c3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044180.684633:0:3625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3843798200 already unused, calling callback (ffffffffc174d4f0) 00000100:00100000:0.0:1784044180.684634:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00010000:00010000:2.0:1784044180.684635:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798200/0x89871fc3aba188c3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044180.684641:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798200/0x89871fc3aba188c3 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044180.684643:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d83b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1870705580983168:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1784044180.684649:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9b39494f7700) 00010000:00010000:2.0:1784044180.684651:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1784044180.684653:0:3625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798200/0x89871fc3aba188c3 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044180.684666:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798200/0x89871fc3aba188c3 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00080000:0.0:1784044180.684674:0:8428:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3 count 1 00002000:00010000:0.0:1784044180.684711:0:8428:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 9, mtime: 0x6a565a92, atime: 0x6a565a93, ctime: 0x6a565a92, blocks: 0x8 00010000:00010000:0.0:1784044180.684719:0:8428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c9816671/0x89871fc3aba188ed lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044180.684733:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=373s v=(0 0) 00010000:00010000:0.0:1784044180.684737:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784044180.684742:0:8428:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c9816671/0x89871fc3aba188ed lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044180.684763:0:8428:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c9816671/0x89871fc3aba188ed lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044180.684769:0:8428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c9816671/0x89871fc3aba188ed lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044180.684773:0:8428:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c9816671/0x89871fc3aba188ed lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044180.684790:0:8428:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784044180.684814:0:10330:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784044180.684819:0:10330:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c9816671/0x89871fc3aba188ed lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044180.684827:0:10330:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38410b6000 already unused, calling callback (ffffffffc0b56230) 00010000:00010000:2.0:1784044180.684831:0:10330:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c9816671/0x89871fc3aba188ed lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044180.684838:0:10330:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c9816671/0x89871fc3aba188ed lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044180.684852:0:10330:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c9816671/0x89871fc3aba188ed lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044180.684859:0:10330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c9816671/0x89871fc3aba188ed lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044180.684873:0:10330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784044180.684875:0:10330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784044180.684876:0:10330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784044180.684978:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d83b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3640:x1870705580983168:12345-0@lo:6:osp-syn-1-0.0 Request processed in 335us (489us total) trans 4294967305 rc 0/0 00000100:00100000:0.0:1784044180.684986:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1784044180.685978:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397f9dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1870705580983424:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1784044180.686024:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044180.686214:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b38427b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1870705580983296:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1784044180.686241:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044180.686316:0:9822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580983424 00000100:00100000:1.0:1784044180.686322:0:9822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580983424 00000100:00100000:1.0:1784044180.686375:0:9822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580983296 00000100:00100000:1.0:1784044180.686378:0:9822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580983296 00000100:00100000:1.0:1784044180.686395:0:9822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1784044180.686403:0:9822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d81f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3638:x1870705580983424:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1784044180.686637:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1784044180.686646:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d80700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3641:x1870705580983296:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1784044180.686661:0:8426:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3 count 1 00010000:00010000:0.0:1784044180.686680:0:8426:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000162fcd51/0x89871fc3aba188f4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044180.686702:0:8426:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005040606c/0x89871fc3aba186a1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6765 expref: 11 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044180.686723:0:8426:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x3:0x0].0x0 since=2s v=(0 0) 00000100:00100000:2.0:1784044180.686725:0:3640:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967304 gen 2 00010000:00010000:0.0:1784044180.686727:0:8426:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00000004:00080000:2.0:1784044180.686731:0:3640:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967301 committed transno 4294967304 00010000:00010000:0.0:1784044180.686733:0:8426:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000162fcd51/0x89871fc3aba188f4 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1784044180.686752:0:3640:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b3975b50380, transno 4294967302 00010000:00010000:0.0:1784044180.686762:0:8426:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005040606c/0x89871fc3aba186a1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6765 expref: 11 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1784044180.686763:0:3640:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967304 committed transno 4294967304 00010000:00010000:0.0:1784044180.686775:0:8426:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005040606c/0x89871fc3aba186a1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6765 expref: 11 pid: 8428 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044180.686784:0:3640:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff9b3843d82300 x1870705580983168/t4294967305(4294967305) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1784044196 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784044180.686786:0:8426:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d81180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8426:1870705580983552:192.168.202.40@tcp:104: 00000004:00080000:2.0:1784044180.686794:0:3640:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b3843d82300/2, rc 0, transno 4294967305 00000100:00100000:2.0:1784044180.686799:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1870705580983168:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1784044180.686860:0:8426:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b397f923480 going to sleep for 11 seconds 00002000:00010000:1.0:1784044180.686977:0:9822:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1784044180.686980:0:9822:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1784044180 00002000:00010000:1.0:1784044180.686983:0:9822:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1784044180.686985:0:9822:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb ctime from disk: 1784044180 -> 1784044180 00002000:00010000:1.0:1784044180.686994:0:9822:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:1.0:1784044180.687042:0:9822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d81f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3638:x1870705580983424:12345-0@lo:2:osp-syn-0-0.0 Request processed in 639us (1018us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1784044180.687048:0:9822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000020:00080000:2.0:1784044180.687246:0:6544:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000004:00080000:0.0:1784044180.687270:0:3638:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b397f9dd500/2, rc 0, transno 4294967310 00000100:00100000:0.0:1784044180.687275:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397f9dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1870705580983424:0@lo:2:osp-syn-0-0.0 00000020:00080000:3.0:1784044180.687660:0:6490:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9b3951e52f00 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:3.0:1784044180.687666:0:6490:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9b397f942800 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9b3951e52840 00000020:00080000:3.0:1784044180.687669:0:6490:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9b397f942400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9b3843ce0600 00000100:00100000:0.0:1784044180.687936:0:13808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38427b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a93fdf3c-d42f-420a-95ea-b0cbfe954363+16:11409:x1870705565172992:12345-192.168.202.40@tcp:44:lhsmtool_posix.0 Request processed in 6787us (7119us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044180.687945:0:13808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 136 00000020:00080000:2.0:1784044180.692707:0:6544:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:2.0:1784044180.692790:0:6544:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:0.0:1784044180.693438:0:8426:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d81180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8426:1870705580983552:192.168.202.40@tcp:104: 00010000:00010000:0.0:1784044180.693463:0:8426:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000162fcd51/0x89871fc3aba188f4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044180.695793:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044180.699786:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565173120 00000100:00100000:0.0:1784044180.699818:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565173120 00000100:00100000:0.0:1784044180.699890:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 53 00000100:00100000:0.0:1784044180.699901:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+12:2409:x1870705565173120:12345-192.168.202.40@tcp:16:lhsmtool_posix.0 00000001:00080000:3.0:1784044180.701546:0:8421:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00000001:00080000:3.0:1784044180.701560:0:8421:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000100:00100000:3.0:1784044180.702261:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1784044180.702362:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565173248 00000100:00100000:1.0:1784044180.702371:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565173248 00010000:00010000:1.0:1784044180.702412:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005040606c/0x89871fc3aba186a1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6765 expref: 8 pid: 8428 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044180.702460:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 79 00000100:00100000:1.0:1784044180.702469:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d4e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+8:2410:x1870705565173248:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784044180.702483:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784044180.702489:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005040606c/0x89871fc3aba186a1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6765 expref: 8 pid: 8428 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044180.702502:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005040606c/0x89871fc3aba186a1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6765 expref: 8 pid: 8428 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044180.702525:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005040606c/0x89871fc3aba186a1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6765 expref: 8 pid: 8428 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044180.702542:0:6498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1784044180.702547:0:6498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1784044180.702554:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000162fcd51/0x89871fc3aba188f4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044180.702564:0:6498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000162fcd51/0x89871fc3aba188f4 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044180.702614:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784044180.702663:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d4e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+7:2410:x1870705565173248:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 195us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044180.702671:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 79 00010000:00010000:0.0:1784044180.703748:0:8426:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000162fcd51/0x89871fc3aba188f4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044180.703763:0:8426:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000162fcd51/0x89871fc3aba188f4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044180.703774:0:8426:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000162fcd51/0x89871fc3aba188f4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044180.703782:0:8426:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000162fcd51/0x89871fc3aba188f4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044180.703804:0:8426:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1784044180.703996:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d80700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3641:x1870705580983296:12345-0@lo:6:osp-syn-0-0.0 Request processed in 17349us (17751us total) trans 4294967311 rc 0/0 00000100:00100000:0.0:1784044180.704006:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1784044180.704055:0:3641:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:0.0:1784044180.704073:0:3641:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967310 00000004:00080000:0.0:1784044180.704096:0:3641:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b397f9dd500, transno 4294967310 00000100:00100000:0.0:1784044180.704111:0:3641:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff9b38427b5500 x1870705580983296/t4294967311(4294967311) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1784044196 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:0.0:1784044180.704123:0:3641:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b38427b5500/2, rc 0, transno 4294967311 00000100:00100000:0.0:1784044180.704129:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b38427b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1870705580983296:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1784044180.704311:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+6:2409:x1870705565173120:12345-192.168.202.40@tcp:16:lhsmtool_posix.0 Request processed in 4411us (8525us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044180.704319:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 53 00010000:00010000:3.0:1784044180.705648:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784044180.705659:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000162fcd51/0x89871fc3aba188f4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044180.705671:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38410b7e00 already unused, calling callback (ffffffffc0b56230) 00010000:00010000:3.0:1784044180.705676:0:6500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000162fcd51/0x89871fc3aba188f4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044180.705685:0:6500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000162fcd51/0x89871fc3aba188f4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044180.705705:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000162fcd51/0x89871fc3aba188f4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044180.705713:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000162fcd51/0x89871fc3aba188f4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044180.705754:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784044180.705756:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784044180.705758:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784044180.708427:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044180.708581:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565173504 00000100:00100000:2.0:1784044180.708595:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565173504 00000100:00100000:2.0:1784044180.708674:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 137 00000100:00100000:2.0:1784044180.708685:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+16:11409:x1870705565173504:12345-192.168.202.40@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1784044180.708738:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784044180.708769:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798a00/0x89871fc3aba188d8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca67ff expref: 16 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044180.708788:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9b39494f7700) 00010000:00010000:2.0:1784044180.708792:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784044180.708824:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798200/0x89871fc3aba188fb lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044180.708839:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798200/0x89871fc3aba188fb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044180.708848:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798200/0x89871fc3aba188fb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784044180.708992:0:6513:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000015620517 reply state 000000002c65608d transno 4294967403 ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798200/0x89871fc3aba188fb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044180.709026:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798200/0x89871fc3aba188fb lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044180.709032:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9b39494f7700) 00010000:00010000:2.0:1784044180.709034:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1784044180.709037:0:6513:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1784044180.709165:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+17:11409:x1870705565173504:12345-192.168.202.40@tcp:36:lhsmtool_posix.0 Request processed in 481us (746us total) trans 4294967403 rc 0/0 00000100:00100000:2.0:1784044180.709202:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 137 00000100:00100000:0.0:1784044180.712646:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1784044180.712742:0:9822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565173632 00000100:00100000:1.0:1784044180.712751:0:9822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565173632 00000100:00100000:1.0:1784044180.712815:0:9822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 54 00000100:00100000:1.0:1784044180.712826:0:9822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d81180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a93fdf3c-d42f-420a-95ea-b0cbfe954363+6:2407:x1870705565173632:12345-192.168.202.40@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1784044180.712986:0:9822:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:1.0:1784044180.712991:0:9822:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb mtime from disk: 1784044180 -> 1784044179 00002000:00010000:1.0:1784044180.712993:0:9822:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb atime from disk: 0 -> 1784044179 00002000:00010000:1.0:1784044180.712996:0:9822:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb ctime from disk: 1784044180 -> 1784044179 00002000:00010000:1.0:1784044180.712998:0:9822:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:1.0:1784044180.713072:0:9822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d81180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a93fdf3c-d42f-420a-95ea-b0cbfe954363+7:2407:x1870705565173632:12345-192.168.202.40@tcp:2:lhsmtool_posix.0 Request processed in 240us (429us total) trans 4294967312 rc 0/0 00000100:00100000:1.0:1784044180.713081:0:9822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 54 00000100:00100000:3.0:1784044180.715491:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044180.715594:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565173888 00000100:00100000:0.0:1784044180.715613:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565173888 00000100:00100000:0.0:1784044180.715688:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 138 00000100:00100000:0.0:1784044180.715699:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+17:11409:x1870705565173888:12345-192.168.202.40@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1784044180.715773:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7e00/0x89871fc3aba18902 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044180.715791:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798400/0x89871fc3aba188bc lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca67f1 expref: 17 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044180.715803:0:6512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7e00/0x89871fc3aba18902 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044180.715845:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798400/0x89871fc3aba188bc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca67f1 expref: 17 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044180.715860:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798400/0x89871fc3aba188bc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca67f1 expref: 17 pid: 6511 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044180.715876:0:6512:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d80a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6512:1870705580983680:192.168.202.40@tcp:104: 00000100:00100000:0.0:1784044180.715975:0:6512:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b397f923480 going to sleep for 11 seconds 00000100:00100000:3.0:1784044180.719649:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044180.720107:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565174016 00000100:00100000:2.0:1784044180.720117:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565174016 00010000:00010000:2.0:1784044180.720220:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798400/0x89871fc3aba188bc lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca67f1 expref: 18 pid: 6511 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044180.720261:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 80 00000100:00100000:2.0:1784044180.720271:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d4f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+18:2410:x1870705565174016:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784044180.720299:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784044180.720308:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798400/0x89871fc3aba188bc lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca67f1 expref: 18 pid: 6511 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044180.720322:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798400/0x89871fc3aba188bc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca67f1 expref: 18 pid: 6511 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044180.720354:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9b39494f7700) 00010000:00010000:2.0:1784044180.720361:0:6496:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7e00/0x89871fc3aba18902 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044180.720390:0:6496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7e00/0x89871fc3aba18902 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044180.720398:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7e00/0x89871fc3aba18902 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044180.720419:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784044180.720636:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d4f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+18:2410:x1870705565174016:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 365us (997us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044180.720644:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 80 00010000:00010000:0.0:1784044180.720993:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798400/0x89871fc3aba188bc lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca67f1 expref: 17 pid: 6511 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044180.721027:0:6512:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d80a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6512:1870705580983680:192.168.202.40@tcp:104: 00010000:00010000:0.0:1784044180.721047:0:6512:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7e00/0x89871fc3aba18902 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044180.721116:0:6512:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7e00/0x89871fc3aba18902 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044180.721123:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7e00/0x89871fc3aba18902 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044180.721166:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7e00/0x89871fc3aba18902 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044180.721216:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7e00/0x89871fc3aba18902 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044180.721224:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7e00/0x89871fc3aba18902 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044180.721230:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38410b7e00 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:0.0:1784044180.721235:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7e00/0x89871fc3aba18902 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044180.721241:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7e00/0x89871fc3aba18902 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044180.721253:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9b39494f7700) 00010000:00010000:0.0:1784044180.721256:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1784044180.721260:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7e00/0x89871fc3aba18902 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044180.721273:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7e00/0x89871fc3aba18902 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044180.721637:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+16:11409:x1870705565173888:12345-192.168.202.40@tcp:55:lhsmtool_posix.0 Request processed in 5937us (6154us total) trans 0 rc -22/-22 00000100:00100000:1.0:1784044180.721647:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 138 00000100:00100000:1.0:1784044180.724808:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044180.724898:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565174144 00000100:00100000:0.0:1784044180.724908:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565174144 00000100:00100000:0.0:1784044180.724997:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 55 00000100:00100000:0.0:1784044180.725007:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397f9dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+7:2408:x1870705565174144:12345-192.168.202.40@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1784044180.725055:0:8426:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000c9816671/0x89871fc3aba18909 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044180.725088:0:8426:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a8ed0f0e/0x89871fc3aba188e6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca680d expref: 7 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044180.725097:0:8426:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784044180.725101:0:8426:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1784044180.725106:0:8426:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c9816671/0x89871fc3aba18909 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044180.725142:0:8426:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a8ed0f0e/0x89871fc3aba188e6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca680d expref: 7 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044180.725157:0:8426:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a8ed0f0e/0x89871fc3aba188e6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca680d expref: 7 pid: 8427 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044180.725213:0:8426:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d80a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8426:1870705580983808:192.168.202.40@tcp:104: 00000100:00100000:0.0:1784044180.725288:0:8426:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b397f923480 going to sleep for 11 seconds 00000100:00100000:0.0:1784044180.727867:0:8426:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d80a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8426:1870705580983808:192.168.202.40@tcp:104: 00010000:00010000:0.0:1784044180.727901:0:8426:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000c9816671/0x89871fc3aba18909 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044180.729880:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044180.729970:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565174272 00000100:00100000:3.0:1784044180.729980:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565174272 00010000:00010000:3.0:1784044180.730030:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a8ed0f0e/0x89871fc3aba188e6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca680d expref: 8 pid: 8427 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044180.730088:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 81 00000100:00100000:3.0:1784044180.730098:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3944092c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+8:2410:x1870705565174272:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784044180.730116:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784044180.730142:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a8ed0f0e/0x89871fc3aba188e6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca680d expref: 8 pid: 8427 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044180.730155:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a8ed0f0e/0x89871fc3aba188e6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca680d expref: 8 pid: 8427 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044180.730220:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a8ed0f0e/0x89871fc3aba188e6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca680d expref: 8 pid: 8427 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044180.730240:0:6498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1784044180.730245:0:6498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1784044180.730271:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c9816671/0x89871fc3aba18909 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044180.730282:0:6498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c9816671/0x89871fc3aba18909 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044180.730317:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784044180.730386:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3944092c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+7:2410:x1870705565174272:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 288us (515us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044180.730394:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 81 00010000:00010000:1.0:1784044180.730924:0:8426:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000c9816671/0x89871fc3aba18909 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044180.730936:0:8426:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c9816671/0x89871fc3aba18909 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044180.730970:0:8426:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000c9816671/0x89871fc3aba18909 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044180.730979:0:8426:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c9816671/0x89871fc3aba18909 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044180.730987:0:8426:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c9816671/0x89871fc3aba18909 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044180.730995:0:8426:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38410b6000 already unused, calling callback (ffffffffc0b56230) 00010000:00010000:1.0:1784044180.730999:0:8426:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c9816671/0x89871fc3aba18909 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044180.731008:0:8426:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c9816671/0x89871fc3aba18909 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044180.731020:0:8426:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c9816671/0x89871fc3aba18909 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044180.731026:0:8426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c9816671/0x89871fc3aba18909 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044180.731101:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397f9dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+6:2408:x1870705565174144:12345-192.168.202.40@tcp:1:lhsmtool_posix.0 Request processed in 6095us (6303us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044180.731109:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 55 00000100:00100000:1.0:1784044180.734551:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044180.734655:0:13808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565174528 00000100:00100000:0.0:1784044180.734664:0:13808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565174528 00000100:00100000:0.0:1784044180.734727:0:13808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 139 00000100:00100000:0.0:1784044180.734739:0:13808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39759b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a93fdf3c-d42f-420a-95ea-b0cbfe954363+16:11409:x1870705565174528:12345-192.168.202.40@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1784044180.734824:0:13808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6600/0x89871fc3aba18910 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044180.734843:0:13808:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166b800/0x89871fc3aba187ff lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca67b9 expref: 16 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044180.734854:0:13808:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6600/0x89871fc3aba18910 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044180.734889:0:13808:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166b800/0x89871fc3aba187ff lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca67b9 expref: 16 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044180.734904:0:13808:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166b800/0x89871fc3aba187ff lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca67b9 expref: 16 pid: 6512 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044180.734919:0:13808:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d80a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13808:1870705580983936:192.168.202.40@tcp:104: 00000100:00100000:0.0:1784044180.735010:0:13808:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b397f923480 going to sleep for 11 seconds 00000100:00100000:2.0:1784044180.738021:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1784044180.738104:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565174656 00000100:00100000:1.0:1784044180.738113:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565174656 00010000:00010000:1.0:1784044180.738151:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166b800/0x89871fc3aba187ff lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca67b9 expref: 17 pid: 6512 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044180.738215:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 82 00000100:00100000:1.0:1784044180.738225:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397bbbca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+17:2409:x1870705565174656:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784044180.738239:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784044180.738246:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166b800/0x89871fc3aba187ff lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca67b9 expref: 17 pid: 6512 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044180.738260:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166b800/0x89871fc3aba187ff lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca67b9 expref: 17 pid: 6512 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044180.738282:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9b39758c1600) 00010000:00010000:1.0:1784044180.738298:0:6497:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc600/0x89871fc3aba18861 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca67dc expref: 17 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044180.738309:0:6497:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6600/0x89871fc3aba18910 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044180.738318:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6600/0x89871fc3aba18910 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044180.738325:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6600/0x89871fc3aba18910 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044180.738351:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784044180.738418:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397bbbca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+17:2409:x1870705565174656:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 194us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044180.738427:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 82 00010000:00010000:0.0:1784044180.738668:0:13808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166b800/0x89871fc3aba187ff lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca67b9 expref: 16 pid: 6512 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044180.738696:0:13808:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d80a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13808:1870705580983936:192.168.202.40@tcp:104: 00010000:00010000:0.0:1784044180.738716:0:13808:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6600/0x89871fc3aba18910 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044180.738724:0:13808:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6600/0x89871fc3aba18910 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044180.738730:0:13808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6600/0x89871fc3aba18910 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044180.738921:0:13808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7e00/0x89871fc3aba18917 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044180.738933:0:13808:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799e00/0x89871fc3aba188ca lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca67f8 expref: 16 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044180.738940:0:13808:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7e00/0x89871fc3aba18917 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044180.738968:0:13808:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799e00/0x89871fc3aba188ca lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca67f8 expref: 16 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044180.738983:0:13808:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799e00/0x89871fc3aba188ca lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca67f8 expref: 16 pid: 6511 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044180.738998:0:13808:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d80a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13808:1870705580984064:192.168.202.40@tcp:104: 00000100:00100000:0.0:1784044180.739069:0:13808:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3951e52840 going to sleep for 11 seconds 00000100:00100000:2.0:1784044180.744028:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044180.744122:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565174784 00000100:00100000:3.0:1784044180.744130:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565174784 00010000:00010000:3.0:1784044180.744170:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799e00/0x89871fc3aba188ca lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca67f8 expref: 17 pid: 6511 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044180.744240:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 83 00000100:00100000:3.0:1784044180.744249:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397bbbe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+17:2409:x1870705565174784:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784044180.744264:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784044180.744271:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799e00/0x89871fc3aba188ca lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca67f8 expref: 17 pid: 6511 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044180.744294:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799e00/0x89871fc3aba188ca lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca67f8 expref: 17 pid: 6511 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044180.744315:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9b39494f7700) 00010000:00010000:3.0:1784044180.744320:0:6498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7e00/0x89871fc3aba18917 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044180.744354:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7e00/0x89871fc3aba18917 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044180.744361:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7e00/0x89871fc3aba18917 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044180.744379:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784044180.744434:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397bbbe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+17:2409:x1870705565174784:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 186us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044180.744441:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 83 00010000:00010000:0.0:1784044180.744730:0:13808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799e00/0x89871fc3aba188ca lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca67f8 expref: 16 pid: 6511 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044180.744748:0:13808:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d80a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13808:1870705580984064:192.168.202.40@tcp:104: 00010000:00010000:0.0:1784044180.744766:0:13808:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7e00/0x89871fc3aba18917 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044180.744774:0:13808:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7e00/0x89871fc3aba18917 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044180.744780:0:13808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7e00/0x89871fc3aba18917 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1784044180.744877:0:13808:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000001:00080000:0.0:1784044180.744977:0:13808:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000001:00080000:0.0:1784044180.745009:0:13808:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967406 00000100:00100000:0.0:1784044180.745145:0:13808:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d80a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:13808:1870705580984192:0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1784044180.745229:0:13808:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044180.745264:0:13808:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3843703240 going to sleep for 11 seconds 00000100:00100000:3.0:1784044180.746021:0:7768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580984192 00000100:00100000:3.0:1784044180.746027:0:7768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580984192 00000100:00100000:3.0:1784044180.746080:0:7768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1784044180.746088:0:7768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:13808:x1870705580984192:12345-0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1784044180.746197:0:7768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:13808:x1870705580984192:12345-0@lo:1000:mdt00_004.0 Request processed in 110us (966us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044180.746204:0:7768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1784044180.746339:0:13808:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d80a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:13808:1870705580984192:0@lo:1000:mdt00_004.0 00000001:00080000:1.0:1784044180.746474:0:13808:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00000100:00100000:1.0:1784044180.746524:0:13808:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d2d500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:13808:1870705580984320:0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1784044180.746555:0:13808:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044180.746577:0:13808:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b397ab38000 going to sleep for 11 seconds 00000100:00100000:3.0:1784044180.746800:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580984320 00000100:00100000:3.0:1784044180.746805:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580984320 00000100:00100000:3.0:1784044180.746839:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1784044180.746847:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38435ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:13808:x1870705580984320:12345-0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1784044180.746947:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38435ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:13808:x1870705580984320:12345-0@lo:1000:mdt00_004.0 Request processed in 100us (391us total) trans 4294967313 rc 0/0 00000100:00100000:3.0:1784044180.746955:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1784044180.747518:0:13808:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d2d500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:13808:1870705580984320:0@lo:1000:mdt00_004.0 00010000:00010000:2.0:1784044180.747558:0:13808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7e00/0x89871fc3aba18917 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044180.747568:0:13808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7e00/0x89871fc3aba18917 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044180.747576:0:13808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7e00/0x89871fc3aba18917 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044180.747582:0:13808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38410b7e00 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:2.0:1784044180.747586:0:13808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7e00/0x89871fc3aba18917 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044180.747593:0:13808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7e00/0x89871fc3aba18917 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044180.747617:0:13808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9b39494f7700) 00010000:00010000:2.0:1784044180.747635:0:13808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1784044180.747641:0:13808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7e00/0x89871fc3aba18917 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044180.747647:0:13808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7e00/0x89871fc3aba18917 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044180.747673:0:13808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798600/0x89871fc3aba1885a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044180.747678:0:13808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798600/0x89871fc3aba1885a lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044180.747683:0:13808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798600/0x89871fc3aba1885a lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044180.747688:0:13808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3843798600 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:2.0:1784044180.747691:0:13808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798600/0x89871fc3aba1885a lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044180.747695:0:13808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798600/0x89871fc3aba1885a lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044180.747703:0:13808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9b39758c1600) 00010000:00010000:2.0:1784044180.747705:0:13808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1784044180.747712:0:13808:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc600/0x89871fc3aba18861 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca67dc expref: 19 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044180.747722:0:13808:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc600/0x89871fc3aba18861 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca67dc expref: 19 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044180.747730:0:13808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc600/0x89871fc3aba18861 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca67dc expref: 19 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044180.747765:0:13808:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc600/0x89871fc3aba18861 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca67dc expref: 19 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044180.747777:0:13808:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397bbbd880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13808:1870705580984448:192.168.202.40@tcp:105: 00000100:00100000:2.0:1784044180.747847:0:13808:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b397b8d3b40 going to sleep for 11 seconds 00000100:00100000:0.0:1784044180.751315:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044180.751432:0:13808:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397bbbd880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13808:1870705580984448:192.168.202.40@tcp:105: 00010000:00010000:2.0:1784044180.751460:0:13808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798600/0x89871fc3aba1885a lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044180.751471:0:13808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798600/0x89871fc3aba1885a lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044180.751503:0:13808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799800/0x89871fc3aba1891e lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044180.751517:0:13808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799800/0x89871fc3aba1891e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044180.751529:0:13808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799800/0x89871fc3aba1891e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044180.751539:0:13808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799800/0x89871fc3aba1891e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044180.751545:0:13808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799800/0x89871fc3aba1891e lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044180.751553:0:13808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799800/0x89871fc3aba1891e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044180.751576:0:13808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3843799800 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:2.0:1784044180.751580:0:13808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799800/0x89871fc3aba1891e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044180.751586:0:13808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799800/0x89871fc3aba1891e lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044180.751597:0:13808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9b39758c1600) 00010000:00010000:2.0:1784044180.751610:0:13808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784044180.751614:0:13808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799800/0x89871fc3aba1891e lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044180.751620:0:13808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799800/0x89871fc3aba1891e lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044180.751630:0:13808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6600/0x89871fc3aba18910 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044180.751636:0:13808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6600/0x89871fc3aba18910 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044180.751641:0:13808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6600/0x89871fc3aba18910 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044180.751645:0:13808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38410b6600 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:2.0:1784044180.751648:0:13808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6600/0x89871fc3aba18910 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044180.751653:0:13808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6600/0x89871fc3aba18910 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044180.751671:0:13808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9b39758c1600) 00010000:00010000:2.0:1784044180.751673:0:13808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1784044180.751676:0:13808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6600/0x89871fc3aba18910 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044180.751682:0:13808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6600/0x89871fc3aba18910 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044180.751837:0:13808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39759b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a93fdf3c-d42f-420a-95ea-b0cbfe954363+19:11409:x1870705565174528:12345-192.168.202.40@tcp:57:lhsmtool_posix.0 Request processed in 17100us (17295us total) trans 4294967408 rc 0/0 00000100:00100000:2.0:1784044180.751846:0:13808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 139 00000020:00080000:2.0:1784044180.751853:0:13808:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1784044180.752882:0:13763:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1784044180.752888:0:13763:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1784044180.753878:0:13763:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:3.0:1784044180.753906:0:13763:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1784044180.756374:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1784044180.757465:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565174912 00000100:00100000:1.0:1784044180.757478:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565174912 00000100:00100000:1.0:1784044180.757525:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565175168 00000100:00100000:1.0:1784044180.757528:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565175168 00000100:00100000:1.0:1784044180.757546:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 31 00000100:00100000:1.0:1784044180.757555:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+20:11408:x1870705565174912:12345-192.168.202.40@tcp:49:lfs.0 00000100:00100000:1.0:1784044180.757733:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+20:11408:x1870705565174912:12345-192.168.202.40@tcp:49:lfs.0 Request processed in 178us (6427us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044180.757741:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 31 00000100:00100000:1.0:1784044180.757758:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 32 00000100:00100000:1.0:1784044180.757764:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3974226450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+19:11409:x1870705565175168:12345-192.168.202.40@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1784044180.757986:0:6515:0:(mdd_object.c:4016:mdd_close()) Object [0x200000402:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1784044180.758023:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967409 00010000:00010000:1.0:1784044180.758055:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc800/0x89871fc3aba18925 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044180.758080:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc800/0x89871fc3aba18925 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044180.758112:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc800/0x89871fc3aba18925 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044180.758120:0:6515:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc800/0x89871fc3aba18925 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044180.758125:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc800/0x89871fc3aba18925 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044180.758131:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc800/0x89871fc3aba18925 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044180.758153:0:6515:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1784044180.758218:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3974226450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+21:11409:x1870705565175168:12345-192.168.202.40@tcp:35:lhsmtool_posix.0 Request processed in 452us (1851us total) trans 4294967410 rc 0/0 00000100:00100000:1.0:1784044180.758226:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 32 00000020:00080000:1.0:1784044180.758231:0:6515:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1784044180.758658:0:10331:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784044180.758667:0:10331:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc800/0x89871fc3aba18925 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044180.758675:0:10331:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38426fc800 already unused, calling callback (ffffffffc0b56230) 00010000:00010000:3.0:1784044180.758679:0:10331:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc800/0x89871fc3aba18925 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044180.758686:0:10331:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc800/0x89871fc3aba18925 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044180.758698:0:10331:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9b39494f7700) 00010000:00010000:3.0:1784044180.758701:0:10331:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1784044180.758706:0:10331:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc800/0x89871fc3aba18925 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044180.758711:0:10331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc800/0x89871fc3aba18925 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044180.758722:0:10331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784044180.758724:0:10331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784044180.758725:0:10331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784044180.762042:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044180.762402:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565175424 00000100:00100000:2.0:1784044180.762412:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565175424 00000100:00100000:2.0:1784044180.762507:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 140 00000100:00100000:2.0:1784044180.762517:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+21:11408:x1870705565175424:12345-192.168.202.40@tcp:58:lfs.0 00000040:00080000:2.0:1784044180.762689:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:2.0:1784044180.762779:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+21:11408:x1870705565175424:12345-192.168.202.40@tcp:58:lfs.0 Request processed in 262us (746us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044180.762787:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 140 00000100:00100000:2.0:1784044180.802312:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1784044180.802559:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565175552 00000100:00100000:1.0:1784044180.802570:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565175552 00000100:00100000:1.0:1784044180.802642:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 141 00000100:00100000:1.0:1784044180.802650:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397bbbd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+21:11411:x1870705565175552:12345-192.168.202.40@tcp:101:lfs.0 00010000:00010000:1.0:1784044180.802669:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784044180.802685:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd000/0x89871fc3aba1892c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcd3dffad52ca6814 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044180.802748:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd800/0x89871fc3aba18933 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044180.802763:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd800/0x89871fc3aba18933 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044180.802782:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd800/0x89871fc3aba18933 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044180.802792:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fca00/0x89871fc3aba1893a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044180.802797:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fca00/0x89871fc3aba1893a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044180.802801:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fca00/0x89871fc3aba1893a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044180.802859:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc800/0x89871fc3aba18941 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044180.802866:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166bc00/0x89871fc3aba1884c lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca67d5 expref: 22 pid: 13808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044180.802871:0:6512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc800/0x89871fc3aba18941 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044180.802897:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166bc00/0x89871fc3aba1884c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca67d5 expref: 22 pid: 13808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044180.802907:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166bc00/0x89871fc3aba1884c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca67d5 expref: 22 pid: 13808 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044180.802916:0:6512:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b38435eca80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6512:1870705580984576:192.168.202.40@tcp:104: 00000100:00100000:1.0:1784044180.803008:0:6512:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b397ab38b40 going to sleep for 11 seconds 00000100:00100000:2.0:1784044180.809325:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044180.809495:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565175808 00000100:00100000:3.0:1784044180.809504:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565175808 00000100:00100000:3.0:1784044180.809559:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 33 00000100:00100000:3.0:1784044180.809570:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397bbbfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+23:6177:x1870705565175808:12345-192.168.202.40@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1784044180.809801:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397bbbfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+24:6177:x1870705565175808:12345-192.168.202.40@tcp:35:ldlm_bl.0 Request processed in 233us (487us total) trans 4294967411 rc 0/0 00000100:00100000:3.0:1784044180.809809:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 33 00000100:00100000:1.0:1784044180.811760:0:6512:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b38435eca80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6512:1870705580984576:192.168.202.40@tcp:104: 00010000:00010000:1.0:1784044180.811788:0:6512:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc800/0x89871fc3aba18941 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044180.812982:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1784044180.813150:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565175936 00000100:00100000:1.0:1784044180.813159:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565175936 00010000:00010000:1.0:1784044180.813267:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166bc00/0x89871fc3aba1884c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca67d5 expref: 24 pid: 13808 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044180.813474:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 84 00000100:00100000:1.0:1784044180.813486:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d82d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+24:2409:x1870705565175936:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784044180.813503:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784044180.813510:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166bc00/0x89871fc3aba1884c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca67d5 expref: 24 pid: 13808 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044180.813522:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166bc00/0x89871fc3aba1884c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca67d5 expref: 24 pid: 13808 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044180.813543:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166bc00/0x89871fc3aba1884c lrc: 0/0,0 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca67d5 expref: 24 pid: 13808 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044180.813560:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9b39758c1600) 00010000:00010000:1.0:1784044180.813566:0:6497:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc800/0x89871fc3aba18941 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044180.813576:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc800/0x89871fc3aba18941 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044180.813583:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc800/0x89871fc3aba18941 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044180.813643:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784044180.813706:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d82d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+23:2409:x1870705565175936:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 221us (730us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044180.813713:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 84 00010000:00010000:3.0:1784044180.814087:0:6512:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc800/0x89871fc3aba18941 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044180.814096:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc800/0x89871fc3aba18941 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784044180.814148:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:3.0:1784044180.814152:0:6512:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1784044180.814171:0:6512:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc800/0x89871fc3aba18941 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044180.814199:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc800/0x89871fc3aba18941 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044180.814209:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd800/0x89871fc3aba18933 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044180.814215:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd800/0x89871fc3aba18933 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044180.814221:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd800/0x89871fc3aba18933 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044180.814227:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38426fd800 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:3.0:1784044180.814232:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd800/0x89871fc3aba18933 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044180.814239:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd800/0x89871fc3aba18933 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044180.814249:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9b397aa61900) 00010000:00010000:3.0:1784044180.814252:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784044180.814256:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd800/0x89871fc3aba18933 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044180.814270:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd800/0x89871fc3aba18933 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044180.814294:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fca00/0x89871fc3aba1893a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044180.814302:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fca00/0x89871fc3aba1893a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044180.814307:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fca00/0x89871fc3aba1893a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044180.814311:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38426fca00 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:3.0:1784044180.814315:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fca00/0x89871fc3aba1893a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044180.814321:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fca00/0x89871fc3aba1893a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044180.814329:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9b3842777400) 00010000:00010000:3.0:1784044180.814331:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784044180.814334:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fca00/0x89871fc3aba1893a lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044180.814348:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fca00/0x89871fc3aba1893a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044180.814381:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd000/0x89871fc3aba1892c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6814 expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044180.814395:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc800/0x89871fc3aba18941 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6814 expref: 22 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044180.814410:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9b39758c1600) 00010000:00010000:3.0:1784044180.814413:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784044180.814415:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b38426fc800, rc 0) 00000100:00100000:3.0:1784044180.814459:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397bbbd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+22:11411:x1870705565175552:12345-192.168.202.40@tcp:101:lfs.0 Request processed in 11809us (12157us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044180.814467:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 141 00010000:00010000:2.0:1784044181.133839:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1784044181.648145:0:14263:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1784044181.648154:0:14263:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1784044181.648220:0:14263:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1784044181.648230:0:14263:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:3.0:1784044181.773308:0:13763:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1784044181.773318:0:13763:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1784044181.773353:0:13763:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1784044181.773362:0:13763:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1784044181.773501:0:13763:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d4df80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13763:1870705580984704:192.168.202.40@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1784044181.773608:0:13763:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3975b85480 going to sleep for 11 seconds 00000100:00100000:3.0:1784044181.781649:0:13763:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d4df80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13763:1870705580984704:192.168.202.40@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1784044181.793377:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044181.793459:0:13808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565176064 00000100:00100000:2.0:1784044181.793470:0:13808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565176064 00000100:00100000:2.0:1784044181.793539:0:13808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 142 00000100:00100000:2.0:1784044181.793550:0:13808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a93fdf3c-d42f-420a-95ea-b0cbfe954363+22:11423:x1870705565176064:12345-192.168.202.40@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1784044181.793614:0:13808:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1784044181.793744:0:13808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a93fdf3c-d42f-420a-95ea-b0cbfe954363+22:11423:x1870705565176064:12345-192.168.202.40@tcp:53:lhsmtool_posix.0 Request processed in 196us (378us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044181.793752:0:13808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 142 00000100:00100000:2.0:1784044181.800086:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044181.800164:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565176320 00000100:00100000:0.0:1784044181.800201:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565176320 00000100:00100000:0.0:1784044181.800257:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 143 00000100:00100000:0.0:1784044181.800274:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3945931500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+22:11423:x1870705565176320:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1784044181.800295:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784044181.800316:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7a00/0x89871fc3aba18948 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcd3dffad52ca681b expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044181.800441:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6200/0x89871fc3aba1894f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044181.800459:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6200/0x89871fc3aba1894f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044181.800472:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6200/0x89871fc3aba1894f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784044181.800483:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:0.0:1784044181.800625:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7a00/0x89871fc3aba18948 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca681b expref: 25 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044181.800642:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6200/0x89871fc3aba1894f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca681b expref: 24 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044181.800650:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9b39758c1600) 00010000:00010000:0.0:1784044181.800653:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784044181.800656:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b38410b6200, rc 0) 00000100:00100000:0.0:1784044181.800982:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3945931500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+24:11423:x1870705565176320:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 Request processed in 708us (903us total) trans 4294967412 rc 0/0 00000100:00100000:0.0:1784044181.800989:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 143 00000100:00100000:0.0:1784044181.807411:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044181.807501:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565176448 00000100:00100000:3.0:1784044181.807512:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565176448 00000100:00100000:3.0:1784044181.807578:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 9 00000100:00100000:3.0:1784044181.807588:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d83100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+24:2408:x1870705565176448:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784044181.807612:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784044181.807636:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6200/0x89871fc3aba1894f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca681b expref: 24 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044181.807655:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9b39758c1600) 00010000:00010000:3.0:1784044181.807660:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784044181.807714:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d83100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+23:2408:x1870705565176448:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 127us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044181.807735:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 9 00000100:00100000:3.0:1784044181.809439:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044181.809576:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565176704 00000100:00100000:0.0:1784044181.809606:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565176704 00000100:00100000:0.0:1784044181.809650:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 144 00000100:00100000:0.0:1784044181.809658:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+23:11423:x1870705565176704:12345-192.168.202.40@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1784044181.809738:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7c00/0x89871fc3aba1895d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044181.809757:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7c00/0x89871fc3aba1895d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044181.809770:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7c00/0x89871fc3aba1895d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044181.809928:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7c00/0x89871fc3aba1895d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044181.809936:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7c00/0x89871fc3aba1895d lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044181.809943:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7c00/0x89871fc3aba1895d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044181.809949:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38410b7c00 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:0.0:1784044181.809954:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7c00/0x89871fc3aba1895d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044181.809962:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7c00/0x89871fc3aba1895d lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044181.809974:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9b39758c1600) 00010000:00010000:0.0:1784044181.809977:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1784044181.809981:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7c00/0x89871fc3aba1895d lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044181.809998:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7c00/0x89871fc3aba1895d lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044181.810118:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+24:11423:x1870705565176704:12345-192.168.202.40@tcp:57:lhsmtool_posix.0 Request processed in 459us (686us total) trans 4294967413 rc 0/0 00000100:00100000:0.0:1784044181.810126:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 144 00000100:00100000:2.0:1784044181.821882:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000040:00080000:3.0:1784044181.821915:0:13763:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1784044181.821921:0:13763:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000100:00100000:2.0:1784044181.834802:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565176960 00000100:00100000:2.0:1784044181.834815:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565176960 00000100:00100000:2.0:1784044181.834867:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 34 00000100:00100000:2.0:1784044181.834877:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843dbd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+24:11423:x1870705565176960:12345-192.168.202.40@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1784044181.835131:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843dbd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+25:11423:x1870705565176960:12345-192.168.202.40@tcp:35:lhsmtool_posix.0 Request processed in 254us (13261us total) trans 4294967414 rc 0/0 00000100:00100000:2.0:1784044181.835138:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 34 00000040:00080000:3.0:1784044181.839640:0:13763:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1784044181.839662:0:13763:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1784044182.158618:0:10330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784044183.181391:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784044183.277815:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044183.277866:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044183.277889:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044183.277919:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044183.277940:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044183.277959:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044183.277987:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044183.278030:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565177216 00000100:00100000:0.0:1784044183.278040:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565177216 00000100:00100000:0.0:1784044183.278103:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565177728 00000100:00100000:0.0:1784044183.278106:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565177728 00000100:00100000:0.0:1784044183.278122:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565177344 00000100:00100000:0.0:1784044183.278124:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565177344 00000100:00100000:0.0:1784044183.278136:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565177856 00000100:00100000:0.0:1784044183.278138:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565177856 00000100:00100000:0.0:1784044183.278154:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 321 00000100:00100000:0.0:1784044183.278164:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+25:2407:x1870705565177216:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:1.0:1784044183.278251:0:9501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 322 00000100:00100000:1.0:1784044183.278262:0:9501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68dfcea6-5d83-4dbb-8fa3-e35542d621e5+5:2407:x1870705565177728:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:0.0:1784044183.278264:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+25:2407:x1870705565177216:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 102us (461us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044183.278271:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 321 00000100:00100000:1.0:1784044183.278289:0:9501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68dfcea6-5d83-4dbb-8fa3-e35542d621e5+5:2407:x1870705565177728:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 30us (399us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044183.278289:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 323 00000100:00100000:0.0:1784044183.278301:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843c54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+5:2407:x1870705565177344:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:0.0:1784044183.278326:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843c54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+5:2407:x1870705565177344:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 25us (385us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044183.281417:0:9501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 322 00000100:00100000:1.0:1784044183.281460:0:9501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 324 00000100:00100000:1.0:1784044183.281474:0:9501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3975b7df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68dfcea6-5d83-4dbb-8fa3-e35542d621e5+5:2407:x1870705565177856:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:1.0:1784044183.281800:0:9501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3975b7df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68dfcea6-5d83-4dbb-8fa3-e35542d621e5+5:2407:x1870705565177856:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 329us (3810us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044183.281808:0:9501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 324 00000100:00100000:1.0:1784044183.281834:0:9822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565177472 00000100:00100000:1.0:1784044183.281841:0:9822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565177472 00000100:00100000:0.0:1784044183.282013:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 323 00000100:00100000:0.0:1784044183.282042:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565177088 00000100:00100000:0.0:1784044183.282046:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565177088 00000100:00100000:0.0:1784044183.282078:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 412 00000100:00100000:0.0:1784044183.282085:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3950374450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4a09ad9-a185-4679-99bb-b6a07b865440+13:2407:x1870705565177088:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:0.0:1784044183.282112:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3950374450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4a09ad9-a185-4679-99bb-b6a07b865440+13:2407:x1870705565177088:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 28us (4194us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044183.282118:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 412 00000100:00100000:0.0:1784044183.282149:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565177600 00000100:00100000:0.0:1784044183.282153:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565177600 00000100:00100000:0.0:1784044183.282196:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 118 00000100:00100000:0.0:1784044183.282203:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843c55180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+5:2407:x1870705565177600:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:0.0:1784044183.282229:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843c55180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+5:2407:x1870705565177600:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 27us (4269us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044183.282236:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 118 00000100:00100000:1.0:1784044183.282447:0:9822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 119 00000100:00100000:1.0:1784044183.282455:0:9822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d83800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a93fdf3c-d42f-420a-95ea-b0cbfe954363+6:2407:x1870705565177472:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:1.0:1784044183.282482:0:9822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d83800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a93fdf3c-d42f-420a-95ea-b0cbfe954363+6:2407:x1870705565177472:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 28us (4625us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044183.282488:0:9822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 119 00000100:00080000:1.0:1784044183.282615:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784044183.282620:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1784044183.282622:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1784044183.282631:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:2.0:1784044183.502915:0:14315:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1784044183.502925:0:14315:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1784044183.502967:0:14315:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1784044183.502973:0:14315:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1784044183.630608:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b38420aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1870705580984832:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1784044183.630680:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044183.631149:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580984832 00000100:00100000:2.0:1784044183.631157:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580984832 00000100:00100000:2.0:1784044183.631233:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1784044183.631242:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3975b7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1870705580984832:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1784044183.631274:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:2.0:1784044183.631381:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3975b7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1870705580984832:12345-0@lo:41:osp-pre-0-1.0 Request processed in 140us (700us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044183.631387:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1784044183.631554:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b38420aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1870705580984832:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1784044183.663808:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1784044183.663844:0:9501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565178112 00000100:00100000:1.0:1784044183.663852:0:9501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565178112 00000100:00100000:1.0:1784044183.663904:0:9501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 145 00000100:00100000:1.0:1784044183.663913:0:9501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38435eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a93fdf3c-d42f-420a-95ea-b0cbfe954363+25:11443:x1870705565178112:12345-192.168.202.40@tcp:101:lfs.0 00010000:00010000:1.0:1784044183.663935:0:9501:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784044183.664020:0:9501:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc000/0x89871fc3aba18964 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcd3dffad52ca6822 expref: -99 pid: 9501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044183.664204:0:9501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fcc00/0x89871fc3aba1896b lrc: 3/1,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044183.664224:0:9501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fcc00/0x89871fc3aba1896b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044183.664238:0:9501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fcc00/0x89871fc3aba1896b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784044183.664250:0:9501:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:1.0:1784044183.664370:0:9501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc000/0x89871fc3aba18964 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6822 expref: 28 pid: 9501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044183.664385:0:9501:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fcc00/0x89871fc3aba1896b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6822 expref: 27 pid: 9501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044183.664394:0:9501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9b39758c1600) 00010000:00010000:1.0:1784044183.664396:0:9501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1784044183.664399:0:9501:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b38426fcc00, rc 0) 00000100:00100000:1.0:1784044183.664453:0:9501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38435eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a93fdf3c-d42f-420a-95ea-b0cbfe954363+27:11443:x1870705565178112:12345-192.168.202.40@tcp:101:lfs.0 Request processed in 541us (654us total) trans 4294967415 rc 0/0 00000100:00100000:1.0:1784044183.664472:0:9501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 145 00000100:00100000:1.0:1784044183.673466:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044183.673754:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565178240 00000100:00100000:0.0:1784044183.673764:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565178240 00000100:00100000:0.0:1784044183.673830:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 146 00000100:00100000:0.0:1784044183.673840:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38435ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+27:11443:x1870705565178240:12345-192.168.202.40@tcp:54:lfs.0 00010000:00010000:0.0:1784044183.673920:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7800/0x89871fc3aba18979 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044183.673938:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7800/0x89871fc3aba18979 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044183.673950:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7800/0x89871fc3aba18979 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044183.673986:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7800/0x89871fc3aba18979 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044183.673993:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7800/0x89871fc3aba18979 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044183.674000:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7800/0x89871fc3aba18979 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044183.674007:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38410b7800 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:0.0:1784044183.674011:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7800/0x89871fc3aba18979 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044183.674020:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7800/0x89871fc3aba18979 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044183.674032:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9b39758c1600) 00010000:00010000:0.0:1784044183.674047:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1784044183.674052:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7800/0x89871fc3aba18979 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044183.674059:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7800/0x89871fc3aba18979 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044183.674140:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38435ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+27:11443:x1870705565178240:12345-192.168.202.40@tcp:54:lfs.0 Request processed in 301us (683us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044183.674148:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 146 00000100:00100000:1.0:1784044183.760745:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044183.760948:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565178368 00000100:00100000:0.0:1784044183.760957:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565178368 00000100:00100000:0.0:1784044183.761052:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 56 00000100:00100000:0.0:1784044183.761063:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39503bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+6:2410:x1870705565178368:12345-192.168.202.40@tcp:101:cat.0 00010000:00010000:0.0:1784044183.761080:0:8427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784044183.761101:0:8427:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009efb7f3c/0x89871fc3aba18980 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcd3dffad52ca6829 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784044183.761128:0:8427:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 13, mtime: 0x6a565a93, atime: 0x6a565a93, ctime: 0x6a565a93, blocks: 0x8 00010000:00010000:0.0:1784044183.761148:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=376s v=(0 0) 00010000:00010000:0.0:1784044183.761153:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784044183.761163:0:8427:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009efb7f3c/0x89871fc3aba18980 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6829 expref: 7 pid: 8427 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044183.761343:0:8427:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009efb7f3c/0x89871fc3aba18980 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6829 expref: 7 pid: 8427 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044183.761357:0:8427:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b38410b7800, rc 0) 00000100:00100000:0.0:1784044183.761418:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39503bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+7:2410:x1870705565178368:12345-192.168.202.40@tcp:101:cat.0 Request processed in 357us (682us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044183.761425:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 56 00000100:00100000:3.0:1784044183.765130:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044183.765252:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565178496 00000100:00100000:2.0:1784044183.765262:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565178496 00002000:00100000:2.0:1784044183.765322:0:8433:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x4:0x0] (0->4095) req@ffff9b3843d4e300 x1870705565178496/t0(0) o3->a93fdf3c-d42f-420a-95ea-b0cbfe954363@192.168.202.40@tcp:334/0 lens 488/0 e 0 to 0 dl 1784044194 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784044183.765333:0:8433:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b3843d4e300 with x1870705565178496 ext(0->4095) 00002000:00010000:2.0:1784044183.765339:0:8433:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b3843d4e300 00000100:00100000:2.0:1784044183.765373:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 3 00000100:00100000:2.0:1784044183.765382:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d4e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+7:2409:x1870705565178496:12345-192.168.202.40@tcp:3:cat.0 00000100:00100000:2.0:1784044183.765550:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d4e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+7:2409:x1870705565178496:12345-192.168.202.40@tcp:3:cat.0 Request processed in 169us (430us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1784044183.765558:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 3 00002000:00100000:2.0:1784044183.765565:0:8433:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x4:0x0] (0->4095) req@ffff9b3843d4e300 x1870705565178496/t0(0) o3->a93fdf3c-d42f-420a-95ea-b0cbfe954363@192.168.202.40@tcp:334/0 lens 488/4536 e 0 to 0 dl 1784044194 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784044183.765582:0:8433:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b3843d4e300 with x1870705565178496 ext(0->4095) 00002000:00010000:2.0:1784044183.765586:0:8433:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b3843d4e300 00010000:00010000:3.0:1784044184.205348:0:10331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784044184.653583:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784044184.653624:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d46680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1870705580984960:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1784044184.653704:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044184.653994:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784044184.654003:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39412e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1870705580985088:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784044184.654031:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044184.654060:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580984960 00000100:00100000:0.0:1784044184.654067:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580984960 00000100:00100000:0.0:1784044184.654118:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580985088 00000100:00100000:0.0:1784044184.654121:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580985088 00000100:00100000:0.0:1784044184.654138:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1784044184.654147:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39412e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1870705580984960:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1784044184.654198:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1784044184.654239:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39412e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1870705580984960:12345-0@lo:13:osp-pre-0-1.0 Request processed in 92us (535us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044184.654247:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1784044184.654265:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1784044184.654272:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39412e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3640:x1870705580985088:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1784044184.654281:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1784044184.654309:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39412e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3640:x1870705580985088:12345-0@lo:13:osp-pre-0-0.0 Request processed in 38us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044184.654315:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00080000:0.0:1784044184.654331:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784044184.654367:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39412e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1870705580985088:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784044184.654443:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d46680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1870705580984960:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1784044184.654581:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1784044184.654591:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d46680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1870705580985216:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1784044184.654622:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044184.654745:0:7768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580985216 00000100:00100000:1.0:1784044184.654750:0:7768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580985216 00000100:00100000:1.0:1784044184.654789:0:7768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1784044184.654796:0:7768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38420ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1870705580985216:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1784044184.654818:0:7768:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1784044184.654857:0:7768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38420ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1870705580985216:12345-0@lo:41:osp-pre-1-0.0 Request processed in 61us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044184.654864:0:7768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1784044184.654893:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d46680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1870705580985216:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1784044185.230902:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784044185.678328:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784044185.678355:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39412e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1870705580985344:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1784044185.678458:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044185.678548:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843e0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1870705580985728:0@lo:400:kworker.0 00000100:00100000:3.0:1784044185.678632:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044185.678654:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3842707b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1870705580986240:0@lo:400:kworker.0 00000100:00100000:3.0:1784044185.678691:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044185.678709:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3947ee8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3638:1870705580986752:0@lo:400:kworker.0 00000100:00100000:3.0:1784044185.678733:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044185.678746:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d46680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:3640:1870705580985472:0@lo:400:kworker.0 00000100:00100000:3.0:1784044185.678763:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1784044185.678772:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843e0f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1870705580985856:0@lo:400:kworker.0 00000100:00100000:1.0:1784044185.678791:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044185.678806:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044185.678822:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397f9ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1870705580985984:0@lo:400:kworker.0 00000100:00100000:3.0:1784044185.678831:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3842707800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1870705580986368:0@lo:400:kworker.0 00000100:00100000:1.0:1784044185.678859:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044185.678865:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044185.678886:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397aa54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1870705580986496:0@lo:400:kworker.0 00000100:00100000:3.0:1784044185.678892:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3947ee8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1870705580986880:0@lo:400:kworker.0 00000100:00100000:1.0:1784044185.678926:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044185.678931:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044185.678952:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1784044185.678961:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843e0fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1870705580985600:0@lo:400:kworker.0 00000100:00100000:1.0:1784044185.678993:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044185.679008:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580985344 00000100:00100000:3.0:1784044185.679016:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580985344 00000100:00100000:1.0:1784044185.679017:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3842706a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1870705580986112:0@lo:400:kworker.0 00000100:00100000:1.0:1784044185.679043:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044185.679064:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3947ee9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3640:1870705580986624:0@lo:400:kworker.0 00000100:00100000:3.0:1784044185.679088:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1784044185.679102:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d4f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1870705580985344:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1784044185.679103:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044185.679125:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843e38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1870705580987008:0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1784044185.679136:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00080000:2.0:1784044185.679282:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784044185.679312:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580986752 00000100:00100000:2.0:1784044185.679316:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580986752 00000100:00100000:2.0:1784044185.679345:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580985856 00000100:00100000:2.0:1784044185.679349:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580985856 00000100:00100000:2.0:1784044185.679362:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580986368 00000100:00100000:2.0:1784044185.679371:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580986368 00000100:00100000:2.0:1784044185.679388:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580986496 00000100:00100000:2.0:1784044185.679391:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580986496 00000100:00100000:2.0:1784044185.679406:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580985600 00000100:00100000:2.0:1784044185.679409:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580985600 00000100:00100000:2.0:1784044185.679421:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580986624 00000100:00100000:2.0:1784044185.679423:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580986624 00000100:00100000:2.0:1784044185.679439:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 325 00000100:00100000:2.0:1784044185.679446:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1870705580986752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784044185.679488:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1870705580986752:12345-0@lo:400:kworker.0 Request processed in 43us (754us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044185.679496:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 325 00000100:00100000:2.0:1784044185.679513:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 326 00000100:00100000:2.0:1784044185.679518:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1870705580985856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784044185.679545:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1870705580985856:12345-0@lo:400:kworker.0 Request processed in 27us (741us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044185.679550:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 326 00000100:00100000:2.0:1784044185.679571:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 327 00000100:00100000:2.0:1784044185.679577:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843e3bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1870705580986368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784044185.679603:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843e3bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1870705580986368:12345-0@lo:400:kworker.0 Request processed in 27us (739us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044185.679608:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 327 00000100:00100000:2.0:1784044185.679618:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 328 00000100:00100000:2.0:1784044185.679623:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3975b53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1870705580986496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784044185.679647:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3975b53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1870705580986496:12345-0@lo:400:kworker.0 Request processed in 24us (723us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044185.679652:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 328 00000100:00100000:2.0:1784044185.679672:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 329 00000100:00100000:2.0:1784044185.679678:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3975b51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1870705580985600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784044185.679706:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3975b51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1870705580985600:12345-0@lo:400:kworker.0 Request processed in 28us (714us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044185.679711:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 329 00000100:00100000:2.0:1784044185.679722:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 330 00000100:00100000:2.0:1784044185.679727:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397f945c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1870705580986624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784044185.679752:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397f945c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1870705580986624:12345-0@lo:400:kworker.0 Request processed in 25us (653us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044185.679757:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 330 00000100:00100000:2.0:1784044185.679778:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580985728 00000100:00100000:2.0:1784044185.679782:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580985728 00000100:00100000:2.0:1784044185.679807:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580985984 00000100:00100000:2.0:1784044185.679810:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580985984 00000100:00100000:2.0:1784044185.679824:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1784044185.679830:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1870705580985728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784044185.679863:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1870705580985728:12345-0@lo:400:kworker.0 Request processed in 33us (1230us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044185.679868:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1784044185.679879:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1784044185.679884:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3975b50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1870705580985984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784044185.679910:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3975b50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1870705580985984:12345-0@lo:400:kworker.0 Request processed in 26us (1052us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044185.679916:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00080000:2.0:1784044185.679932:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1784044185.679935:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1784044185.679979:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843e0f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1870705580985856:0@lo:400:kworker.0 00000100:00100000:2.0:1784044185.679999:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3842707800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1870705580986368:0@lo:400:kworker.0 00000100:00100000:2.0:1784044185.680010:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843e0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1870705580985728:0@lo:400:kworker.0 00010000:00080000:2.0:1784044185.680024:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b3947ee8380 x1870705580986752/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044201 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784044185.680034:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3947ee8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3638:1870705580986752:0@lo:400:kworker.0 00000100:00100000:1.0:1784044185.680482:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044185.680507:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843e0fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1870705580985600:0@lo:400:kworker.0 00000100:00100000:1.0:1784044185.680515:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3947ee9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3640:1870705580986624:0@lo:400:kworker.0 00000100:00100000:1.0:1784044185.680523:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397f9ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1870705580985984:0@lo:400:kworker.0 00010000:00080000:1.0:1784044185.680534:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b397aa54380 x1870705580986496/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044201 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784044185.680544:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397aa54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1870705580986496:0@lo:400:kworker.0 00000100:00100000:1.0:1784044185.680595:0:9822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580986240 00000100:00100000:1.0:1784044185.680599:0:9822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580986240 00000100:00100000:1.0:1784044185.680624:0:9822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580986880 00000100:00100000:1.0:1784044185.680627:0:9822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580986880 00000100:00100000:1.0:1784044185.680642:0:9822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580986112 00000100:00100000:1.0:1784044185.680644:0:9822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580986112 00000100:00100000:1.0:1784044185.680652:0:9822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1784044185.680655:0:9822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3638:x1870705580986240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044185.680679:0:9822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3638:x1870705580986240:12345-0@lo:400:kworker.0 Request processed in 24us (1989us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044185.680683:0:9822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1784044185.680691:0:9822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1784044185.680694:0:9822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843e39500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3638:x1870705580986880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044185.680709:0:9822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843e39500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3638:x1870705580986880:12345-0@lo:400:kworker.0 Request processed in 15us (1782us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044185.680712:0:9822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1784044185.680725:0:9822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1784044185.680728:0:9822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397f947100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3640:x1870705580986112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044185.680748:0:9822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397f947100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3640:x1870705580986112:12345-0@lo:400:kworker.0 Request processed in 20us (1706us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044185.680752:0:9822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00080000:1.0:1784044185.680776:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784044185.680787:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3842706a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1870705580986112:0@lo:400:kworker.0 00000100:00100000:1.0:1784044185.680808:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580987008 00000100:00100000:1.0:1784044185.680810:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580987008 00000100:00100000:1.0:1784044185.680825:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1784044185.680828:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38436a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3640:x1870705580987008:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1784044185.680838:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784044185.680859:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38436a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3640:x1870705580987008:12345-0@lo:13:osp-pre-1-0.0 Request processed in 31us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044185.680863:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1784044185.680880:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843e38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1870705580987008:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784044185.682486:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580985472 00000100:00100000:0.0:1784044185.682526:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580985472 00000100:00100000:0.0:1784044185.682613:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 413 00000100:00100000:0.0:1784044185.682622:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3950376850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+24:3640:x1870705580985472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784044185.682740:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3950376850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+24:3640:x1870705580985472:12345-0@lo:400:kworker.0 Request processed in 119us (3950us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044185.682748:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 413 00000100:00100000:0.0:1784044185.682832:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d46680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:3640:1870705580985472:0@lo:400:kworker.0 00000100:00100000:3.0:1784044185.683850:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d4f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1870705580985344:12345-0@lo:13:osp-pre-1-1.0 Request processed in 4749us (5389us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044185.683863:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1784044185.690354:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39412e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1870705580985344:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1784044185.690408:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3947ee8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1870705580986880:0@lo:400:kworker.0 00000100:00100000:2.0:1784044185.690422:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3842707b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1870705580986240:0@lo:400:kworker.0 00000040:00080000:1.0:1784044185.933391:0:13763:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1784044185.933573:0:13763:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1784044185.933597:0:13763:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1784044185.933606:0:13763:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1784044186.254529:0:10330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1784044186.708371:0:9505:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00000001:00080000:0.0:1784044186.711560:0:8421:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967313 is committed 00000001:00080000:0.0:1784044186.711581:0:8421:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967312 is committed 00000001:00080000:1.0:1784044186.712749:0:6490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967415 is committed 00000020:00080000:1.0:1784044186.712791:0:6490:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9b397ab38a80 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:1.0:1784044186.712797:0:6490:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9b3843436800 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9b397ab38c00 00000020:00080000:1.0:1784044186.712801:0:6490:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9b3843436c00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9b397f940000 00000020:00080000:1.0:1784044186.712828:0:6490:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000020:00080000:3.0:1784044186.713446:0:6544:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:3.0:1784044186.713588:0:6544:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00010000:00010000:2.0:1784044186.722522:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798200/0x89871fc3aba188fb lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044186.722539:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798200/0x89871fc3aba188fb lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044186.722557:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798200/0x89871fc3aba188fb lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044186.722563:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3843798200 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:2.0:1784044186.722569:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798200/0x89871fc3aba188fb lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044186.722576:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798200/0x89871fc3aba188fb lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044186.722594:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9b39494f7700) 00010000:00010000:2.0:1784044186.722617:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784044186.722622:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798200/0x89871fc3aba188fb lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044186.722629:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798200/0x89871fc3aba188fb lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1784044187.046087:0:13804:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1784044187.283535:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784044188.311162:0:10331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784044188.392586:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044188.392688:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044188.392719:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1784044188.392763:0:9822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565179008 00000100:00100000:1.0:1784044188.392785:0:9822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565179008 00000100:00100000:1.0:1784044188.392858:0:9822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 123 00000100:00100000:1.0:1784044188.392869:0:9822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397f9e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a93fdf3c-d42f-420a-95ea-b0cbfe954363+6:2409:x1870705565179008:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:1.0:1784044188.392963:0:9822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397f9e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a93fdf3c-d42f-420a-95ea-b0cbfe954363+6:2409:x1870705565179008:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 95us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044188.392972:0:9822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 123 00000100:00080000:1.0:1784044188.393013:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784044188.400887:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044188.400920:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044188.402878:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565178752 00000100:00100000:2.0:1784044188.402894:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565178752 00000100:00080000:0.0:1784044188.403240:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784044188.403304:0:13808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565179264 00000100:00100000:0.0:1784044188.403309:0:13808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565179264 00000100:00100000:0.0:1784044188.403337:0:13808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565178880 00000100:00100000:0.0:1784044188.403340:0:13808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565178880 00000100:00100000:0.0:1784044188.403363:0:13808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 331 00000100:00100000:0.0:1784044188.403372:0:13808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843e38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a93fdf3c-d42f-420a-95ea-b0cbfe954363+13:2409:x1870705565178752:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:0.0:1784044188.403448:0:13808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843e38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a93fdf3c-d42f-420a-95ea-b0cbfe954363+13:2409:x1870705565178752:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 76us (10876us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044188.403457:0:13808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 331 00000100:00100000:2.0:1784044188.403472:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 332 00000100:00100000:0.0:1784044188.403476:0:13808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 333 00000100:00100000:2.0:1784044188.403481:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397f9e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68dfcea6-5d83-4dbb-8fa3-e35542d621e5+5:2409:x1870705565179264:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:0.0:1784044188.403481:0:13808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397a8a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a93fdf3c-d42f-420a-95ea-b0cbfe954363+5:2409:x1870705565178880:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:0.0:1784044188.407868:0:13808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397a8a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a93fdf3c-d42f-420a-95ea-b0cbfe954363+5:2409:x1870705565178880:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 4375us (6937us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044188.407876:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397f9e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68dfcea6-5d83-4dbb-8fa3-e35542d621e5+5:2409:x1870705565179264:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 4397us (15155us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044188.407884:0:13808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 333 00000100:00080000:0.0:1784044188.408466:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1784044188.408473:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784044188.411078:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044188.411248:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044188.411388:0:9501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565179392 00000100:00100000:3.0:1784044188.411402:0:9501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565179392 00000100:00100000:2.0:1784044188.412885:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 332 00000100:00100000:1.0:1784044188.413785:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565179136 00000100:00100000:1.0:1784044188.413800:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565179136 00000100:00100000:1.0:1784044188.413873:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 124 00000100:00100000:1.0:1784044188.413885:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397a8a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+5:2409:x1870705565179136:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:3.0:1784044188.414208:0:9501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 334 00000100:00100000:3.0:1784044188.414220:0:9501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3943eb3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68dfcea6-5d83-4dbb-8fa3-e35542d621e5+5:2409:x1870705565179392:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:1.0:1784044188.414311:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397a8a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+5:2409:x1870705565179136:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 429us (3241us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044188.414320:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 124 00000100:00100000:3.0:1784044188.414439:0:9501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3943eb3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68dfcea6-5d83-4dbb-8fa3-e35542d621e5+5:2409:x1870705565179392:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 223us (3191us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044188.414447:0:9501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 334 00000100:00100000:3.0:1784044188.414488:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565178624 00000100:00100000:3.0:1784044188.414493:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565178624 00000100:00100000:3.0:1784044188.414579:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 414 00000100:00100000:3.0:1784044188.414587:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3950374850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4a09ad9-a185-4679-99bb-b6a07b865440+13:2409:x1870705565178624:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:3.0:1784044188.414632:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3950374850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4a09ad9-a185-4679-99bb-b6a07b865440+13:2409:x1870705565178624:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 46us (13754us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044188.414639:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 414 00000100:00080000:3.0:1784044188.414908:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1784044188.414914:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1784044188.750879:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b38420aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1870705580987136:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1784044188.750971:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044188.751076:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580987136 00000100:00100000:1.0:1784044188.751084:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580987136 00000100:00100000:1.0:1784044188.751137:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:1.0:1784044188.751146:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39412eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1870705580987136:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1784044188.751202:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:1.0:1784044188.754789:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39412eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1870705580987136:12345-0@lo:41:osp-pre-0-1.0 Request processed in 3631us (3806us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044188.754804:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1784044188.755582:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b38420aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1870705580987136:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1784044189.295009:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1784044189.295222:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565179520 00000100:00100000:1.0:1784044189.295231:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565179520 00000100:00100000:1.0:1784044189.295298:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 147 00000100:00100000:1.0:1784044189.295309:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3943eb1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+13:11096:x1870705565179520:12345-192.168.202.40@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1784044189.295688:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3943eb1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+13:11096:x1870705565179520:12345-192.168.202.40@tcp:60:lhsmtool_posix.0 Request processed in 381us (687us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044189.295696:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 147 00000100:00100000:3.0:1784044189.302857:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044189.302973:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565179648 00000100:00100000:2.0:1784044189.302983:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565179648 00000100:00100000:2.0:1784044189.303041:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 148 00000100:00100000:2.0:1784044189.303051:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3943eb1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+5:11096:x1870705565179648:12345-192.168.202.40@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1784044189.303545:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3943eb1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+5:11096:x1870705565179648:12345-192.168.202.40@tcp:60:lhsmtool_posix.0 Request processed in 493us (697us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044189.303555:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 148 00000100:00100000:2.0:1784044189.317848:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044189.317975:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565179904 00000100:00100000:0.0:1784044189.317990:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565179904 00000100:00100000:0.0:1784044189.318067:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 35 00000100:00100000:0.0:1784044189.318087:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38420aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+13:11096:x1870705565179904:12345-192.168.202.40@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1784044189.318797:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38420aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+14:11096:x1870705565179904:12345-192.168.202.40@tcp:35:lhsmtool_posix.0 Request processed in 717us (956us total) trans 4294967416 rc 0/0 00000100:00100000:0.0:1784044189.318809:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 35 00010000:00010000:2.0:1784044189.325769:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784044189.774275:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b38436a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1870705580987264:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1784044189.774361:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044189.775096:0:7768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580987264 00000100:00100000:1.0:1784044189.775104:0:7768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580987264 00000100:00100000:1.0:1784044189.775150:0:7768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:1.0:1784044189.775160:0:7768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843736300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1870705580987264:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1784044189.775218:0:7768:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1784044189.775269:0:7768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843736300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1870705580987264:12345-0@lo:41:osp-pre-1-0.0 Request processed in 110us (908us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044189.775276:0:7768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:1.0:1784044189.775351:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b38436a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1870705580987264:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1784044189.775370:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784044189.775376:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3842707b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1870705580987392:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1784044189.775407:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044189.775442:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580987392 00000100:00100000:1.0:1784044189.775446:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580987392 00000100:00100000:1.0:1784044189.775481:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1784044189.775488:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3842707800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1870705580987392:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1784044189.775507:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1784044189.775555:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3842707800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1870705580987392:12345-0@lo:13:osp-pre-0-1.0 Request processed in 68us (147us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044189.775562:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1784044189.775594:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3842707b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1870705580987392:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1784044189.775842:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784044189.776216:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3943eb3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1870705580987520:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784044189.776263:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044189.776988:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580987520 00000100:00100000:3.0:1784044189.776996:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580987520 00000100:00100000:3.0:1784044189.777065:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1784044189.777074:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3842707b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1870705580987520:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1784044189.777091:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1784044189.777146:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3842707b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1870705580987520:12345-0@lo:13:osp-pre-0-0.0 Request processed in 73us (881us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044189.777153:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1784044189.777260:0:3640:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967313 gen 2 00000004:00080000:2.0:1784044189.777266:0:3640:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b38427b5500, transno 4294967311 00000004:00080000:2.0:1784044189.777295:0:3640:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967313 committed transno 4294967313 00000100:00100000:2.0:1784044189.777338:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3943eb3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1870705580987520:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1784044189.777771:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784044189.825810:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044189.825974:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565180032 00000100:00100000:0.0:1784044189.825985:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565180032 00000100:00100000:0.0:1784044189.826062:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 149 00000100:00100000:0.0:1784044189.826726:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3943eb2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68dfcea6-5d83-4dbb-8fa3-e35542d621e5+5:11902:x1870705565180032:12345-192.168.202.40@tcp:101:lsof.0 00010000:00010000:0.0:1784044189.826756:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784044189.826783:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6800/0x89871fc3aba18987 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcd3dffad52ca6830 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044189.826868:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7a00/0x89871fc3aba1898e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044189.826883:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7a00/0x89871fc3aba1898e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044189.826896:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7a00/0x89871fc3aba1898e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784044189.826954:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1784044189.826975:0:6512:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1784044189.827032:0:6512:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7a00/0x89871fc3aba1898e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044189.827062:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6800/0x89871fc3aba18987 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6830 expref: 7 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044189.827082:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7a00/0x89871fc3aba1898e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6830 expref: 6 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044189.827103:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b39758c1000) 00010000:00010000:0.0:1784044189.827107:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1784044189.827111:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b38410b7a00, rc 0) 00000100:00100000:0.0:1784044189.827218:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3943eb2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68dfcea6-5d83-4dbb-8fa3-e35542d621e5+6:11902:x1870705565180032:12345-192.168.202.40@tcp:101:lsof.0 Request processed in 1146us (1418us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044189.827225:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 149 00010000:00010000:2.0:1784044190.349386:0:10330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784044190.798258:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784044190.798287:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3943eb3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1870705580987648:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784044190.798360:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044190.798437:0:10713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580987648 00000100:00100000:3.0:1784044190.798444:0:10713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580987648 00000100:00100000:3.0:1784044190.798519:0:10713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1784044190.798530:0:10713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38427b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1870705580987648:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1784044190.798564:0:10713:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784044190.798625:0:10713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38427b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1870705580987648:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044190.798642:0:10713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1784044190.798690:0:3640:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967305 gen 2 00000004:00080000:3.0:1784044190.798695:0:3640:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b3843d82300, transno 4294967305 00000100:00100000:3.0:1784044190.798778:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3943eb3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1870705580987648:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1784044190.799270:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784044190.799737:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39412e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3639:1870705580987904:0@lo:400:kworker.0 00000100:00100000:2.0:1784044190.799790:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044190.799816:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1870705580988416:0@lo:400:kworker.0 00000100:00100000:2.0:1784044190.799842:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044190.799860:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3639:1870705580988928:0@lo:400:kworker.0 00000100:00100000:2.0:1784044190.799879:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044190.799955:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580987904 00000100:00100000:2.0:1784044190.799961:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580987904 00000100:00100000:2.0:1784044190.799998:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580988928 00000100:00100000:2.0:1784044190.800001:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580988928 00000100:00100000:2.0:1784044190.800026:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 335 00000100:00100000:2.0:1784044190.800032:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1870705580987904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784044190.800280:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39412e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:3638:1870705580987776:0@lo:400:kworker.0 00000100:00100000:0.0:1784044190.800318:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044190.800345:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d3df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1870705580988288:0@lo:400:kworker.0 00000100:00100000:0.0:1784044190.800369:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044190.800388:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d3c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1870705580988800:0@lo:400:kworker.0 00000100:00100000:0.0:1784044190.800410:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044190.800441:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580987776 00000100:00100000:0.0:1784044190.800445:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580987776 00000100:00100000:3.0:1784044190.800887:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3943eb3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1870705580989312:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1784044190.800922:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044190.800955:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580989312 00000100:00100000:3.0:1784044190.800959:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580989312 00000100:00100000:3.0:1784044190.800995:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1784044190.801002:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843ce6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1870705580989312:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1784044190.801018:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784044190.801057:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843ce6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1870705580989312:12345-0@lo:13:osp-pre-1-1.0 Request processed in 55us (134us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044190.801065:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1784044190.801313:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1870705580987904:12345-0@lo:400:kworker.0 Request processed in 43us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044190.801322:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 335 00000100:00100000:2.0:1784044190.801340:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580988800 00000100:00100000:2.0:1784044190.801344:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580988800 00000100:00100000:2.0:1784044190.801363:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 336 00000100:00100000:0.0:1784044190.801764:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 415 00000100:00100000:0.0:1784044190.801773:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3950377850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+24:3638:x1870705580987776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784044190.801832:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3950377850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+24:3638:x1870705580987776:12345-0@lo:400:kworker.0 Request processed in 60us (1514us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044190.801839:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 415 00000100:00100000:0.0:1784044190.801871:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580988288 00000100:00100000:0.0:1784044190.801876:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580988288 00000100:00100000:0.0:1784044190.801903:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:0.0:1784044190.801911:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1870705580988288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784044190.801945:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1870705580988288:12345-0@lo:400:kworker.0 Request processed in 35us (1574us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044190.801951:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:0.0:1784044190.801973:0:13808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 337 00000100:00100000:0.0:1784044190.801980:0:13808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1870705580988800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784044190.802011:0:13808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1870705580988800:12345-0@lo:400:kworker.0 Request processed in 31us (1599us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044190.802017:0:13808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 337 00000100:00100000:0.0:1784044190.802050:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3641:1870705580988160:0@lo:400:kworker.0 00000100:00100000:2.0:1784044190.802230:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843cfd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1870705580988928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784044190.802272:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843cfd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1870705580988928:12345-0@lo:400:kworker.0 Request processed in 903us (2391us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044190.802278:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 336 00000100:00100000:2.0:1784044190.802302:0:9822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580988416 00000100:00100000:2.0:1784044190.802314:0:9822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580988416 00000100:00100000:2.0:1784044190.802342:0:9822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1784044190.802349:0:9822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d2d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3639:x1870705580988416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784044190.802388:0:9822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d2d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3639:x1870705580988416:12345-0@lo:400:kworker.0 Request processed in 40us (2546us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044190.802394:0:9822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1784044190.802444:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39412e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3639:1870705580987904:0@lo:400:kworker.0 00000100:00100000:3.0:1784044190.802597:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3943eb3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1870705580989312:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1784044190.802609:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39412e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:3638:1870705580987776:0@lo:400:kworker.0 00000100:00080000:1.0:1784044190.802859:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1784044190.802864:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784044190.802867:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784044190.802897:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d46680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1870705580988032:0@lo:400:kworker.0 00000100:00100000:1.0:1784044190.802932:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044190.802954:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1870705580988544:0@lo:400:kworker.0 00000100:00100000:1.0:1784044190.802975:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044190.802990:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d3d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3640:1870705580989056:0@lo:400:kworker.0 00000100:00100000:1.0:1784044190.803011:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044190.803042:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580988032 00000100:00100000:1.0:1784044190.803047:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580988032 00000100:00100000:3.0:1784044190.803238:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d3df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1870705580988288:0@lo:400:kworker.0 00010000:00080000:3.0:1784044190.803253:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b3843d3c000 x1870705580988800/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044206 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784044190.803263:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d3c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1870705580988800:0@lo:400:kworker.0 00000100:00100000:3.0:1784044190.803324:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:3.0:1784044190.803331:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3842706a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1870705580988032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044190.803385:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3842706a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1870705580988032:12345-0@lo:400:kworker.0 Request processed in 54us (451us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044190.803391:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:3.0:1784044190.803412:0:13808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580989056 00000100:00100000:3.0:1784044190.803416:0:13808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580989056 00000100:00100000:3.0:1784044190.803449:0:13808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 338 00000100:00100000:1.0:1784044190.803548:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580988544 00000100:00100000:1.0:1784044190.803552:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580988544 00000100:00100000:1.0:1784044190.803576:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1784044190.803581:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38436a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1870705580988544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784044190.803711:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1870705580988416:0@lo:400:kworker.0 00000100:00100000:2.0:1784044190.803728:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3639:1870705580988928:0@lo:400:kworker.0 00000100:00100000:1.0:1784044190.803806:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38436a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1870705580988544:12345-0@lo:400:kworker.0 Request processed in 31us (636us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044190.803813:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00080000:1.0:1784044190.803829:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1784044190.803847:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d46680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1870705580988032:0@lo:400:kworker.0 00000100:00100000:1.0:1784044190.803857:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1870705580988544:0@lo:400:kworker.0 00000100:00100000:0.0:1784044190.804307:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044190.804335:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3641:1870705580988672:0@lo:400:kworker.0 00000100:00100000:0.0:1784044190.804367:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044190.804387:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1870705580989184:0@lo:400:kworker.0 00000100:00100000:0.0:1784044190.804409:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044190.804443:0:9822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580989184 00000100:00100000:0.0:1784044190.804447:0:9822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580989184 00000100:00100000:0.0:1784044190.804479:0:9822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1784044190.804486:0:9822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d3dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3641:x1870705580989184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784044190.804548:0:9822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d3dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3641:x1870705580989184:12345-0@lo:400:kworker.0 Request processed in 63us (138us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044190.804554:0:9822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1784044190.804592:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1870705580989184:0@lo:400:kworker.0 00000100:00100000:1.0:1784044190.804681:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580988160 00000100:00100000:1.0:1784044190.804685:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580988160 00000100:00100000:1.0:1784044190.804718:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580988672 00000100:00100000:1.0:1784044190.804721:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580988672 00000100:00100000:1.0:1784044190.804750:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 339 00000100:00100000:1.0:1784044190.804763:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1870705580988160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044190.804799:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1870705580988160:12345-0@lo:400:kworker.0 Request processed in 37us (492us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044190.804805:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 339 00000100:00100000:1.0:1784044190.804819:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 340 00000100:00100000:1.0:1784044190.804825:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1870705580988672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044190.804851:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1870705580988672:12345-0@lo:400:kworker.0 Request processed in 27us (483us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044190.804857:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 340 00000100:00080000:1.0:1784044190.804872:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784044190.805292:0:13808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397aa54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1870705580989056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044190.805343:0:13808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397aa54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1870705580989056:12345-0@lo:400:kworker.0 Request processed in 1887us (2329us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044190.805350:0:13808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 338 00010000:00080000:1.0:1784044190.805731:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b3843d3d880 x1870705580989056/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044206 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784044190.805744:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d3d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3640:1870705580989056:0@lo:400:kworker.0 00000100:00100000:0.0:1784044190.806340:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3641:1870705580988160:0@lo:400:kworker.0 00000100:00100000:0.0:1784044190.806353:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3641:1870705580988672:0@lo:400:kworker.0 00010000:00010000:2.0:1784044191.375553:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784044192.401733:0:10331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1784044192.859474:0:6490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967416 is committed 00000020:00080000:1.0:1784044192.859499:0:6490:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:2.0:1784044192.860507:0:6544:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:2.0:1784044192.860523:0:6544:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00010000:00010000:0.0:1784044193.434962:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784044193.512870:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044193.512923:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044193.512953:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044193.512985:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044193.513002:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044193.513022:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044193.513076:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044193.513112:0:13808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565180416 00000100:00100000:3.0:1784044193.513124:0:13808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565180416 00000100:00100000:3.0:1784044193.513225:0:13808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565180928 00000100:00100000:3.0:1784044193.513241:0:13808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565180928 00000100:00100000:3.0:1784044193.513261:0:13808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565180288 00000100:00100000:3.0:1784044193.513264:0:13808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565180288 00000100:00100000:3.0:1784044193.513280:0:13808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565180800 00000100:00100000:3.0:1784044193.513282:0:13808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565180800 00000100:00100000:3.0:1784044193.513303:0:13808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 341 00000100:00100000:3.0:1784044193.513314:0:13808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843ce7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a93fdf3c-d42f-420a-95ea-b0cbfe954363+5:2407:x1870705565180416:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:1.0:1784044193.513527:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565180160 00000100:00100000:1.0:1784044193.513533:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565180160 00000100:00100000:1.0:1784044193.513578:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 416 00000100:00100000:1.0:1784044193.513587:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3950375050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4a09ad9-a185-4679-99bb-b6a07b865440+13:2407:x1870705565180160:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:1.0:1784044193.513685:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3950375050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4a09ad9-a185-4679-99bb-b6a07b865440+13:2407:x1870705565180160:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 99us (832us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044193.513693:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 416 00000100:00100000:1.0:1784044193.513750:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 342 00000100:00100000:1.0:1784044193.513757:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39412e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68dfcea6-5d83-4dbb-8fa3-e35542d621e5+5:2407:x1870705565180928:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:1.0:1784044193.513801:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39412e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68dfcea6-5d83-4dbb-8fa3-e35542d621e5+5:2407:x1870705565180928:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 44us (815us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044193.513808:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 342 00000100:00100000:1.0:1784044193.513827:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 343 00000100:00100000:1.0:1784044193.513834:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3943eb3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+13:2407:x1870705565180288:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:1.0:1784044193.513864:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3943eb3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+13:2407:x1870705565180288:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 31us (861us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044193.513870:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 343 00000100:00100000:1.0:1784044193.513881:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 344 00000100:00100000:1.0:1784044193.513886:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3844535f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68dfcea6-5d83-4dbb-8fa3-e35542d621e5+6:2407:x1870705565180800:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:1.0:1784044193.513911:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3844535f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68dfcea6-5d83-4dbb-8fa3-e35542d621e5+6:2407:x1870705565180800:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 24us (836us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044193.513916:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 344 00000100:00100000:1.0:1784044193.513939:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565180672 00000100:00100000:1.0:1784044193.513942:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565180672 00000100:00100000:1.0:1784044193.513968:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565180544 00000100:00100000:1.0:1784044193.513971:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565180544 00000100:00100000:1.0:1784044193.513991:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 128 00000100:00100000:1.0:1784044193.513996:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39412e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+5:2407:x1870705565180672:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:1.0:1784044193.514021:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39412e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+5:2407:x1870705565180672:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 25us (1068us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044193.514027:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 128 00000100:00100000:1.0:1784044193.514037:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 129 00000100:00100000:1.0:1784044193.514043:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843caf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+6:2407:x1870705565180544:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:1.0:1784044193.514074:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843caf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+6:2407:x1870705565180544:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 31us (1051us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044193.514080:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 129 00000100:00080000:1.0:1784044193.514097:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1784044193.514101:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784044193.514104:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1784044193.514107:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1784044193.514500:0:13808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843ce7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a93fdf3c-d42f-420a-95ea-b0cbfe954363+5:2407:x1870705565180416:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 1173us (1562us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044193.514518:0:13808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 341 00000100:00100000:1.0:1784044193.870792:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784044193.870829:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1870705580989440:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1784044193.870944:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044193.872591:0:7768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580989440 00000100:00100000:0.0:1784044193.872611:0:7768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580989440 00000100:00100000:0.0:1784044193.872684:0:7768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:0.0:1784044193.872697:0:7768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1870705580989440:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1784044193.872753:0:7768:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:0.0:1784044193.872854:0:7768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1870705580989440:12345-0@lo:41:osp-pre-0-1.0 Request processed in 159us (1909us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044193.872862:0:7768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:0.0:1784044193.872930:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1870705580989440:0@lo:41:osp-pre-0-1.0 00000001:02000400:0.0:1784044194.152563:0:14513:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 11:49:51 (1784044191) 00010000:00010000:2.0:1784044194.455105:0:10330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784044194.898657:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1870705580989696:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1784044194.898759:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044194.898860:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784044194.898867:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397f9ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1870705580989568:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1784044194.898902:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044194.901502:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580989568 00000100:00100000:3.0:1784044194.901517:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580989568 00000100:00100000:3.0:1784044194.901604:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1784044194.901621:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1870705580989568:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1784044194.901663:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1784044194.901774:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1870705580989568:12345-0@lo:13:osp-pre-0-1.0 Request processed in 159us (2869us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044194.901783:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1784044194.901860:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397f9ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1870705580989568:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1784044194.902111:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3844534700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1870705580989824:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784044194.902232:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044194.902458:0:10713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580989824 00000100:00100000:3.0:1784044194.902465:0:10713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580989824 00000100:00100000:3.0:1784044194.902523:0:10713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1784044194.902532:0:10713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1870705580989824:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1784044194.902549:0:10713:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1784044194.902600:0:10713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1870705580989824:12345-0@lo:13:osp-pre-0-0.0 Request processed in 69us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044194.902608:0:10713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1784044194.903068:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3844534700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1870705580989824:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784044194.904382:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580989696 00000100:00100000:1.0:1784044194.904395:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580989696 00000100:00100000:1.0:1784044194.904486:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:1.0:1784044194.904498:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1870705580989696:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1784044194.904547:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1784044194.904657:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1870705580989696:12345-0@lo:41:osp-pre-1-0.0 Request processed in 160us (5896us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044194.904665:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00080000:1.0:1784044194.904695:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784044194.906147:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1870705580989696:0@lo:41:osp-pre-1-0.0 00000040:00080000:1.0:1784044195.149613:0:13763:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1784044195.149627:0:13763:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1784044195.149777:0:13763:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 1 00000040:00080000:1.0:1784044195.149786:0:13763:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1784044195.479294:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784044195.709308:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044195.709588:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565181184 00000100:00100000:2.0:1784044195.709602:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565181184 00000100:00100000:2.0:1784044195.709690:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 150 00000100:00100000:2.0:1784044195.709704:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397f9ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+13:12169:x1870705565181184:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1784044195.709734:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784044195.709767:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799c00/0x89871fc3aba18995 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcd3dffad52ca6837 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044195.710643:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798000/0x89871fc3aba1899c lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044195.710679:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798000/0x89871fc3aba1899c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044195.710715:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798000/0x89871fc3aba1899c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044195.710957:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799a00/0x89871fc3aba189a3 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044195.710983:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799a00/0x89871fc3aba189a3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044195.710999:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799a00/0x89871fc3aba189a3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1784044195.711201:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1784044195.711273:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799400/0x89871fc3aba189aa lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044195.711284:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799400/0x89871fc3aba189aa lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044195.711700:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799400/0x89871fc3aba189aa lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784044195.711715:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:2.0:1784044195.711817:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798000/0x89871fc3aba1899c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044195.711825:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798000/0x89871fc3aba1899c lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044195.711831:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798000/0x89871fc3aba1899c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044195.711837:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3843798000 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:2.0:1784044195.712072:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798000/0x89871fc3aba1899c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044195.712082:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798000/0x89871fc3aba1899c lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044195.712096:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9b396f2a8100) 00010000:00010000:2.0:1784044195.712099:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784044195.712104:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798000/0x89871fc3aba1899c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044195.712120:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798000/0x89871fc3aba1899c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044195.712136:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799a00/0x89871fc3aba189a3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044195.712143:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799a00/0x89871fc3aba189a3 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044195.712148:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799a00/0x89871fc3aba189a3 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044195.712154:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3843799a00 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:2.0:1784044195.712156:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799a00/0x89871fc3aba189a3 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044195.712161:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799a00/0x89871fc3aba189a3 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044195.712168:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9b397b61bc00) 00010000:00010000:2.0:1784044195.712170:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784044195.712235:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799a00/0x89871fc3aba189a3 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044195.712241:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799a00/0x89871fc3aba189a3 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044195.712590:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799c00/0x89871fc3aba18995 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6837 expref: 16 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044195.712610:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799400/0x89871fc3aba189aa lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6837 expref: 15 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044195.713080:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9b396f2a8900) 00010000:00010000:2.0:1784044195.713083:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784044195.713086:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3843799400, rc 0) 00000100:00100000:2.0:1784044195.713491:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397f9ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+15:12169:x1870705565181184:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 Request processed in 3786us (4204us total) trans 4294967417 rc 0/0 00000100:00100000:2.0:1784044195.713501:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 150 00000100:00100000:0.0:1784044195.717933:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044195.718051:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044195.718740:0:13808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565181312 00000100:00100000:3.0:1784044195.718756:0:13808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565181312 00000100:00100000:3.0:1784044195.718848:0:13808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 151 00000100:00100000:3.0:1784044195.718860:0:13808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a93fdf3c-d42f-420a-95ea-b0cbfe954363+15:12169:x1870705565181312:12345-192.168.202.40@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1784044195.719123:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565181440 00000100:00100000:1.0:1784044195.719140:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565181440 00000100:00100000:3.0:1784044195.719477:0:13808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a93fdf3c-d42f-420a-95ea-b0cbfe954363+16:12169:x1870705565181312:12345-192.168.202.40@tcp:59:lhsmtool_posix.0 Request processed in 607us (1559us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044195.719716:0:13808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 151 00000100:00100000:1.0:1784044195.719809:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 10 00000100:00100000:1.0:1784044195.719839:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d3f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+15:2408:x1870705565181440:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784044195.719925:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784044195.719954:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799400/0x89871fc3aba189aa lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6837 expref: 15 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044195.719975:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9b396f2a8900) 00010000:00010000:1.0:1784044195.719980:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784044195.720038:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d3f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+14:2408:x1870705565181440:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 203us (1986us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044195.720045:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 10 00000100:00100000:1.0:1784044195.726046:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044195.726490:0:9501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565181568 00000100:00100000:3.0:1784044195.726503:0:9501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565181568 00000100:00080000:1.0:1784044195.726659:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1784044195.727755:0:9501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 152 00000100:00100000:3.0:1784044195.727774:0:9501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3947ee8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a93fdf3c-d42f-420a-95ea-b0cbfe954363+5:12169:x1870705565181568:12345-192.168.202.40@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1784044195.728532:0:9501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3947ee8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a93fdf3c-d42f-420a-95ea-b0cbfe954363+5:12169:x1870705565181568:12345-192.168.202.40@tcp:59:lhsmtool_posix.0 Request processed in 761us (2491us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044195.728550:0:9501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 152 00000100:00100000:1.0:1784044195.918898:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784044195.918937:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3947ee8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1870705580989952:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784044195.919039:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044195.919130:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580989952 00000100:00100000:1.0:1784044195.919140:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580989952 00000100:00100000:1.0:1784044195.919249:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1784044195.919262:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3947ee9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1870705580989952:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1784044195.919311:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784044195.919369:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3947ee9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1870705580989952:12345-0@lo:13:osp-pre-1-0.0 Request processed in 111us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044195.919377:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00080000:1.0:1784044195.919404:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784044195.919451:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3947ee8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1870705580989952:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784044195.924906:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1784044195.924952:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3947ee8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1870705580990080:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1784044195.925058:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044195.926417:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843cfc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:3641:1870705580990208:0@lo:400:kworker.0 00000100:00100000:1.0:1784044195.926496:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044195.926761:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580990208 00000100:00100000:0.0:1784044195.926773:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580990208 00000100:00100000:0.0:1784044195.926849:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 417 00000100:00100000:0.0:1784044195.926860:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3950377050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+24:3641:x1870705580990208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044195.927108:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580990080 00000100:00100000:3.0:1784044195.927114:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580990080 00000100:00100000:3.0:1784044195.927164:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1784044195.927220:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843e0df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1870705580990080:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1784044195.927244:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784044195.927556:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3950377050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+24:3641:x1870705580990208:12345-0@lo:400:kworker.0 Request processed in 696us (1059us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044195.927565:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 417 00000100:00100000:1.0:1784044195.927824:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843cfc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:3641:1870705580990208:0@lo:400:kworker.0 00000100:00100000:3.0:1784044195.927862:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843e0df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1870705580990080:12345-0@lo:13:osp-pre-1-1.0 Request processed in 690us (2803us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044195.927870:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1784044195.927911:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843c89180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1870705580990592:0@lo:400:kworker.0 00000100:00100000:3.0:1784044195.927951:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044195.928000:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843cffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1870705580990336:0@lo:400:kworker.0 00000100:00100000:3.0:1784044195.928028:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044195.928049:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784044195.928054:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843c8bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1870705580990464:0@lo:400:kworker.0 00000100:00100000:3.0:1784044195.928078:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044195.928109:0:13808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580990592 00000100:00100000:3.0:1784044195.928114:0:13808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580990592 00000100:00100000:3.0:1784044195.928161:0:13808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580990336 00000100:00100000:3.0:1784044195.928165:0:13808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580990336 00000100:00100000:2.0:1784044195.928439:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3844584a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1870705580990976:0@lo:400:kworker.0 00000100:00100000:2.0:1784044195.928486:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044195.928509:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3844586d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3639:1870705580991488:0@lo:400:kworker.0 00000100:00100000:2.0:1784044195.928535:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044195.928553:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1784044195.928559:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3844585180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1870705580990848:0@lo:400:kworker.0 00000100:00100000:2.0:1784044195.928582:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044195.928601:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3844585880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3639:1870705580991360:0@lo:400:kworker.0 00000100:00100000:2.0:1784044195.928622:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044195.928678:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580990976 00000100:00100000:2.0:1784044195.928682:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580990976 00000100:00100000:2.0:1784044195.928713:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580990848 00000100:00100000:2.0:1784044195.928716:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580990848 00000100:00100000:2.0:1784044195.928736:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1784044195.928744:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3844585500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1870705580990976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784044195.928793:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3844585500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1870705580990976:12345-0@lo:400:kworker.0 Request processed in 50us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044195.928799:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1784044195.928815:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1784044195.928820:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3844584380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1870705580990848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784044195.928847:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3844584380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1870705580990848:12345-0@lo:400:kworker.0 Request processed in 27us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044195.928852:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1784044195.928876:0:9501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580991488 00000100:00100000:2.0:1784044195.928879:0:9501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580991488 00000100:00100000:2.0:1784044195.928899:0:9501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580991360 00000100:00100000:2.0:1784044195.928901:0:9501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580991360 00000100:00100000:2.0:1784044195.928914:0:9501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 345 00000100:00100000:2.0:1784044195.928920:0:9501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3844535180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1870705580990592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784044195.928952:0:9501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3844535180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1870705580990592:12345-0@lo:400:kworker.0 Request processed in 32us (1001us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044195.928959:0:9501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 345 00000100:00100000:2.0:1784044195.928973:0:9501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 346 00000100:00100000:2.0:1784044195.928979:0:9501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3844587100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1870705580991488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784044195.929006:0:9501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3844587100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1870705580991488:12345-0@lo:400:kworker.0 Request processed in 28us (471us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044195.929022:0:9501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 346 00000100:00100000:2.0:1784044195.929035:0:9501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 347 00000100:00100000:2.0:1784044195.929040:0:9501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3844586680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1870705580991360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784044195.929070:0:9501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3844586680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1870705580991360:12345-0@lo:400:kworker.0 Request processed in 31us (447us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044195.929076:0:9501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 347 00000100:00100000:2.0:1784044195.929118:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3844585180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1870705580990848:0@lo:400:kworker.0 00000100:00100000:2.0:1784044195.929128:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3844585880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3639:1870705580991360:0@lo:400:kworker.0 00000100:00100000:2.0:1784044195.929136:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3844584a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1870705580990976:0@lo:400:kworker.0 00010000:00080000:2.0:1784044195.929149:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b3844586d80 x1870705580991488/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044211 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784044195.929159:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3844586d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3639:1870705580991488:0@lo:400:kworker.0 00000100:00100000:2.0:1784044195.929432:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3844584000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3640:1870705580991104:0@lo:400:kworker.0 00000100:00100000:2.0:1784044195.929479:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044195.929513:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843c89180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1870705580990592:0@lo:400:kworker.0 00000100:00100000:2.0:1784044195.929525:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1784044195.929532:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3844584700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1870705580990720:0@lo:400:kworker.0 00000100:00100000:2.0:1784044195.929560:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044195.929582:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3844587800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1870705580991232:0@lo:400:kworker.0 00000100:00100000:2.0:1784044195.929602:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044195.929620:0:9501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580991104 00000100:00100000:2.0:1784044195.929623:0:9501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580991104 00000100:00100000:3.0:1784044195.929842:0:13808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580991232 00000100:00100000:3.0:1784044195.929847:0:13808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580991232 00000100:00100000:3.0:1784044195.929868:0:13808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 348 00000100:00100000:3.0:1784044195.929875:0:13808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3844534a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1870705580990336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044195.929920:0:13808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3844534a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1870705580990336:12345-0@lo:400:kworker.0 Request processed in 46us (1891us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044195.929926:0:13808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 348 00000100:00100000:3.0:1784044195.929940:0:13808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 349 00000100:00100000:3.0:1784044195.929946:0:13808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3844585880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1870705580991232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044195.929980:0:13808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3844585880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1870705580991232:12345-0@lo:400:kworker.0 Request processed in 35us (376us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044195.929986:0:13808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 349 00000100:00100000:3.0:1784044195.930025:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580990464 00000100:00100000:3.0:1784044195.930029:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580990464 00000100:00100000:3.0:1784044195.930053:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580990720 00000100:00100000:3.0:1784044195.930056:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580990720 00000100:00100000:3.0:1784044195.930069:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:3.0:1784044195.930075:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3844534000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1870705580990464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044195.930114:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3844534000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1870705580990464:12345-0@lo:400:kworker.0 Request processed in 39us (2035us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044195.930120:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:3.0:1784044195.930132:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:3.0:1784044195.930139:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3844584a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1870705580990720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044195.930167:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3844584a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1870705580990720:12345-0@lo:400:kworker.0 Request processed in 30us (607us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044195.930323:0:9501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 350 00000100:00100000:2.0:1784044195.930330:0:9501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3844586d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1870705580991104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784044195.930366:0:9501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3844586d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1870705580991104:12345-0@lo:400:kworker.0 Request processed in 37us (887us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044195.930373:0:9501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 350 00000100:00100000:2.0:1784044195.930411:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3844584700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1870705580990720:0@lo:400:kworker.0 00010000:00080000:2.0:1784044195.930426:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b3844587800 x1870705580991232/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044211 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784044195.930436:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3844587800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1870705580991232:0@lo:400:kworker.0 00000100:00100000:2.0:1784044195.930446:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3844584000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3640:1870705580991104:0@lo:400:kworker.0 00000100:00100000:2.0:1784044195.930505:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843c8bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1870705580990464:0@lo:400:kworker.0 00000100:00100000:2.0:1784044195.930517:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843cffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1870705580990336:0@lo:400:kworker.0 00000100:00100000:3.0:1784044195.930575:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00080000:3.0:1784044195.930612:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1784044195.930617:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1784044195.930620:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784044195.933302:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3947ee8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1870705580990080:0@lo:13:osp-pre-1-1.0 00000040:00080000:3.0:1784044196.174044:0:13763:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1784044196.174057:0:13763:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1784044196.174588:0:13763:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:3.0:1784044196.174604:0:13763:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:1.0:1784044196.302163:0:13804:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1784044196.495321:0:10331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1784044197.326069:0:13804:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1784044197.518559:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784044198.064672:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044198.065133:0:9501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565181696 00000100:00100000:3.0:1784044198.065151:0:9501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565181696 00000100:00100000:3.0:1784044198.065300:0:9501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 153 00000100:00100000:3.0:1784044198.065314:0:9501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3844584000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a93fdf3c-d42f-420a-95ea-b0cbfe954363+14:12211:x1870705565181696:12345-192.168.202.40@tcp:101:lfs.0 00010000:00010000:3.0:1784044198.065343:0:9501:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784044198.065374:0:9501:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166aa00/0x89871fc3aba189b8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcd3dffad52ca683e expref: -99 pid: 9501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044198.065486:0:9501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166ac00/0x89871fc3aba189bf lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044198.065505:0:9501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166ac00/0x89871fc3aba189bf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044198.065522:0:9501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166ac00/0x89871fc3aba189bf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044198.065541:0:9501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166a400/0x89871fc3aba189c6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044198.065548:0:9501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166a400/0x89871fc3aba189c6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044198.065579:0:9501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166a400/0x89871fc3aba189c6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044198.065643:0:9501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166ac00/0x89871fc3aba189bf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044198.065650:0:9501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166ac00/0x89871fc3aba189bf lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044198.065657:0:9501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166ac00/0x89871fc3aba189bf lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044198.065664:0:9501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b394166ac00 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:3.0:1784044198.065668:0:9501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166ac00/0x89871fc3aba189bf lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044198.065676:0:9501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166ac00/0x89871fc3aba189bf lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044198.065691:0:9501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b39758c1000) 00010000:00010000:3.0:1784044198.065693:0:9501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784044198.065700:0:9501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166ac00/0x89871fc3aba189bf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044198.065707:0:9501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166ac00/0x89871fc3aba189bf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044198.065725:0:9501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166a400/0x89871fc3aba189c6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044198.065732:0:9501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166a400/0x89871fc3aba189c6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044198.065745:0:9501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166a400/0x89871fc3aba189c6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044198.065750:0:9501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b394166a400 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:3.0:1784044198.065753:0:9501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166a400/0x89871fc3aba189c6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044198.065759:0:9501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166a400/0x89871fc3aba189c6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044198.065766:0:9501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9b397aa61a00) 00010000:00010000:3.0:1784044198.065769:0:9501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784044198.065772:0:9501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166a400/0x89871fc3aba189c6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044198.065777:0:9501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166a400/0x89871fc3aba189c6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044198.065820:0:9501:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166aa00/0x89871fc3aba189b8 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca683e expref: 15 pid: 9501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044198.065833:0:9501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b39758c1000) 00010000:00010000:3.0:1784044198.065835:0:9501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784044198.065839:0:9501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166aa00/0x89871fc3aba189b8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca683e expref: 15 pid: 9501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044198.065850:0:9501:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b394166aa00, rc 0) 00000100:00100000:3.0:1784044198.065954:0:9501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3844584000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a93fdf3c-d42f-420a-95ea-b0cbfe954363+14:12211:x1870705565181696:12345-192.168.202.40@tcp:101:lfs.0 Request processed in 643us (1299us total) trans 0 rc 301/301 00000100:00100000:3.0:1784044198.065975:0:9501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 153 00000100:00080000:2.0:1784044198.066375:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784044198.084397:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1784044198.091062:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565181952 00000100:00100000:1.0:1784044198.091087:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565181952 00000100:00100000:1.0:1784044198.091515:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 154 00000100:00100000:1.0:1784044198.091530:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3844537800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+14:12211:x1870705565181952:12345-192.168.202.40@tcp:36:lfs.0 00010000:00010000:1.0:1784044198.091614:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784044198.091650:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6c00/0x89871fc3aba1830c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6662 expref: 14 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044198.091672:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b39758c1000) 00010000:00010000:1.0:1784044198.091679:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784044198.091763:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fce00/0x89871fc3aba189cd lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044198.091781:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7a00/0x89871fc3aba1898e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6830 expref: 5 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044198.091792:0:6513:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fce00/0x89871fc3aba189cd lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044198.091857:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7a00/0x89871fc3aba1898e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6830 expref: 5 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044198.091875:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7a00/0x89871fc3aba1898e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6830 expref: 5 pid: 6512 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044198.091893:0:6513:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843e0f800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6513:1870705580991616:192.168.202.40@tcp:104: 00000100:00100000:0.0:1784044198.093162:0:6513:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b397b763e40 going to sleep for 11 seconds 00000100:00100000:1.0:1784044198.099115:0:6513:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843e0f800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6513:1870705580991616:192.168.202.40@tcp:104: 00010000:00010000:1.0:1784044198.099158:0:6513:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fce00/0x89871fc3aba189cd lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044198.099680:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1784044198.099926:0:13182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565182080 00000100:00100000:1.0:1784044198.099936:0:13182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565182080 00010000:00010000:1.0:1784044198.100006:0:13182:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7a00/0x89871fc3aba1898e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6830 expref: 6 pid: 6512 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044198.100056:0:13182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 85 00000100:00100000:1.0:1784044198.100067:0:13182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3844535880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:68dfcea6-5d83-4dbb-8fa3-e35542d621e5+6:2410:x1870705565182080:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784044198.100088:0:13182:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784044198.100097:0:13182:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7a00/0x89871fc3aba1898e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6830 expref: 6 pid: 6512 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044198.100112:0:13182:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7a00/0x89871fc3aba1898e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6830 expref: 6 pid: 6512 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044198.100140:0:13182:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7a00/0x89871fc3aba1898e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6830 expref: 6 pid: 6512 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044198.100215:0:13182:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b39758c1000) 00010000:00010000:1.0:1784044198.100222:0:13182:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fce00/0x89871fc3aba189cd lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044198.100233:0:13182:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fce00/0x89871fc3aba189cd lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044198.100241:0:13182:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fce00/0x89871fc3aba189cd lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044198.100271:0:13182:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784044198.100335:0:13182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3844535880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:68dfcea6-5d83-4dbb-8fa3-e35542d621e5+5:2410:x1870705565182080:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 269us (658us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044198.100344:0:13182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 85 00010000:00010000:1.0:1784044198.100375:0:6513:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fce00/0x89871fc3aba189cd lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044198.100383:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fce00/0x89871fc3aba189cd lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044198.100412:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc000/0x89871fc3aba189d4 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044198.100423:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc000/0x89871fc3aba189d4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044198.100430:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc000/0x89871fc3aba189d4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044198.101147:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd400/0x89871fc3aba189db lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044198.101167:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd400/0x89871fc3aba189db lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044198.101207:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd400/0x89871fc3aba189db lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784044198.101228:0:6513:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000fc881474 reply state 000000007f238742 transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd400/0x89871fc3aba189db lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044198.101242:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd400/0x89871fc3aba189db lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044198.101249:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9b3842777a00) 00010000:00010000:1.0:1784044198.101252:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784044198.101256:0:6513:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1784044198.101263:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:1.0:1784044198.101272:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fce00/0x89871fc3aba189cd lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044198.101279:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fce00/0x89871fc3aba189cd lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044198.101287:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fce00/0x89871fc3aba189cd lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044198.101294:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38426fce00 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:1.0:1784044198.101299:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fce00/0x89871fc3aba189cd lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044198.101308:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fce00/0x89871fc3aba189cd lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044198.101329:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b39758c1000) 00010000:00010000:1.0:1784044198.101332:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784044198.101336:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fce00/0x89871fc3aba189cd lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044198.101343:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fce00/0x89871fc3aba189cd lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784044198.101362:0:6513:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000fc881474 reply state 000000007f238742 transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc000/0x89871fc3aba189d4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044198.101372:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc000/0x89871fc3aba189d4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044198.101378:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9b3842777700) 00010000:00010000:1.0:1784044198.101380:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784044198.101383:0:6513:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:1.0:1784044198.101472:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3844537800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+15:12211:x1870705565181952:12345-192.168.202.40@tcp:36:lfs.0 Request processed in 9943us (17088us total) trans 4294967418 rc 0/0 00000100:00100000:1.0:1784044198.101481:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 154 00000100:00080000:2.0:1784044198.101664:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784044198.226005:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044198.226505:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565182208 00000100:00100000:2.0:1784044198.226519:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565182208 00000100:00100000:2.0:1784044198.226640:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 155 00000100:00100000:2.0:1784044198.226654:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+15:12220:x1870705565182208:12345-192.168.202.40@tcp:101:lctl.0 00010000:00010000:2.0:1784044198.226685:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784044198.226715:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799400/0x89871fc3aba189e2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcd3dffad52ca6845 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044198.226809:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798200/0x89871fc3aba189e9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044198.226835:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798200/0x89871fc3aba189e9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044198.226852:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798200/0x89871fc3aba189e9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784044198.226942:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1784044198.226947:0:6511:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1784044198.226981:0:6511:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798200/0x89871fc3aba189e9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044198.227014:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799400/0x89871fc3aba189e2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6845 expref: 17 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044198.227037:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798200/0x89871fc3aba189e9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6845 expref: 16 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044198.227048:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b397b61bc00) 00010000:00010000:2.0:1784044198.227052:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1784044198.227057:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3843798200, rc 0) 00000100:00100000:2.0:1784044198.227165:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+16:12220:x1870705565182208:12345-192.168.202.40@tcp:101:lctl.0 Request processed in 514us (1175us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044198.227214:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 155 00000100:00100000:2.0:1784044198.295664:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044198.295924:0:13808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565182336 00000100:00100000:0.0:1784044198.295938:0:13808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565182336 00000100:00100000:0.0:1784044198.296064:0:13808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 156 00000100:00100000:0.0:1784044198.296077:0:13808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3844587800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a93fdf3c-d42f-420a-95ea-b0cbfe954363+16:12226:x1870705565182336:12345-192.168.202.40@tcp:101:bash.0 00010000:00010000:0.0:1784044198.296106:0:13808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784044198.296137:0:13808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6000/0x89871fc3aba189f0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcd3dffad52ca684c expref: -99 pid: 13808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044198.296297:0:13808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7a00/0x89871fc3aba189f7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044198.296316:0:13808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7a00/0x89871fc3aba189f7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044198.296359:0:13808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7a00/0x89871fc3aba189f7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044198.296375:0:13808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6c00/0x89871fc3aba189fe lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044198.296383:0:13808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6c00/0x89871fc3aba189fe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044198.296390:0:13808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6c00/0x89871fc3aba189fe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044198.296520:0:13808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7e00/0x89871fc3aba18a05 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044198.296531:0:13808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7e00/0x89871fc3aba18a05 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044198.296538:0:13808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7e00/0x89871fc3aba18a05 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784044198.296586:0:13808:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:0.0:1784044198.296592:0:13808:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1784044198.296619:0:13808:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7e00/0x89871fc3aba18a05 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044198.296634:0:13808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7a00/0x89871fc3aba189f7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044198.296641:0:13808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7a00/0x89871fc3aba189f7 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044198.296659:0:13808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7a00/0x89871fc3aba189f7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044198.296665:0:13808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38410b7a00 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:0.0:1784044198.296669:0:13808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7a00/0x89871fc3aba189f7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044198.296676:0:13808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7a00/0x89871fc3aba189f7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044198.296692:0:13808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b397b61bc00) 00010000:00010000:0.0:1784044198.296695:0:13808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784044198.296699:0:13808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7a00/0x89871fc3aba189f7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044198.296707:0:13808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7a00/0x89871fc3aba189f7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044198.296725:0:13808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6c00/0x89871fc3aba189fe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044198.296731:0:13808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6c00/0x89871fc3aba189fe lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044198.296737:0:13808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6c00/0x89871fc3aba189fe lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044198.296742:0:13808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38410b6c00 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:0.0:1784044198.296745:0:13808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6c00/0x89871fc3aba189fe lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044198.296761:0:13808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6c00/0x89871fc3aba189fe lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044198.296770:0:13808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9b3842777700) 00010000:00010000:0.0:1784044198.296772:0:13808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784044198.296775:0:13808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6c00/0x89871fc3aba189fe lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044198.296780:0:13808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6c00/0x89871fc3aba189fe lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044198.296813:0:13808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6000/0x89871fc3aba189f0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca684c expref: 18 pid: 13808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044198.296827:0:13808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7e00/0x89871fc3aba18a05 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca684c expref: 17 pid: 13808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044198.296834:0:13808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9b3842777a00) 00010000:00010000:0.0:1784044198.296836:0:13808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1784044198.296839:0:13808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b38410b7e00, rc 0) 00000100:00100000:0.0:1784044198.296932:0:13808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3844587800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a93fdf3c-d42f-420a-95ea-b0cbfe954363+17:12226:x1870705565182336:12345-192.168.202.40@tcp:101:bash.0 Request processed in 857us (1283us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044198.296941:0:13808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 156 00000100:00100000:2.0:1784044198.300346:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1784044198.300623:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565182592 00000100:00100000:1.0:1784044198.300638:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565182592 00000100:00100000:1.0:1784044198.300729:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 157 00000100:00100000:1.0:1784044198.300740:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3844584700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+17:12226:x1870705565182592:12345-192.168.202.40@tcp:101:bash.0 00010000:00010000:1.0:1784044198.300771:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784044198.300805:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fde00/0x89871fc3aba18a0c lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcd3dffad52ca6853 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044198.300956:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc200/0x89871fc3aba18a13 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044198.300995:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc200/0x89871fc3aba18a13 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044198.301009:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc200/0x89871fc3aba18a13 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044198.301167:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fce00/0x89871fc3aba18a1a lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044198.301254:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fce00/0x89871fc3aba18a1a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044198.301268:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fce00/0x89871fc3aba18a1a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1784044198.301833:0:6513:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x4:0x0], index 1: 0 00010000:00010000:1.0:1784044198.303221:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fdc00/0x89871fc3aba18a21 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044198.303242:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fdc00/0x89871fc3aba18a21 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044198.303255:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fdc00/0x89871fc3aba18a21 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044198.303295:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc200/0x89871fc3aba18a13 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044198.303302:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc200/0x89871fc3aba18a13 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044198.303309:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc200/0x89871fc3aba18a13 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044198.303331:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38426fc200 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:1.0:1784044198.303336:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc200/0x89871fc3aba18a13 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044198.303342:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc200/0x89871fc3aba18a13 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044198.303356:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9b3842777a00) 00010000:00010000:1.0:1784044198.303359:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784044198.303364:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc200/0x89871fc3aba18a13 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044198.303370:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc200/0x89871fc3aba18a13 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784044198.303385:0:6513:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000003189f9df reply state 00000000a85b815c transno 4294967419 ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fce00/0x89871fc3aba18a1a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044198.303396:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fce00/0x89871fc3aba18a1a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044198.303401:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9b3842777600) 00010000:00010000:1.0:1784044198.303404:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784044198.303407:0:6513:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1784044198.303642:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fde00/0x89871fc3aba18a0c lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6853 expref: 20 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044198.303658:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fdc00/0x89871fc3aba18a21 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6853 expref: 19 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044198.303676:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9b3842777500) 00010000:00010000:1.0:1784044198.303678:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784044198.303681:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b38426fdc00, rc 0) 00000100:00100000:1.0:1784044198.303758:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3844584700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+20:12226:x1870705565182592:12345-192.168.202.40@tcp:101:bash.0 Request processed in 3020us (3428us total) trans 4294967419 rc 0/0 00000100:00100000:1.0:1784044198.303768:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 157 00000100:00100000:1.0:1784044198.306741:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044198.306947:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565182720 00000100:00100000:2.0:1784044198.306960:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565182720 00000100:00100000:2.0:1784044198.307132:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 57 00000100:00100000:2.0:1784044198.307145:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843e0f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+5:2409:x1870705565182720:12345-192.168.202.40@tcp:101:bash.0 00010000:00010000:2.0:1784044198.307237:0:8426:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784044198.307267:0:8426:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000045ec66be/0x89871fc3aba18a2f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcd3dffad52ca685a expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784044198.307299:0:8426:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784044198.307326:0:8426:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=391s v=(0 0) 00010000:00010000:2.0:1784044198.307331:0:8426:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784044198.307344:0:8426:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000045ec66be/0x89871fc3aba18a2f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca685a expref: 6 pid: 8426 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044198.307367:0:8426:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000045ec66be/0x89871fc3aba18a2f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca685a expref: 6 pid: 8426 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044198.307382:0:8426:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3843798400, rc 0) 00000100:00100000:2.0:1784044198.307471:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843e0f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+6:2409:x1870705565182720:12345-192.168.202.40@tcp:101:bash.0 Request processed in 328us (745us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044198.307479:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 57 00000100:00080000:3.0:1784044198.307736:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784044198.309938:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1784044198.311038:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565182848 00000100:00100000:1.0:1784044198.311058:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565182848 00000100:00100000:1.0:1784044198.311257:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 58 00000100:00100000:1.0:1784044198.311272:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3844585180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+6:12226:x1870705565182848:12345-192.168.202.40@tcp:101:bash.0 00010000:00010000:1.0:1784044198.311296:0:8428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784044198.311321:0:8428:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dc93ff9c/0x89871fc3aba18a36 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcd3dffad52ca6861 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044198.311364:0:8428:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000045ec66be/0x89871fc3aba18a2f lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca685a expref: 7 pid: 8426 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044198.311372:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784044198.311377:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784044198.311381:0:8428:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dc93ff9c/0x89871fc3aba18a36 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6861 expref: 7 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044198.311422:0:8428:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000045ec66be/0x89871fc3aba18a2f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca685a expref: 7 pid: 8426 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044198.311477:0:8428:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000045ec66be/0x89871fc3aba18a2f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca685a expref: 7 pid: 8426 timeout: 491 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044198.311496:0:8428:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843e0fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8428:1870705580991744:192.168.202.40@tcp:104: 00000100:00100000:1.0:1784044198.311767:0:8428:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b395829fcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1784044198.314654:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044198.314759:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565182976 00000100:00100000:3.0:1784044198.314773:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565182976 00010000:00010000:3.0:1784044198.314834:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000045ec66be/0x89871fc3aba18a2f lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca685a expref: 8 pid: 8426 timeout: 491 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044198.314895:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 86 00000100:00100000:3.0:1784044198.314918:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3944090c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+8:2410:x1870705565182976:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784044198.314941:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784044198.314973:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000045ec66be/0x89871fc3aba18a2f lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca685a expref: 8 pid: 8426 timeout: 491 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044198.314989:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000045ec66be/0x89871fc3aba18a2f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca685a expref: 8 pid: 8426 timeout: 491 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044198.315025:0:6498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784044198.315031:0:6498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784044198.315043:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000dc93ff9c/0x89871fc3aba18a36 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6861 expref: 8 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044198.315055:0:6498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dc93ff9c/0x89871fc3aba18a36 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6861 expref: 8 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044198.315133:0:6498:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000dc93ff9c/0x89871fc3aba18a36 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6861 expref: 8 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044198.315150:0:6498:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3844536d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6498:1870705580991872:192.168.202.40@tcp:105: 00000100:00100000:3.0:1784044198.315307:0:6498:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3943259840 going to sleep for 11 seconds 00010000:00010000:1.0:1784044198.315554:0:8428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000045ec66be/0x89871fc3aba18a2f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca685a expref: 8 pid: 8426 timeout: 491 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044198.315573:0:8428:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843e0fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8428:1870705580991744:192.168.202.40@tcp:104: 00010000:00010000:1.0:1784044198.315606:0:8428:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000dc93ff9c/0x89871fc3aba18a36 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6861 expref: 7 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044198.315616:0:8428:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b38426fde00, rc 0) 00000100:00100000:1.0:1784044198.315656:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3844585180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+7:12226:x1870705565182848:12345-192.168.202.40@tcp:101:bash.0 Request processed in 4389us (5733us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044198.315665:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 58 00000100:00100000:1.0:1784044198.319489:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044198.319649:0:6498:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3844536d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6498:1870705580991872:192.168.202.40@tcp:105: 00010000:00010000:3.0:1784044198.319681:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784044198.319768:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3944090c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+6:2410:x1870705565182976:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 4850us (5127us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044198.319781:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 86 00000100:00100000:0.0:1784044198.320556:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565183232 00000100:00100000:0.0:1784044198.320568:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565183232 00000100:00100000:0.0:1784044198.320635:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 36 00000100:00100000:0.0:1784044198.320646:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843e0fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+20:12226:x1870705565183232:12345-192.168.202.40@tcp:35:bash.0 00000100:00100000:0.0:1784044198.321070:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843e0fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+21:12226:x1870705565183232:12345-192.168.202.40@tcp:35:bash.0 Request processed in 424us (1598us total) trans 4294967420 rc 0/0 00000100:00100000:0.0:1784044198.321080:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 36 00000100:00100000:1.0:1784044198.398317:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044198.398891:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565183488 00000100:00100000:2.0:1784044198.398909:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565183488 00000100:00100000:2.0:1784044198.399013:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 158 00000100:00100000:2.0:1784044198.399031:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3947ee8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+21:12236:x1870705565183488:12345-192.168.202.40@tcp:101:lfs.0 00010000:00010000:2.0:1784044198.399087:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784044198.399120:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799400/0x89871fc3aba18a3d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcd3dffad52ca6868 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784044198.399354:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:2.0:1784044198.399525:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799400/0x89871fc3aba18a3d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6868 expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044198.399543:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b397b61bc00) 00010000:00010000:2.0:1784044198.399547:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1784044198.399553:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799400/0x89871fc3aba18a3d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6868 expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044198.399571:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3843799400, rc 0) 00000100:00100000:2.0:1784044198.399664:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3947ee8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+22:12236:x1870705565183488:12345-192.168.202.40@tcp:101:lfs.0 Request processed in 638us (1361us total) trans 4294967421 rc 301/301 00000100:00100000:2.0:1784044198.399673:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 158 00000100:00100000:2.0:1784044198.404967:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044198.405429:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565183744 00000100:00100000:0.0:1784044198.405456:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565183744 00000100:00100000:0.0:1784044198.405547:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 37 00000100:00100000:0.0:1784044198.405560:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3844585c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+22:12236:x1870705565183744:12345-192.168.202.40@tcp:35:lfs.0 00000100:00100000:0.0:1784044198.405924:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3844585c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+23:12236:x1870705565183744:12345-192.168.202.40@tcp:35:lfs.0 Request processed in 365us (971us total) trans 4294967422 rc 0/0 00000100:00100000:0.0:1784044198.405932:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 37 00000100:00100000:0.0:1784044198.473348:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044198.473478:0:9501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565183872 00000100:00100000:3.0:1784044198.473491:0:9501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565183872 00000100:00100000:3.0:1784044198.473579:0:9501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 159 00000100:00100000:3.0:1784044198.473592:0:9501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a93fdf3c-d42f-420a-95ea-b0cbfe954363+23:12242:x1870705565183872:12345-192.168.202.40@tcp:101:lfs.0 00010000:00010000:3.0:1784044198.473627:0:9501:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784044198.473657:0:9501:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166aa00/0x89871fc3aba18a4b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcd3dffad52ca686f expref: -99 pid: 9501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044198.473766:0:9501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166a400/0x89871fc3aba18a52 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044198.473786:0:9501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166a400/0x89871fc3aba18a52 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044198.473802:0:9501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166a400/0x89871fc3aba18a52 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784044198.473898:0:9501:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:3.0:1784044198.473904:0:9501:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1784044198.473933:0:9501:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166a400/0x89871fc3aba18a52 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044198.473970:0:9501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166aa00/0x89871fc3aba18a4b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca686f expref: 25 pid: 9501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044198.473996:0:9501:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166a400/0x89871fc3aba18a52 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca686f expref: 24 pid: 9501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044198.474008:0:9501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9b3842777a00) 00010000:00010000:3.0:1784044198.474011:0:9501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1784044198.474016:0:9501:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b394166a400, rc 0) 00000100:00100000:3.0:1784044198.474119:0:9501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a93fdf3c-d42f-420a-95ea-b0cbfe954363+24:12242:x1870705565183872:12345-192.168.202.40@tcp:101:lfs.0 Request processed in 529us (788us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044198.474127:0:9501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 159 00000100:00100000:1.0:1784044198.480034:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044198.480166:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565184128 00000100:00100000:2.0:1784044198.480240:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565184128 00000100:00100000:2.0:1784044198.480337:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 160 00000100:00100000:2.0:1784044198.480353:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b384316c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+24:12242:x1870705565184128:12345-192.168.202.40@tcp:101:lfs.0 00010000:00010000:2.0:1784044198.480383:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784044198.480415:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799000/0x89871fc3aba18a59 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcd3dffad52ca6876 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044198.480588:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799c00/0x89871fc3aba18a60 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044198.480607:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799c00/0x89871fc3aba18a60 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044198.480645:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799c00/0x89871fc3aba18a60 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784044198.480661:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:2.0:1784044198.480824:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799000/0x89871fc3aba18a59 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6876 expref: 27 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044198.480849:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799c00/0x89871fc3aba18a60 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6876 expref: 26 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044198.480858:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9b3842777500) 00010000:00010000:2.0:1784044198.480862:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784044198.480866:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3843799c00, rc 0) 00000100:00100000:2.0:1784044198.480949:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b384316c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+26:12242:x1870705565184128:12345-192.168.202.40@tcp:101:lfs.0 Request processed in 599us (930us total) trans 4294967423 rc 0/0 00000100:00100000:2.0:1784044198.480958:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 160 00000100:00100000:2.0:1784044198.484827:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044198.484958:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565184384 00000100:00100000:0.0:1784044198.484972:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565184384 00000100:00100000:0.0:1784044198.485063:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 161 00000100:00100000:0.0:1784044198.485075:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3844586a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+26:12242:x1870705565184384:12345-192.168.202.40@tcp:101:lfs.0 00010000:00010000:0.0:1784044198.485109:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784044198.485139:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7000/0x89871fc3aba18a6e lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcd3dffad52ca687d expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044198.485345:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6a00/0x89871fc3aba18a75 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044198.485365:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6a00/0x89871fc3aba18a75 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044198.485378:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6a00/0x89871fc3aba18a75 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784044198.485417:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:0.0:1784044198.485579:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7000/0x89871fc3aba18a6e lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca687d expref: 29 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044198.485601:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6a00/0x89871fc3aba18a75 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca687d expref: 28 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044198.485612:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9b3842777500) 00010000:00010000:0.0:1784044198.485614:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1784044198.485619:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b38410b6a00, rc 0) 00000100:00100000:0.0:1784044198.485698:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3844586a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+28:12242:x1870705565184384:12345-192.168.202.40@tcp:101:lfs.0 Request processed in 624us (887us total) trans 4294967424 rc 0/0 00000100:00100000:0.0:1784044198.485706:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 161 00000100:00100000:0.0:1784044198.489416:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1784044198.489590:0:13182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565184512 00000100:00100000:1.0:1784044198.489604:0:13182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565184512 00000100:00100000:1.0:1784044198.489693:0:13182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 11 00000100:00100000:1.0:1784044198.489706:0:13182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a93fdf3c-d42f-420a-95ea-b0cbfe954363+28:2410:x1870705565184512:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784044198.489755:0:13182:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784044198.489793:0:13182:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799c00/0x89871fc3aba18a60 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6876 expref: 28 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044198.489819:0:13182:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9b3842777500) 00010000:00010000:1.0:1784044198.489825:0:13182:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784044198.489918:0:13182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a93fdf3c-d42f-420a-95ea-b0cbfe954363+27:2410:x1870705565184512:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 215us (519us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044198.489927:0:13182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 11 00000100:00100000:1.0:1784044198.500169:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044198.500467:0:9822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565184640 00000100:00100000:2.0:1784044198.500481:0:9822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565184640 00000100:00100000:2.0:1784044198.500560:0:9822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 59 00000100:00100000:2.0:1784044198.500573:0:9822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39459b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a93fdf3c-d42f-420a-95ea-b0cbfe954363+6:2409:x1870705565184640:12345-192.168.202.40@tcp:1:lfs.0 00010000:00010000:2.0:1784044198.500636:0:9822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002e0bf137/0x89871fc3aba18a83 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044198.500664:0:9822:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000dc93ff9c/0x89871fc3aba18a36 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6861 expref: 6 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044198.500695:0:9822:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784044198.500701:0:9822:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1784044198.500706:0:9822:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002e0bf137/0x89871fc3aba18a83 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044198.500755:0:9822:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000dc93ff9c/0x89871fc3aba18a36 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6861 expref: 6 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044198.500772:0:9822:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000dc93ff9c/0x89871fc3aba18a36 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6861 expref: 6 pid: 8428 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044198.500791:0:9822:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3844584e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9822:1870705580992000:192.168.202.40@tcp:104: 00000100:00100000:2.0:1784044198.500924:0:9822:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3843150e40 going to sleep for 11 seconds 00000100:00100000:1.0:1784044198.504755:0:9822:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3844584e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9822:1870705580992000:192.168.202.40@tcp:104: 00010000:00010000:1.0:1784044198.504806:0:9822:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000002e0bf137/0x89871fc3aba18a83 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044198.505108:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044198.506545:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565184768 00000100:00100000:0.0:1784044198.506559:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565184768 00002000:00100000:0.0:1784044198.506946:0:8433:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff9b3844587480 x1870705565184768/t0(0) o4->a93fdf3c-d42f-420a-95ea-b0cbfe954363@192.168.202.40@tcp:349/0 lens 504/0 e 0 to 0 dl 1784044209 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784044198.506960:0:8433:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b3844587480 with x1870705565184768 ext(0->12) 00010000:00010000:0.0:1784044198.506973:0:8433:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000dc93ff9c/0x89871fc3aba18a36 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6861 expref: 7 pid: 8428 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044198.507351:0:8433:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000dc93ff9c/0x89871fc3aba18a36 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6861 expref: 7 pid: 8428 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784044198.507361:0:8433:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9b3844587480 00000100:00100000:0.0:1784044198.507421:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 2 00000100:00100000:0.0:1784044198.507432:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3844587480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+7:2409:x1870705565184768:12345-192.168.202.40@tcp:4:lfs.0 00000100:00100000:0.0:1784044198.509383:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3844587480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+9:2409:x1870705565184768:12345-192.168.202.40@tcp:4:lfs.0 Request processed in 1942us (4400us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1784044198.509397:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 2 00002000:00100000:0.0:1784044198.509408:0:8433:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff9b3844587480 x1870705565184768/t4294967306(0) o4->a93fdf3c-d42f-420a-95ea-b0cbfe954363@192.168.202.40@tcp:349/0 lens 504/448 e 0 to 0 dl 1784044209 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784044198.509419:0:8433:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b3844587480 with x1870705565184768 ext(0->12) 00010000:00010000:0.0:1784044198.509428:0:8433:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000dc93ff9c/0x89871fc3aba18a36 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6861 expref: 9 pid: 8428 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044198.509455:0:8433:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000dc93ff9c/0x89871fc3aba18a36 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6861 expref: 9 pid: 8428 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784044198.509464:0:8433:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9b3844587480 00000100:00100000:0.0:1784044198.513341:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044198.522295:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565184896 00000100:00100000:2.0:1784044198.522316:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565184896 00010000:00010000:2.0:1784044198.522397:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000dc93ff9c/0x89871fc3aba18a36 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6861 expref: 9 pid: 8428 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044198.522464:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 87 00000100:00100000:2.0:1784044198.522477:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d3d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+9:2409:x1870705565184896:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784044198.522496:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1784044198.522522:0:6497:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1784044198.522525:0:6497:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1784044197 00002000:00010000:2.0:1784044198.522546:0:6497:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb atime from disk: 0 -> 1784044198 00002000:00010000:2.0:1784044198.522549:0:6497:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb ctime from disk: 0 -> 1784044197 00002000:00010000:2.0:1784044198.522552:0:6497:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1784044198.522563:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000dc93ff9c/0x89871fc3aba18a36 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6861 expref: 9 pid: 8428 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044198.522581:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000dc93ff9c/0x89871fc3aba18a36 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6861 expref: 9 pid: 8428 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044198.522608:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dc93ff9c/0x89871fc3aba18a36 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6861 expref: 9 pid: 8428 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044198.522626:0:6497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1784044198.522631:0:6497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1784044198.522638:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002e0bf137/0x89871fc3aba18a83 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044198.522660:0:6497:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002e0bf137/0x89871fc3aba18a83 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044198.522703:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784044198.522778:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d3d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+8:2409:x1870705565184896:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 304us (9446us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044198.522786:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 87 00010000:00010000:1.0:1784044198.522977:0:9822:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000002e0bf137/0x89871fc3aba18a83 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044198.522996:0:9822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002e0bf137/0x89871fc3aba18a83 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044198.523020:0:9822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002e0bf137/0x89871fc3aba18a83 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044198.523029:0:9822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002e0bf137/0x89871fc3aba18a83 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044198.523051:0:9822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002e0bf137/0x89871fc3aba18a83 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044198.523059:0:9822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3843799a00 already unused, calling callback (ffffffffc0b56230) 00010000:00010000:1.0:1784044198.523063:0:9822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002e0bf137/0x89871fc3aba18a83 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044198.523071:0:9822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002e0bf137/0x89871fc3aba18a83 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044198.523082:0:9822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002e0bf137/0x89871fc3aba18a83 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044198.523089:0:9822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002e0bf137/0x89871fc3aba18a83 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044198.523144:0:9822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39459b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a93fdf3c-d42f-420a-95ea-b0cbfe954363+7:2409:x1870705565184640:12345-192.168.202.40@tcp:1:lfs.0 Request processed in 22573us (22989us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044198.523152:0:9822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 59 00000100:00100000:1.0:1784044198.527806:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044198.528089:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565185152 00000100:00100000:3.0:1784044198.528110:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565185152 00000100:00100000:3.0:1784044198.528229:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 38 00000100:00100000:3.0:1784044198.528243:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3974227c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+27:12242:x1870705565185152:12345-192.168.202.40@tcp:35:lfs.0 00000004:00010000:3.0:1784044198.528365:0:6515:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6a00/0x89871fc3aba18a75 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca687d expref: 27 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1784044198.529504:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00000001:00080000:3.0:1784044198.529650:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:3.0:1784044198.530115:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00010000:00010000:3.0:1784044198.530232:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166aa00/0x89871fc3aba18a8a lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044198.530262:0:6515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fdc00/0x89871fc3aba18a21 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6853 expref: 31 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044198.530273:0:6515:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166aa00/0x89871fc3aba18a8a lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044198.530835:0:6515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fdc00/0x89871fc3aba18a21 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6853 expref: 31 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044198.530859:0:6515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fdc00/0x89871fc3aba18a21 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6853 expref: 31 pid: 6513 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044198.530883:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3844535880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6515:1870705580992128:192.168.202.40@tcp:104: 00000100:00100000:3.0:1784044198.531877:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3942f27480 going to sleep for 11 seconds 00000100:00100000:0.0:1784044198.534784:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1784044198.534941:0:13182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565185280 00000100:00100000:1.0:1784044198.534956:0:13182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565185280 00010000:00010000:1.0:1784044198.535094:0:13182:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fdc00/0x89871fc3aba18a21 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6853 expref: 32 pid: 6513 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044198.535478:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3844535880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6515:1870705580992128:192.168.202.40@tcp:104: 00010000:00010000:3.0:1784044198.535520:0:6515:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166aa00/0x89871fc3aba18a8a lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044198.536497:0:13182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 88 00000100:00100000:1.0:1784044198.536519:0:13182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d3d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a93fdf3c-d42f-420a-95ea-b0cbfe954363+32:2409:x1870705565185280:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784044198.536539:0:13182:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784044198.536548:0:13182:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fdc00/0x89871fc3aba18a21 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6853 expref: 32 pid: 6513 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044198.536563:0:13182:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fdc00/0x89871fc3aba18a21 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6853 expref: 32 pid: 6513 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044198.536588:0:13182:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fdc00/0x89871fc3aba18a21 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6853 expref: 32 pid: 6513 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044198.536605:0:13182:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9b3842777500) 00010000:00010000:1.0:1784044198.536611:0:13182:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166aa00/0x89871fc3aba18a8a lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044198.536621:0:13182:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166aa00/0x89871fc3aba18a8a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044198.536630:0:13182:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166aa00/0x89871fc3aba18a8a lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044198.536669:0:13182:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784044198.536716:0:6515:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166aa00/0x89871fc3aba18a8a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044198.536730:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166aa00/0x89871fc3aba18a8a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044198.536761:0:13182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d3d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a93fdf3c-d42f-420a-95ea-b0cbfe954363+31:2409:x1870705565185280:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 249us (1991us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044198.536774:0:13182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 88 00000001:00080000:3.0:1784044198.536922:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000001:00080000:3.0:1784044198.540146:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00000100:00100000:3.0:1784044198.540372:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3844535880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6515:1870705580992256:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1784044198.540525:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044198.540575:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3943259180 going to sleep for 11 seconds 00000100:00100000:1.0:1784044198.541013:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580992256 00000100:00100000:1.0:1784044198.541050:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580992256 00000100:00100000:1.0:1784044198.541164:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:1.0:1784044198.541222:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39502f1050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6515:x1870705580992256:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00080000:3.0:1784044198.541545:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1784044198.541776:0:10330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784044198.542094:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39502f1050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6515:x1870705580992256:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 916us (1565us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044198.542106:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:3.0:1784044198.543863:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3844535880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6515:1870705580992256:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1784044198.547459:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00000100:00100000:3.0:1784044198.547566:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3844535880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6515:1870705580992384:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1784044198.550115:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044198.550158:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3942f27a80 going to sleep for 11 seconds 00000100:00100000:0.0:1784044198.550552:0:7768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580992384 00000100:00100000:0.0:1784044198.550561:0:7768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580992384 00000100:00100000:0.0:1784044198.550626:0:7768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1784044198.550637:0:7768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3844536d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6515:x1870705580992384:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1784044198.550841:0:7768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3844536d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6515:x1870705580992384:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 205us (734us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1784044198.550853:0:7768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:2.0:1784044198.551117:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3844535880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6515:1870705580992384:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1784044198.551268:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967431 00010000:00010000:2.0:1784044198.551361:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166aa00/0x89871fc3aba18a8a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044198.551376:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166aa00/0x89871fc3aba18a8a lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044198.551384:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166aa00/0x89871fc3aba18a8a lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044198.551392:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b394166aa00 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:2.0:1784044198.551398:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166aa00/0x89871fc3aba18a8a lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044198.551406:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166aa00/0x89871fc3aba18a8a lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044198.551426:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9b3842777500) 00010000:00010000:2.0:1784044198.551429:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1784044198.551434:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166aa00/0x89871fc3aba18a8a lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044198.551452:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166aa00/0x89871fc3aba18a8a lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1784044198.551611:0:6515:0:(mdd_object.c:4016:mdd_close()) Object [0x200000402:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1784044198.551701:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8448 00000004:00080000:2.0:1784044198.551715:0:6515:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 391722539560ns, next at 392722537158ns, rc = 0 00000001:00080000:2.0:1784044198.551721:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967432 00010000:00010000:2.0:1784044198.551748:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9b3842777500) 00010000:00010000:2.0:1784044198.551751:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1784044198.551759:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6a00/0x89871fc3aba18a75 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca687d expref: 35 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044198.551927:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3974227c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+34:12242:x1870705565185152:12345-192.168.202.40@tcp:35:lfs.0 Request processed in 23686us (24137us total) trans 4294967433 rc 0/0 00000100:00100000:2.0:1784044198.551938:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 38 00000020:00080000:2.0:1784044198.551945:0:6515:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1784044198.558465:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044198.561030:0:13808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565185408 00000100:00100000:2.0:1784044198.561050:0:13808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565185408 00000100:00100000:2.0:1784044198.561145:0:13808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 162 00000100:00100000:2.0:1784044198.561157:0:13808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3844535500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a93fdf3c-d42f-420a-95ea-b0cbfe954363+34:12242:x1870705565185408:12345-192.168.202.40@tcp:101:lfs.0 00010000:00010000:2.0:1784044198.561399:0:13808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784044198.561426:0:13808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798000/0x89871fc3aba18a91 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcd3dffad52ca6884 expref: -99 pid: 13808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044198.561580:0:13808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798000/0x89871fc3aba18a91 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6884 expref: 35 pid: 13808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044198.561836:0:13808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798000/0x89871fc3aba18a91 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6884 expref: 35 pid: 13808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044198.561862:0:13808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9b397b61ba00) 00010000:00010000:2.0:1784044198.561866:0:13808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1784044198.562083:0:13808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3843798000, rc 0) 00000100:00100000:2.0:1784044198.562425:0:13808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3844535500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a93fdf3c-d42f-420a-95ea-b0cbfe954363+35:12242:x1870705565185408:12345-192.168.202.40@tcp:101:lfs.0 Request processed in 1267us (3980us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044198.562434:0:13808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 162 00000100:00100000:1.0:1784044198.576655:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044198.576791:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565185664 00000100:00100000:0.0:1784044198.576824:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565185664 00000100:00100000:0.0:1784044198.576904:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 39 00000100:00100000:0.0:1784044198.576917:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39459b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+35:12242:x1870705565185664:12345-192.168.202.40@tcp:35:lfs.0 00000100:00100000:1.0:1784044198.580335:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39459b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+36:12242:x1870705565185664:12345-192.168.202.40@tcp:35:lfs.0 Request processed in 3404us (3677us total) trans 4294967434 rc 0/0 00000100:00100000:1.0:1784044198.580352:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 39 00000100:00100000:0.0:1784044198.633947:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1784044198.634238:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565185792 00000100:00100000:1.0:1784044198.634252:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565185792 00000100:00100000:1.0:1784044198.634323:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 418 00000100:00100000:1.0:1784044198.634336:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3950376050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4a09ad9-a185-4679-99bb-b6a07b865440+13:2409:x1870705565185792:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:1.0:1784044198.634460:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3950376050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4a09ad9-a185-4679-99bb-b6a07b865440+13:2409:x1870705565185792:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 124us (528us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044198.634469:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 418 00000100:00100000:2.0:1784044198.635100:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044198.635572:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565186048 00000100:00100000:0.0:1784044198.635583:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565186048 00000100:00080000:3.0:1784044198.640539:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784044198.641110:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 132 00000100:00100000:0.0:1784044198.641130:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3844585c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+6:2409:x1870705565186048:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:0.0:1784044198.641385:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3844585c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+6:2409:x1870705565186048:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 262us (6294us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044198.641393:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 132 00000100:00100000:2.0:1784044198.645344:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044198.645412:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044198.645459:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1784044198.645563:0:9501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565186304 00000100:00100000:1.0:1784044198.645579:0:9501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565186304 00000100:00100000:3.0:1784044198.645643:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565185920 00000100:00100000:3.0:1784044198.645655:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565185920 00000100:00100000:1.0:1784044198.645701:0:9501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 351 00000100:00100000:1.0:1784044198.645723:0:9501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3844586300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68dfcea6-5d83-4dbb-8fa3-e35542d621e5+5:2409:x1870705565186304:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:1.0:1784044198.645821:0:9501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3844586300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68dfcea6-5d83-4dbb-8fa3-e35542d621e5+5:2409:x1870705565186304:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 103us (494us total) trans 0 rc 0/0 00000100:00080000:2.0:1784044198.646310:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1784044198.646497:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565186176 00000100:00100000:0.0:1784044198.646504:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565186176 00000100:00100000:3.0:1784044198.656714:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 352 00000100:00100000:3.0:1784044198.656748:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3844587b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+5:2409:x1870705565185920:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:1.0:1784044198.656822:0:9501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 351 00000100:00100000:3.0:1784044198.656910:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3844587b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+5:2409:x1870705565185920:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 176us (11494us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044198.656920:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 352 00000100:00100000:0.0:1784044198.668897:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 353 00000100:00100000:0.0:1784044198.668930:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3844585f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68dfcea6-5d83-4dbb-8fa3-e35542d621e5+5:2409:x1870705565186176:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:0.0:1784044198.669032:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3844585f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68dfcea6-5d83-4dbb-8fa3-e35542d621e5+5:2409:x1870705565186176:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 122us (23571us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044198.669041:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 353 00000100:00100000:2.0:1784044198.711465:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044198.711586:0:13808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565186560 00000100:00100000:0.0:1784044198.711597:0:13808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565186560 00000100:00100000:0.0:1784044198.711668:0:13808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 163 00000100:00100000:0.0:1784044198.711678:0:13808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3844584a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a93fdf3c-d42f-420a-95ea-b0cbfe954363+36:12252:x1870705565186560:12345-192.168.202.40@tcp:101:lfs.0 00010000:00010000:0.0:1784044198.711703:0:13808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784044198.711722:0:13808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7000/0x89871fc3aba18a98 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcd3dffad52ca688b expref: -99 pid: 13808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784044198.712069:0:13808:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:0.0:1784044198.712354:0:13808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7000/0x89871fc3aba18a98 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca688b expref: 38 pid: 13808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044198.712372:0:13808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b397b61bc00) 00010000:00010000:0.0:1784044198.712375:0:13808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1784044198.712381:0:13808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7000/0x89871fc3aba18a98 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca688b expref: 38 pid: 13808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044198.712396:0:13808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b38410b7000, rc 0) 00000100:00100000:2.0:1784044198.712603:0:13808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3844584a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a93fdf3c-d42f-420a-95ea-b0cbfe954363+37:12252:x1870705565186560:12345-192.168.202.40@tcp:101:lfs.0 Request processed in 925us (1428us total) trans 4294967435 rc 301/301 00000100:00100000:2.0:1784044198.712613:0:13808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 163 00000100:00100000:1.0:1784044198.714621:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044198.714721:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565186688 00000100:00100000:3.0:1784044198.714731:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565186688 00000100:00100000:2.0:1784044198.715510:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 164 00000100:00100000:2.0:1784044198.715527:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39459b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+37:12252:x1870705565186688:12345-192.168.202.40@tcp:34:lfs.0 00010000:00010000:2.0:1784044198.715603:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799800/0x89871fc3aba18aa6 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044198.715620:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799800/0x89871fc3aba18aa6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044198.715633:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799800/0x89871fc3aba18aa6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044198.715644:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798600/0x89871fc3aba18aad lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044198.715652:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798600/0x89871fc3aba18aad lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044198.715658:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798600/0x89871fc3aba18aad lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044198.715742:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799a00/0x89871fc3aba18ab4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044198.715750:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799a00/0x89871fc3aba18ab4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044198.715790:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799a00/0x89871fc3aba18ab4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784044198.715847:0:6512:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799a00/0x89871fc3aba18ab4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044198.715861:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799800/0x89871fc3aba18aa6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044198.716027:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799800/0x89871fc3aba18aa6 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044198.716038:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799800/0x89871fc3aba18aa6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044198.716045:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3843799800 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:2.0:1784044198.716050:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799800/0x89871fc3aba18aa6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044198.716057:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799800/0x89871fc3aba18aa6 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044198.716069:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9b3842777a00) 00010000:00010000:2.0:1784044198.716072:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784044198.716077:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799800/0x89871fc3aba18aa6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044198.716084:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799800/0x89871fc3aba18aa6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044198.716098:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798600/0x89871fc3aba18aad lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044198.716111:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798600/0x89871fc3aba18aad lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044198.716116:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798600/0x89871fc3aba18aad lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044198.716121:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3843798600 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:2.0:1784044198.716124:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798600/0x89871fc3aba18aad lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044198.716129:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798600/0x89871fc3aba18aad lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044198.716136:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9b3842777600) 00010000:00010000:2.0:1784044198.716138:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784044198.716141:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798600/0x89871fc3aba18aad lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044198.716146:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798600/0x89871fc3aba18aad lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044198.716155:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799a00/0x89871fc3aba18ab4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044198.716160:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799a00/0x89871fc3aba18ab4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044198.716165:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799a00/0x89871fc3aba18ab4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044198.716170:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3843799a00 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:2.0:1784044198.716267:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799a00/0x89871fc3aba18ab4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044198.716274:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799a00/0x89871fc3aba18ab4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044198.716283:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9b397b61ba00) 00010000:00010000:2.0:1784044198.716285:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784044198.716288:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799a00/0x89871fc3aba18ab4 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044198.716294:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799a00/0x89871fc3aba18ab4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044198.716429:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39459b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+37:12252:x1870705565186688:12345-192.168.202.40@tcp:34:lfs.0 Request processed in 901us (1813us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044198.716446:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 164 00000100:00100000:1.0:1784044198.727998:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044198.728139:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565186944 00000100:00100000:3.0:1784044198.728149:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565186944 00000100:00100000:3.0:1784044198.728237:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 40 00000100:00100000:3.0:1784044198.728249:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39459b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+37:12252:x1870705565186944:12345-192.168.202.40@tcp:35:lfs.0 00000100:00100000:3.0:1784044198.728532:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39459b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+38:12252:x1870705565186944:12345-192.168.202.40@tcp:35:lfs.0 Request processed in 283us (540us total) trans 4294967436 rc 0/0 00000100:00100000:3.0:1784044198.728546:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 40 00000100:00100000:3.0:1784044198.789950:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044198.790063:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565187200 00000100:00100000:2.0:1784044198.790072:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565187200 00000100:00100000:2.0:1784044198.790137:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 165 00000100:00100000:2.0:1784044198.790147:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3844537100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+38:12255:x1870705565187200:12345-192.168.202.40@tcp:101:lfs.0 00010000:00010000:2.0:1784044198.790216:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784044198.790238:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799a00/0x89871fc3aba18abb lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcd3dffad52ca6892 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044198.790887:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798600/0x89871fc3aba18ac2 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044198.790905:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798600/0x89871fc3aba18ac2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044198.790937:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798600/0x89871fc3aba18ac2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044198.790949:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799800/0x89871fc3aba18ac9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044198.790956:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799800/0x89871fc3aba18ac9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044198.790963:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799800/0x89871fc3aba18ac9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044198.791073:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799000/0x89871fc3aba18ad0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044198.791083:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799000/0x89871fc3aba18ad0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044198.791090:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799000/0x89871fc3aba18ad0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784044198.791100:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:2.0:1784044198.791614:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798600/0x89871fc3aba18ac2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044198.791623:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798600/0x89871fc3aba18ac2 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044198.791630:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798600/0x89871fc3aba18ac2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044198.791636:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3843798600 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:2.0:1784044198.791649:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798600/0x89871fc3aba18ac2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044198.791658:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798600/0x89871fc3aba18ac2 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044198.791672:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9b3842777a00) 00010000:00010000:2.0:1784044198.791675:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784044198.791679:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798600/0x89871fc3aba18ac2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044198.791685:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798600/0x89871fc3aba18ac2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044198.791699:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799800/0x89871fc3aba18ac9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044198.791705:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799800/0x89871fc3aba18ac9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044198.791712:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799800/0x89871fc3aba18ac9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044198.791717:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3843799800 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:2.0:1784044198.791720:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799800/0x89871fc3aba18ac9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044198.791726:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799800/0x89871fc3aba18ac9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044198.791733:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9b3842777600) 00010000:00010000:2.0:1784044198.791735:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784044198.791744:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799800/0x89871fc3aba18ac9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044198.791751:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799800/0x89871fc3aba18ac9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044198.791799:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799a00/0x89871fc3aba18abb lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6892 expref: 41 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044198.791814:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799000/0x89871fc3aba18ad0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6892 expref: 40 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044198.791821:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9b397b61ba00) 00010000:00010000:2.0:1784044198.791823:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784044198.791826:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3843799000, rc 0) 00000100:00100000:2.0:1784044198.792039:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3844537100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+40:12255:x1870705565187200:12345-192.168.202.40@tcp:101:lfs.0 Request processed in 1892us (2097us total) trans 4294967437 rc 0/0 00000100:00100000:2.0:1784044198.792048:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 165 00000100:00100000:0.0:1784044198.798364:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044198.798446:0:13808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565187328 00000100:00100000:2.0:1784044198.798456:0:13808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565187328 00000100:00100000:2.0:1784044198.798526:0:13808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 166 00000100:00100000:2.0:1784044198.798536:0:13808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a93fdf3c-d42f-420a-95ea-b0cbfe954363+40:12255:x1870705565187328:12345-192.168.202.40@tcp:54:lfs.0 00010000:00010000:2.0:1784044198.798605:0:13808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799a00/0x89871fc3aba18ade lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044198.798622:0:13808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799a00/0x89871fc3aba18ade lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044198.798634:0:13808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799a00/0x89871fc3aba18ade lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044198.798695:0:13808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799a00/0x89871fc3aba18ade lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044198.798702:0:13808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799a00/0x89871fc3aba18ade lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044198.798709:0:13808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799a00/0x89871fc3aba18ade lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044198.798716:0:13808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3843799a00 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:2.0:1784044198.798720:0:13808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799a00/0x89871fc3aba18ade lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044198.798728:0:13808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799a00/0x89871fc3aba18ade lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044198.798741:0:13808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9b397b61ba00) 00010000:00010000:2.0:1784044198.798745:0:13808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1784044198.798749:0:13808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799a00/0x89871fc3aba18ade lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044198.798756:0:13808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799a00/0x89871fc3aba18ade lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044198.798831:0:13808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a93fdf3c-d42f-420a-95ea-b0cbfe954363+40:12255:x1870705565187328:12345-192.168.202.40@tcp:54:lfs.0 Request processed in 296us (477us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044198.798838:0:13808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 166 00000100:00100000:3.0:1784044198.803465:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044198.803581:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565187584 00000100:00100000:2.0:1784044198.803596:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565187584 00000100:00100000:2.0:1784044198.803642:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 41 00000100:00100000:2.0:1784044198.803669:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3844534380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+40:12255:x1870705565187584:12345-192.168.202.40@tcp:35:lfs.0 00000100:00100000:2.0:1784044198.804126:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3844534380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+41:12255:x1870705565187584:12345-192.168.202.40@tcp:35:lfs.0 Request processed in 459us (669us total) trans 4294967438 rc 0/0 00000100:00100000:2.0:1784044198.804134:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 41 00000100:00100000:2.0:1784044198.990971:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1870705580992512:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1784044198.991040:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044198.991201:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580992512 00000100:00100000:3.0:1784044198.991209:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580992512 00000100:00100000:3.0:1784044198.991261:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:3.0:1784044198.991271:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3844584e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1870705580992512:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1784044198.991315:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:3.0:1784044198.991371:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3844584e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1870705580992512:12345-0@lo:41:osp-pre-0-1.0 Request processed in 101us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044198.991379:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:2.0:1784044198.991576:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1870705580992512:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1784044199.143074:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044199.145138:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565187840 00000100:00100000:2.0:1784044199.145153:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565187840 00000100:00100000:2.0:1784044199.145424:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 167 00000100:00100000:2.0:1784044199.145446:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3844536680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+41:12286:x1870705565187840:12345-192.168.202.40@tcp:101:cat.0 00010000:00010000:2.0:1784044199.145575:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784044199.147139:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799a00/0x89871fc3aba18ae5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcd3dffad52ca6899 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044199.147412:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799800/0x89871fc3aba18aec lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044199.147541:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799800/0x89871fc3aba18aec lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044199.147559:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799800/0x89871fc3aba18aec lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784044199.147572:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:2.0:1784044199.147833:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799a00/0x89871fc3aba18ae5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6899 expref: 44 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044199.147877:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799800/0x89871fc3aba18aec lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6899 expref: 43 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044199.148022:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9b397b61ba00) 00010000:00010000:2.0:1784044199.148026:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784044199.148029:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3843799800, rc 0) 00000100:00100000:2.0:1784044199.148539:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3844536680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+43:12286:x1870705565187840:12345-192.168.202.40@tcp:101:cat.0 Request processed in 3101us (5472us total) trans 4294967439 rc 0/0 00000100:00100000:2.0:1784044199.148549:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 167 00000100:00100000:0.0:1784044199.155789:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044199.157449:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1784044199.159792:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565188096 00000100:00100000:1.0:1784044199.159808:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565188096 00000100:00100000:1.0:1784044199.159907:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 42 00000100:00100000:1.0:1784044199.159919:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+43:12286:x1870705565188096:12345-192.168.202.40@tcp:35:cat.0 00000100:00100000:1.0:1784044199.160612:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+44:12286:x1870705565188096:12345-192.168.202.40@tcp:35:cat.0 Request processed in 692us (4831us total) trans 4294967440 rc 0/0 00000100:00100000:1.0:1784044199.160622:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 42 00000100:00100000:0.0:1784044199.162314:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565188224 00000100:00100000:0.0:1784044199.162327:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565188224 00000100:00100000:0.0:1784044199.162540:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 12 00000100:00100000:0.0:1784044199.162549:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3844535c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+44:2409:x1870705565188224:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784044199.162565:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784044199.162591:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799800/0x89871fc3aba18aec lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6899 expref: 44 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044199.162611:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9b397b61ba00) 00010000:00010000:0.0:1784044199.162616:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784044199.162684:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3844535c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+43:2409:x1870705565188224:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 137us (5253us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044199.162691:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 12 00000100:00100000:3.0:1784044199.240873:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1784044199.241034:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565188480 00000100:00100000:1.0:1784044199.241042:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565188480 00000100:00100000:1.0:1784044199.241097:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 168 00000100:00100000:1.0:1784044199.241105:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3844536a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+43:12292:x1870705565188480:12345-192.168.202.40@tcp:101:dd.0 00010000:00010000:1.0:1784044199.241128:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784044199.241130:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1784044199.241152:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166a400/0x89871fc3aba18a52 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca686f expref: 43 pid: 9501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044199.241167:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9b3842777a00) 00010000:00010000:1.0:1784044199.241170:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784044199.241230:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd000/0x89871fc3aba18afa lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcd3dffad52ca68a0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044199.241336:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fca00/0x89871fc3aba18b01 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044199.241350:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799000/0x89871fc3aba18ad0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6892 expref: 43 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044199.241359:0:6513:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fca00/0x89871fc3aba18b01 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044199.241403:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799000/0x89871fc3aba18ad0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6892 expref: 43 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044199.241413:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799000/0x89871fc3aba18ad0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6892 expref: 43 pid: 6513 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044199.241424:0:6513:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39459b7800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6513:1870705580992640:192.168.202.40@tcp:104: 00000100:00100000:1.0:1784044199.241590:0:6513:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b395829fcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1784044199.247321:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044199.247746:0:6513:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39459b7800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6513:1870705580992640:192.168.202.40@tcp:104: 00010000:00010000:3.0:1784044199.247779:0:6513:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fca00/0x89871fc3aba18b01 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044199.248572:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565188608 00000100:00100000:2.0:1784044199.248582:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565188608 00010000:00010000:2.0:1784044199.248633:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799000/0x89871fc3aba18ad0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6892 expref: 44 pid: 6513 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044199.248684:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 89 00000100:00100000:2.0:1784044199.248695:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39459b6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+44:2409:x1870705565188608:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784044199.248711:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784044199.248717:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799000/0x89871fc3aba18ad0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6892 expref: 44 pid: 6513 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044199.248727:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799000/0x89871fc3aba18ad0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6892 expref: 44 pid: 6513 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044199.248745:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799000/0x89871fc3aba18ad0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6892 expref: 44 pid: 6513 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044199.248774:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9b397b61ba00) 00010000:00010000:2.0:1784044199.248778:0:6496:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fca00/0x89871fc3aba18b01 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044199.248785:0:6496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fca00/0x89871fc3aba18b01 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044199.248790:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fca00/0x89871fc3aba18b01 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044199.248814:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784044199.248866:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39459b6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+43:2409:x1870705565188608:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 174us (1555us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044199.248871:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 89 00010000:00010000:3.0:1784044199.249035:0:6513:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fca00/0x89871fc3aba18b01 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044199.249041:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fca00/0x89871fc3aba18b01 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784044199.249056:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:3.0:1784044199.249194:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd000/0x89871fc3aba18afa lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca68a0 expref: 44 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044199.249207:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fca00/0x89871fc3aba18b01 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca68a0 expref: 43 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044199.249221:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9b397b61ba00) 00010000:00010000:3.0:1784044199.249223:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1784044199.249225:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b38426fca00, rc 0) 00000100:00100000:3.0:1784044199.249246:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3844536a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+43:12292:x1870705565188480:12345-192.168.202.40@tcp:101:dd.0 Request processed in 8142us (8383us total) trans 4294967441 rc 0/0 00000100:00100000:3.0:1784044199.249251:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 168 00000100:00100000:0.0:1784044199.253807:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044199.253895:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565188736 00000100:00100000:2.0:1784044199.253906:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565188736 00000100:00100000:2.0:1784044199.253965:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 169 00000100:00100000:2.0:1784044199.253976:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+43:12292:x1870705565188736:12345-192.168.202.40@tcp:101:dd.0 00010000:00010000:2.0:1784044199.253999:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784044199.254019:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799a00/0x89871fc3aba18b0f lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcd3dffad52ca68a7 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044199.254053:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798600/0x89871fc3aba18b16 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044199.254067:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798600/0x89871fc3aba18b16 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044199.254077:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798600/0x89871fc3aba18b16 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044199.254247:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799a00/0x89871fc3aba18b0f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca68a7 expref: 45 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044199.254267:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798600/0x89871fc3aba18b16 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca68a7 expref: 44 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044199.254276:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9b397b61ba00) 00010000:00010000:2.0:1784044199.254280:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1784044199.254283:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3843798600, rc 0) 00000100:00100000:2.0:1784044199.254335:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+44:12292:x1870705565188736:12345-192.168.202.40@tcp:101:dd.0 Request processed in 361us (537us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044199.254354:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 169 00000100:00100000:0.0:1784044199.258032:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044199.258107:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565188992 00000100:00100000:2.0:1784044199.258115:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565188992 00000100:00100000:2.0:1784044199.258165:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 170 00000100:00100000:2.0:1784044199.258207:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+44:12292:x1870705565188992:12345-192.168.202.40@tcp:36:dd.0 00010000:00010000:2.0:1784044199.258498:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799000/0x89871fc3aba18b1d lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044199.258521:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799000/0x89871fc3aba18b1d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044199.258533:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799000/0x89871fc3aba18b1d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1784044199.258578:0:6512:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967442 00000004:00010000:2.0:1784044199.258601:0:6512:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000889652e1 reply state 000000008177a42e transno 4294967443 ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799000/0x89871fc3aba18b1d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044199.258634:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799000/0x89871fc3aba18b1d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044199.258642:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9b397b61ba00) 00010000:00010000:2.0:1784044199.258823:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1784044199.258827:0:6512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1784044199.258974:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+47:12292:x1870705565188992:12345-192.168.202.40@tcp:36:dd.0 Request processed in 798us (946us total) trans 4294967443 rc 0/0 00000100:00100000:2.0:1784044199.258982:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 170 00000020:00080000:2.0:1784044199.258987:0:6512:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1784044199.567864:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784044199.649992:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044199.650114:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565189120 00000100:00100000:3.0:1784044199.650124:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565189120 00000100:00100000:3.0:1784044199.650628:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 171 00000100:00100000:3.0:1784044199.650645:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+47:12306:x1870705565189120:12345-192.168.202.40@tcp:101:stat.0 00010000:00010000:3.0:1784044199.650679:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784044199.650708:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166ac00/0x89871fc3aba18b24 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcd3dffad52ca68ae expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044199.650791:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166ae00/0x89871fc3aba18b2b lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044199.650809:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166ae00/0x89871fc3aba18b2b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044199.650823:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166ae00/0x89871fc3aba18b2b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044199.650834:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166b600/0x89871fc3aba18b32 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044199.650842:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166b600/0x89871fc3aba18b32 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044199.650883:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166b600/0x89871fc3aba18b32 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044199.651091:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166a400/0x89871fc3aba18b39 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044199.651103:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fca00/0x89871fc3aba18b01 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca68a0 expref: 48 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044199.651110:0:6513:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166a400/0x89871fc3aba18b39 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044199.651145:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fca00/0x89871fc3aba18b01 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca68a0 expref: 48 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044199.651160:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fca00/0x89871fc3aba18b01 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca68a0 expref: 48 pid: 6513 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044199.651198:0:6513:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3844534e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6513:1870705580992768:192.168.202.40@tcp:104: 00000100:00100000:3.0:1784044199.651603:0:6513:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3942f27a80 going to sleep for 11 seconds 00000100:00100000:0.0:1784044199.655888:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044199.655960:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565189376 00000100:00100000:2.0:1784044199.655970:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565189376 00000100:00100000:2.0:1784044199.656036:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 43 00000100:00100000:2.0:1784044199.656048:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+49:6178:x1870705565189376:12345-192.168.202.40@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1784044199.656209:0:6513:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3844534e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6513:1870705580992768:192.168.202.40@tcp:104: 00010000:00010000:3.0:1784044199.656239:0:6513:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166a400/0x89871fc3aba18b39 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044199.656374:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+50:6178:x1870705565189376:12345-192.168.202.40@tcp:35:ldlm_bl.0 Request processed in 327us (495us total) trans 4294967444 rc 0/0 00000100:00100000:2.0:1784044199.656382:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 43 00000100:00100000:0.0:1784044199.663372:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044199.663648:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565189504 00000100:00100000:2.0:1784044199.663670:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565189504 00010000:00010000:2.0:1784044199.663720:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fca00/0x89871fc3aba18b01 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca68a0 expref: 50 pid: 6513 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044199.663762:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 90 00000100:00100000:2.0:1784044199.663771:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39503bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+50:2410:x1870705565189504:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784044199.663788:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784044199.663810:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fca00/0x89871fc3aba18b01 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca68a0 expref: 50 pid: 6513 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044199.663823:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fca00/0x89871fc3aba18b01 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca68a0 expref: 50 pid: 6513 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044199.663845:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fca00/0x89871fc3aba18b01 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca68a0 expref: 50 pid: 6513 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044199.663863:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9b397b61ba00) 00010000:00010000:2.0:1784044199.663868:0:6497:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166a400/0x89871fc3aba18b39 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044199.663878:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166a400/0x89871fc3aba18b39 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044199.663886:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166a400/0x89871fc3aba18b39 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044199.663921:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784044199.663989:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39503bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+49:2410:x1870705565189504:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 219us (630us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044199.663997:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 90 00010000:00010000:3.0:1784044199.664197:0:6513:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166a400/0x89871fc3aba18b39 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044199.677540:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166a400/0x89871fc3aba18b39 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784044199.677634:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:3.0:1784044199.677639:0:6513:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1784044199.677679:0:6513:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166a400/0x89871fc3aba18b39 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044199.677696:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166a400/0x89871fc3aba18b39 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044199.677707:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166ae00/0x89871fc3aba18b2b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044199.677713:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166ae00/0x89871fc3aba18b2b lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044199.677721:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166ae00/0x89871fc3aba18b2b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044199.677727:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b394166ae00 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:3.0:1784044199.677731:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166ae00/0x89871fc3aba18b2b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044199.677738:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166ae00/0x89871fc3aba18b2b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044199.677754:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9b3842777a00) 00010000:00010000:3.0:1784044199.677757:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784044199.677763:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166ae00/0x89871fc3aba18b2b lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044199.677769:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166ae00/0x89871fc3aba18b2b lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044199.677795:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166b600/0x89871fc3aba18b32 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044199.677801:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166b600/0x89871fc3aba18b32 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044199.677806:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166b600/0x89871fc3aba18b32 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044199.677811:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b394166b600 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:3.0:1784044199.677814:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166b600/0x89871fc3aba18b32 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044199.677820:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166b600/0x89871fc3aba18b32 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044199.677828:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9b3842777600) 00010000:00010000:3.0:1784044199.677830:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784044199.677833:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166b600/0x89871fc3aba18b32 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044199.677839:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166b600/0x89871fc3aba18b32 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044199.677880:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166ac00/0x89871fc3aba18b24 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca68ae expref: 49 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044199.677894:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166a400/0x89871fc3aba18b39 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca68ae expref: 48 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044199.677913:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9b397b61ba00) 00010000:00010000:3.0:1784044199.677915:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784044199.677918:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b394166a400, rc 0) 00000100:00100000:3.0:1784044199.677998:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+48:12306:x1870705565189120:12345-192.168.202.40@tcp:101:stat.0 Request processed in 27357us (28019us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044199.678007:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 171 00000100:00100000:0.0:1784044199.778878:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1784044199.778966:0:9501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565189760 00000100:00100000:1.0:1784044199.778977:0:9501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565189760 00000100:00100000:1.0:1784044199.779032:0:9501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 172 00000100:00100000:1.0:1784044199.779041:0:9501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39503be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a93fdf3c-d42f-420a-95ea-b0cbfe954363+48:12312:x1870705565189760:12345-192.168.202.40@tcp:36:truncate.0 00010000:00010000:1.0:1784044199.779102:0:9501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784044199.779136:0:9501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166a400/0x89871fc3aba18b39 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca68ae expref: 48 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044199.779158:0:9501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9b397b61ba00) 00010000:00010000:1.0:1784044199.779267:0:9501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784044199.779455:0:9501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fca00/0x89871fc3aba18b40 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044199.779471:0:9501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fca00/0x89871fc3aba18b40 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044199.779479:0:9501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fca00/0x89871fc3aba18b40 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1784044199.779531:0:9501:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967445 00000004:00010000:1.0:1784044199.779554:0:9501:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000045492e6e reply state 00000000da0231b9 transno 4294967446 ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fca00/0x89871fc3aba18b40 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044199.779567:0:9501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fca00/0x89871fc3aba18b40 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044199.779573:0:9501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9b397b61ba00) 00010000:00010000:1.0:1784044199.779576:0:9501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784044199.779579:0:9501:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1784044199.779793:0:9501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39503be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a93fdf3c-d42f-420a-95ea-b0cbfe954363+50:12312:x1870705565189760:12345-192.168.202.40@tcp:36:truncate.0 Request processed in 751us (922us total) trans 4294967446 rc 0/0 00000100:00100000:1.0:1784044199.779799:0:9501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 172 00000020:00080000:1.0:1784044199.779802:0:9501:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1784044200.014583:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784044200.014611:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3844534e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1870705580992896:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784044200.014795:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1784044200.014807:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39459b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1870705580993024:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1784044200.014959:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784044200.014970:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843e0fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1870705580993152:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1784044200.015041:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044200.015197:0:10713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580993024 00000100:00100000:0.0:1784044200.015204:0:10713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580993024 00000100:00100000:0.0:1784044200.015275:0:10713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1784044200.015301:0:10713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397f9e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1870705580993024:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1784044200.015335:0:10713:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1784044200.015390:0:10713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397f9e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1870705580993024:12345-0@lo:13:osp-pre-0-1.0 Request processed in 105us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044200.015398:0:10713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1784044200.015570:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39459b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1870705580993024:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1784044200.015597:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784044200.015900:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044200.017537:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580992896 00000100:00100000:1.0:1784044200.017548:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580992896 00000100:00100000:1.0:1784044200.017635:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1784044200.017645:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3844537480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1870705580992896:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1784044200.017677:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1784044200.017743:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3844537480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1870705580992896:12345-0@lo:13:osp-pre-0-0.0 Request processed in 99us (1842us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044200.017751:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00080000:3.0:1784044200.017934:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784044200.017979:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3844534e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1870705580992896:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784044200.018618:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044200.018724:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580993152 00000100:00100000:1.0:1784044200.018730:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580993152 00000100:00100000:1.0:1784044200.018770:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:1.0:1784044200.018778:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843cfed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1870705580993152:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1784044200.018803:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1784044200.018838:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843cfed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1870705580993152:12345-0@lo:41:osp-pre-1-0.0 Request processed in 61us (222us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044200.018844:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:2.0:1784044200.018939:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843e0fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1870705580993152:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1784044200.047624:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044200.047742:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565189888 00000100:00100000:2.0:1784044200.047757:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565189888 00000100:00100000:2.0:1784044200.047862:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 173 00000100:00100000:2.0:1784044200.047872:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843e0c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+50:12326:x1870705565189888:12345-192.168.202.40@tcp:101:stat.0 00010000:00010000:2.0:1784044200.047913:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784044200.047937:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799c00/0x89871fc3aba18b47 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcd3dffad52ca68b5 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044200.048018:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799400/0x89871fc3aba18b4e lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044200.048036:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799400/0x89871fc3aba18b4e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044200.048050:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799400/0x89871fc3aba18b4e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044200.048061:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798400/0x89871fc3aba18b55 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044200.048069:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798400/0x89871fc3aba18b55 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044200.048075:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798400/0x89871fc3aba18b55 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044200.048156:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798a00/0x89871fc3aba18b5c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044200.048166:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798a00/0x89871fc3aba18b5c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044200.048214:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798a00/0x89871fc3aba18b5c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784044200.048269:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00000004:00200000:2.0:1784044200.048273:0:6512:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1784044200.048304:0:6512:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798a00/0x89871fc3aba18b5c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044200.048315:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798a00/0x89871fc3aba18b5c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044200.048321:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799400/0x89871fc3aba18b4e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044200.048325:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799400/0x89871fc3aba18b4e lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044200.048330:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799400/0x89871fc3aba18b4e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044200.048334:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3843799400 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:2.0:1784044200.048336:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799400/0x89871fc3aba18b4e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044200.048342:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799400/0x89871fc3aba18b4e lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044200.048350:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9b3842777a00) 00010000:00010000:2.0:1784044200.048352:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784044200.048355:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799400/0x89871fc3aba18b4e lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044200.048359:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799400/0x89871fc3aba18b4e lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044200.048375:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798400/0x89871fc3aba18b55 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044200.048379:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798400/0x89871fc3aba18b55 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044200.048385:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798400/0x89871fc3aba18b55 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044200.048390:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3843798400 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:2.0:1784044200.048393:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798400/0x89871fc3aba18b55 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044200.048399:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798400/0x89871fc3aba18b55 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044200.048407:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9b3842777600) 00010000:00010000:2.0:1784044200.048410:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784044200.048413:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798400/0x89871fc3aba18b55 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044200.048419:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798400/0x89871fc3aba18b55 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044200.048583:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799c00/0x89871fc3aba18b47 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca68b5 expref: 52 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044200.048594:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798a00/0x89871fc3aba18b5c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca68b5 expref: 51 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044200.048607:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9b397b61ba00) 00010000:00010000:2.0:1784044200.048609:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784044200.048611:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3843798a00, rc 0) 00000100:00100000:2.0:1784044200.048855:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843e0c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+51:12326:x1870705565189888:12345-192.168.202.40@tcp:101:stat.0 Request processed in 984us (1243us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044200.048862:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 173 00000100:00080000:3.0:1784044200.049038:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784044200.128622:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044200.128807:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565190144 00000100:00100000:3.0:1784044200.128817:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565190144 00000100:00100000:3.0:1784044200.128869:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 174 00000100:00100000:3.0:1784044200.128879:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843cfdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+51:12336:x1870705565190144:12345-192.168.202.40@tcp:101:lfs.0 00010000:00010000:3.0:1784044200.128910:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784044200.128929:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166ac00/0x89871fc3aba18b63 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcd3dffad52ca68bc expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784044200.129029:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:3.0:1784044200.129125:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166ac00/0x89871fc3aba18b63 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca68bc expref: 53 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044200.129136:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b397b61bc00) 00010000:00010000:3.0:1784044200.129151:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1784044200.129156:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166ac00/0x89871fc3aba18b63 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca68bc expref: 53 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044200.129168:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b394166ac00, rc 0) 00000100:00100000:3.0:1784044200.129270:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843cfdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+52:12336:x1870705565190144:12345-192.168.202.40@tcp:101:lfs.0 Request processed in 392us (655us total) trans 4294967447 rc 301/301 00000100:00100000:3.0:1784044200.129278:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 174 00000100:00100000:0.0:1784044200.132080:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044200.132141:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565190400 00000100:00100000:2.0:1784044200.132150:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565190400 00000100:00100000:2.0:1784044200.132253:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 44 00000100:00100000:2.0:1784044200.132264:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3974225c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+52:12336:x1870705565190400:12345-192.168.202.40@tcp:35:lfs.0 00000100:00100000:2.0:1784044200.132506:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3974225c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+53:12336:x1870705565190400:12345-192.168.202.40@tcp:35:lfs.0 Request processed in 243us (434us total) trans 4294967448 rc 0/0 00000100:00100000:2.0:1784044200.132514:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 44 00000100:00100000:0.0:1784044200.192539:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1784044200.192755:0:9501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565190656 00000100:00100000:1.0:1784044200.192768:0:9501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565190656 00000100:00100000:1.0:1784044200.192845:0:9501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 175 00000100:00100000:1.0:1784044200.192856:0:9501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843e0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a93fdf3c-d42f-420a-95ea-b0cbfe954363+53:12342:x1870705565190656:12345-192.168.202.40@tcp:101:bash.0 00010000:00010000:1.0:1784044200.192885:0:9501:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784044200.192929:0:9501:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd000/0x89871fc3aba18b71 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcd3dffad52ca68c3 expref: -99 pid: 9501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044200.193051:0:9501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc400/0x89871fc3aba18b78 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044200.193067:0:9501:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798a00/0x89871fc3aba18b5c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca68b5 expref: 54 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044200.193076:0:9501:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc400/0x89871fc3aba18b78 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044200.193108:0:9501:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798a00/0x89871fc3aba18b5c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca68b5 expref: 54 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044200.193122:0:9501:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798a00/0x89871fc3aba18b5c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca68b5 expref: 54 pid: 6512 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044200.193151:0:9501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397f9e3800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9501:1870705580993280:192.168.202.40@tcp:104: 00000100:00100000:1.0:1784044200.193553:0:9501:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b395829f480 going to sleep for 11 seconds 00000100:00100000:1.0:1784044200.198382:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044200.198508:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565190784 00000100:00100000:2.0:1784044200.198519:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565190784 00010000:00010000:2.0:1784044200.198565:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798a00/0x89871fc3aba18b5c lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca68b5 expref: 55 pid: 6512 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044200.198615:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 91 00000100:00100000:2.0:1784044200.198627:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3955a3a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+55:2409:x1870705565190784:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784044200.198646:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784044200.198654:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798a00/0x89871fc3aba18b5c lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca68b5 expref: 55 pid: 6512 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044200.198689:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798a00/0x89871fc3aba18b5c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca68b5 expref: 55 pid: 6512 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044200.198712:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9b397b61ba00) 00010000:00010000:2.0:1784044200.198718:0:6496:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc400/0x89871fc3aba18b78 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044200.198729:0:6496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc400/0x89871fc3aba18b78 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044200.198736:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc400/0x89871fc3aba18b78 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044200.198758:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784044200.198822:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3955a3a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+55:2409:x1870705565190784:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 197us (451us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044200.198830:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 91 00010000:00010000:3.0:1784044200.200376:0:9501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798a00/0x89871fc3aba18b5c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca68b5 expref: 54 pid: 6512 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044200.200398:0:9501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397f9e3800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9501:1870705580993280:192.168.202.40@tcp:104: 00010000:00010000:3.0:1784044200.200420:0:9501:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc400/0x89871fc3aba18b78 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044200.200439:0:9501:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc400/0x89871fc3aba18b78 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044200.200446:0:9501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc400/0x89871fc3aba18b78 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784044200.200466:0:9501:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00010000:00010000:3.0:1784044200.200667:0:9501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd000/0x89871fc3aba18b71 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca68c3 expref: 55 pid: 9501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044200.200684:0:9501:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc400/0x89871fc3aba18b78 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca68c3 expref: 54 pid: 9501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044200.200692:0:9501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9b397b61ba00) 00010000:00010000:3.0:1784044200.200709:0:9501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1784044200.200712:0:9501:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b38426fc400, rc 0) 00000100:00100000:3.0:1784044200.200768:0:9501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843e0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a93fdf3c-d42f-420a-95ea-b0cbfe954363+54:12342:x1870705565190656:12345-192.168.202.40@tcp:101:bash.0 Request processed in 7912us (8241us total) trans 4294967449 rc 0/0 00000100:00100000:3.0:1784044200.200775:0:9501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 175 00000100:00100000:3.0:1784044200.205387:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044200.205622:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565191040 00000100:00100000:0.0:1784044200.205633:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565191040 00000100:00100000:0.0:1784044200.205698:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 176 00000100:00100000:0.0:1784044200.205710:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3844534e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+54:12342:x1870705565191040:12345-192.168.202.40@tcp:36:bash.0 00000001:00080000:1.0:1784044200.208262:0:6490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967449 is committed 00000004:00080000:1.0:1784044200.208308:0:6490:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:1.0:1784044200.208334:0:6490:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9b397aa67240 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:1.0:1784044200.208340:0:6490:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9b397b975900 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9b397aa67840 00000020:00080000:1.0:1784044200.208343:0:6490:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9b397b975000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9b397f940000 00000020:00080000:1.0:1784044200.208382:0:6544:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:1.0:1784044200.208457:0:6544:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00010000:00010000:0.0:1784044200.208655:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6200/0x89871fc3aba18b86 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044200.208676:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6200/0x89871fc3aba18b86 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044200.208688:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6200/0x89871fc3aba18b86 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1784044200.208753:0:6512:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967450 00000004:00010000:0.0:1784044200.208779:0:6512:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000788b4a06 reply state 0000000086a2972e transno 4294967451 ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6200/0x89871fc3aba18b86 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044200.208794:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6200/0x89871fc3aba18b86 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044200.208802:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9b397b61ba00) 00010000:00010000:0.0:1784044200.208804:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1784044200.208808:0:6512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1784044200.208933:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1784044200.208958:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3844536300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1870705580993408:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1784044200.209022:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044200.209207:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580993408 00000100:00100000:3.0:1784044200.209217:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580993408 00000100:00080000:1.0:1784044200.209275:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784044200.209283:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1784044200.209295:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397f9e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3641:x1870705580993408:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1784044200.209320:0:8426:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:4 count 1 00002000:00010000:3.0:1784044200.209353:0:8426:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 13, mtime: 0x6a565aa5, atime: 0x6a565aa6, ctime: 0x6a565aa5, blocks: 0x8 00010000:00010000:3.0:1784044200.209360:0:8426:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005b3883ff/0x89871fc3aba18b8d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044200.209374:0:8426:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=393s v=(0 0) 00010000:00010000:3.0:1784044200.209379:0:8426:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00000100:00100000:0.0:1784044200.209387:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3844534e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+24:12342:x1870705565191040:12345-192.168.202.40@tcp:36:bash.0 Request processed in 3678us (4008us total) trans 4294967451 rc 0/0 00000100:00100000:0.0:1784044200.209395:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 176 00010000:00010000:3.0:1784044200.209396:0:8426:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005b3883ff/0x89871fc3aba18b8d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1784044200.209400:0:6512:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1784044200.209409:0:8426:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005b3883ff/0x89871fc3aba18b8d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044200.209419:0:8426:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005b3883ff/0x89871fc3aba18b8d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044200.209436:0:8426:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005b3883ff/0x89871fc3aba18b8d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044200.209465:0:8426:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1784044200.209588:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397f9e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3641:x1870705580993408:12345-0@lo:6:osp-syn-1-0.0 Request processed in 295us (565us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1784044200.209595:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00010000:00010000:0.0:1784044200.209598:0:10331:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784044200.209605:0:10331:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005b3883ff/0x89871fc3aba18b8d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044200.209613:0:10331:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b394166ac00 already unused, calling callback (ffffffffc0b56230) 00010000:00010000:0.0:1784044200.209617:0:10331:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005b3883ff/0x89871fc3aba18b8d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044200.209625:0:10331:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005b3883ff/0x89871fc3aba18b8d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1784044200.209632:0:3641:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b3844536300/2, rc 0, transno 4294967308 00000100:00100000:3.0:1784044200.209638:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3844536300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1870705580993408:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1784044200.209641:0:10331:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005b3883ff/0x89871fc3aba18b8d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044200.209661:0:10331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005b3883ff/0x89871fc3aba18b8d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044200.209682:0:10331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784044200.209684:0:10331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784044200.209685:0:10331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784044200.209756:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc000/0x89871fc3aba189d4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044200.209765:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc000/0x89871fc3aba189d4 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044200.209772:0:3625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc000/0x89871fc3aba189d4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044200.209777:0:3625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38426fc000 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:2.0:1784044200.209781:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc000/0x89871fc3aba189d4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044200.209798:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc000/0x89871fc3aba189d4 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044200.209809:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9b3842777700) 00010000:00010000:2.0:1784044200.209811:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784044200.209815:0:3625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc000/0x89871fc3aba189d4 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044200.209820:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc000/0x89871fc3aba189d4 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044200.209835:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd400/0x89871fc3aba189db lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044200.209841:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd400/0x89871fc3aba189db lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044200.209847:0:3625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd400/0x89871fc3aba189db lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044200.209852:0:3625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38426fd400 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:2.0:1784044200.209854:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd400/0x89871fc3aba189db lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044200.209861:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd400/0x89871fc3aba189db lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044200.209869:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9b3842777a00) 00010000:00010000:2.0:1784044200.209871:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784044200.209874:0:3625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd400/0x89871fc3aba189db lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044200.209899:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd400/0x89871fc3aba189db lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044200.209913:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fce00/0x89871fc3aba18a1a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044200.209927:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fce00/0x89871fc3aba18a1a lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044200.209934:0:3625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fce00/0x89871fc3aba18a1a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044200.209938:0:3625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38426fce00 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:2.0:1784044200.209941:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fce00/0x89871fc3aba18a1a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044200.209946:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fce00/0x89871fc3aba18a1a lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044200.209954:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9b3842777600) 00010000:00010000:2.0:1784044200.209957:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784044200.209960:0:3625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fce00/0x89871fc3aba18a1a lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044200.209965:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fce00/0x89871fc3aba18a1a lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044200.209979:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799000/0x89871fc3aba18b1d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044200.209985:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799000/0x89871fc3aba18b1d lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044200.209997:0:3625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799000/0x89871fc3aba18b1d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044200.210003:0:3625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3843799000 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:2.0:1784044200.210006:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799000/0x89871fc3aba18b1d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044200.210012:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799000/0x89871fc3aba18b1d lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044200.210021:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9b397b61ba00) 00010000:00010000:2.0:1784044200.210023:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784044200.210026:0:3625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799000/0x89871fc3aba18b1d lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044200.210031:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799000/0x89871fc3aba18b1d lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044200.210042:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fca00/0x89871fc3aba18b40 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044200.210049:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fca00/0x89871fc3aba18b40 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044200.210055:0:3625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fca00/0x89871fc3aba18b40 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044200.210059:0:3625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38426fca00 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:2.0:1784044200.210061:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fca00/0x89871fc3aba18b40 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044200.210075:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fca00/0x89871fc3aba18b40 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044200.210083:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9b397b61ba00) 00010000:00010000:2.0:1784044200.210085:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784044200.210088:0:3625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fca00/0x89871fc3aba18b40 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044200.210094:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fca00/0x89871fc3aba18b40 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044200.216793:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044200.217026:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565191168 00000100:00100000:3.0:1784044200.217037:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565191168 00000100:00100000:3.0:1784044200.217136:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 177 00000100:00100000:3.0:1784044200.217148:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843e0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+20:12342:x1870705565191168:12345-192.168.202.40@tcp:101:bash.0 00010000:00010000:3.0:1784044200.217222:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784044200.217246:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166b600/0x89871fc3aba18b94 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcd3dffad52ca68ca expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044200.217598:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166ae00/0x89871fc3aba18b9b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044200.217617:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc400/0x89871fc3aba18b78 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca68c3 expref: 21 pid: 9501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044200.217625:0:6513:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166ae00/0x89871fc3aba18b9b lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044200.217670:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc400/0x89871fc3aba18b78 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca68c3 expref: 21 pid: 9501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044200.217709:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc400/0x89871fc3aba18b78 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca68c3 expref: 21 pid: 9501 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044200.217725:0:6513:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3844537b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6513:1870705580993536:192.168.202.40@tcp:104: 00000100:00100000:3.0:1784044200.217912:0:6513:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3942f27900 going to sleep for 11 seconds 00000100:00100000:1.0:1784044200.221754:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044200.221821:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565191296 00000100:00100000:2.0:1784044200.221832:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565191296 00010000:00010000:2.0:1784044200.221874:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc400/0x89871fc3aba18b78 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca68c3 expref: 22 pid: 9501 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044200.222016:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 92 00000100:00100000:0.0:1784044200.222030:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397f9e1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+22:2409:x1870705565191296:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784044200.222047:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784044200.222055:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc400/0x89871fc3aba18b78 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca68c3 expref: 22 pid: 9501 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044200.222069:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc400/0x89871fc3aba18b78 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca68c3 expref: 22 pid: 9501 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044200.222091:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9b397b61ba00) 00010000:00010000:0.0:1784044200.222096:0:6498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166ae00/0x89871fc3aba18b9b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044200.222106:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166ae00/0x89871fc3aba18b9b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044200.222115:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166ae00/0x89871fc3aba18b9b lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044200.222136:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784044200.222249:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397f9e1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+22:2409:x1870705565191296:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 222us (506us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044200.222258:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 92 00010000:00010000:3.0:1784044200.224141:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc400/0x89871fc3aba18b78 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca68c3 expref: 21 pid: 9501 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044200.224396:0:6513:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3844537b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6513:1870705580993536:192.168.202.40@tcp:104: 00010000:00010000:3.0:1784044200.224435:0:6513:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166ae00/0x89871fc3aba18b9b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044200.224446:0:6513:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166ae00/0x89871fc3aba18b9b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044200.224452:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166ae00/0x89871fc3aba18b9b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784044200.224513:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:3.0:1784044200.224518:0:6513:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1784044200.224538:0:6513:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166ae00/0x89871fc3aba18b9b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044200.224571:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166b600/0x89871fc3aba18b94 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca68ca expref: 21 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044200.224587:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166ae00/0x89871fc3aba18b9b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca68ca expref: 20 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044200.224614:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9b397b61ba00) 00010000:00010000:3.0:1784044200.224617:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784044200.224620:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b394166ae00, rc 0) 00000100:00100000:3.0:1784044200.224732:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843e0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+20:12342:x1870705565191168:12345-192.168.202.40@tcp:101:bash.0 Request processed in 7585us (7948us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044200.224740:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 177 00000100:00100000:1.0:1784044200.229352:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044200.229473:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565191552 00000100:00100000:0.0:1784044200.229484:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565191552 00000100:00100000:0.0:1784044200.229550:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 45 00000100:00100000:0.0:1784044200.229561:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397f9e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+20:12342:x1870705565191552:12345-192.168.202.40@tcp:35:bash.0 00000100:00100000:0.0:1784044200.229848:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397f9e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+21:12342:x1870705565191552:12345-192.168.202.40@tcp:35:bash.0 Request processed in 288us (507us total) trans 4294967452 rc 0/0 00000100:00100000:0.0:1784044200.229857:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 45 00000100:00100000:2.0:1784044200.330157:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044200.330389:0:9501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565191808 00000100:00100000:3.0:1784044200.330401:0:9501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565191808 00000100:00100000:3.0:1784044200.330472:0:9501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 178 00000100:00100000:3.0:1784044200.330482:0:9501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843cfc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a93fdf3c-d42f-420a-95ea-b0cbfe954363+21:12352:x1870705565191808:12345-192.168.202.40@tcp:101:lfs.0 00010000:00010000:3.0:1784044200.330509:0:9501:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784044200.330531:0:9501:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166b600/0x89871fc3aba18ba2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcd3dffad52ca68d1 expref: -99 pid: 9501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784044200.330639:0:9501:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:3.0:1784044200.330746:0:9501:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166b600/0x89871fc3aba18ba2 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca68d1 expref: 23 pid: 9501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044200.330761:0:9501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b397b61bc00) 00010000:00010000:3.0:1784044200.330764:0:9501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1784044200.330769:0:9501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166b600/0x89871fc3aba18ba2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca68d1 expref: 23 pid: 9501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044200.330783:0:9501:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b394166b600, rc 0) 00000100:00100000:3.0:1784044200.330855:0:9501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843cfc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a93fdf3c-d42f-420a-95ea-b0cbfe954363+22:12352:x1870705565191808:12345-192.168.202.40@tcp:101:lfs.0 Request processed in 373us (707us total) trans 4294967453 rc 301/301 00000100:00100000:3.0:1784044200.330881:0:9501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 178 00000100:00100000:1.0:1784044200.337294:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044200.337393:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565191936 00000100:00100000:0.0:1784044200.337404:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565191936 00000100:00100000:0.0:1784044200.337483:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 179 00000100:00100000:0.0:1784044200.337495:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397f9e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+22:12352:x1870705565191936:12345-192.168.202.40@tcp:34:lfs.0 00010000:00010000:0.0:1784044200.337593:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7c00/0x89871fc3aba18bb0 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044200.337613:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7c00/0x89871fc3aba18bb0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044200.337627:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7c00/0x89871fc3aba18bb0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044200.337644:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6a00/0x89871fc3aba18bb7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044200.337650:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6a00/0x89871fc3aba18bb7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044200.337656:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6a00/0x89871fc3aba18bb7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044200.337766:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6800/0x89871fc3aba18bbe lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044200.337776:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6800/0x89871fc3aba18bbe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044200.337784:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6800/0x89871fc3aba18bbe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784044200.337841:0:6512:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6800/0x89871fc3aba18bbe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044200.337855:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7c00/0x89871fc3aba18bb0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044200.337862:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7c00/0x89871fc3aba18bb0 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044200.337869:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7c00/0x89871fc3aba18bb0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044200.337876:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38410b7c00 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:0.0:1784044200.337881:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7c00/0x89871fc3aba18bb0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044200.337889:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7c00/0x89871fc3aba18bb0 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044200.337903:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9b3842777a00) 00010000:00010000:0.0:1784044200.337907:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784044200.337912:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7c00/0x89871fc3aba18bb0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044200.337925:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7c00/0x89871fc3aba18bb0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044200.337939:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6a00/0x89871fc3aba18bb7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044200.337944:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6a00/0x89871fc3aba18bb7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044200.337950:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6a00/0x89871fc3aba18bb7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044200.337956:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38410b6a00 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:0.0:1784044200.337960:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6a00/0x89871fc3aba18bb7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044200.337965:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6a00/0x89871fc3aba18bb7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044200.337974:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9b3974d3ad00) 00010000:00010000:0.0:1784044200.337976:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784044200.337979:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6a00/0x89871fc3aba18bb7 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044200.337984:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6a00/0x89871fc3aba18bb7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044200.337999:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6800/0x89871fc3aba18bbe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044200.338004:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6800/0x89871fc3aba18bbe lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044200.338015:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6800/0x89871fc3aba18bbe lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044200.338020:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38410b6800 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:0.0:1784044200.338022:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6800/0x89871fc3aba18bbe lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044200.338028:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6800/0x89871fc3aba18bbe lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044200.338035:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9b397b61ba00) 00010000:00010000:0.0:1784044200.338037:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784044200.338040:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6800/0x89871fc3aba18bbe lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044200.338045:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6800/0x89871fc3aba18bbe lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044200.338127:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397f9e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+22:12352:x1870705565191936:12345-192.168.202.40@tcp:34:lfs.0 Request processed in 633us (852us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044200.338135:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 179 00000100:00100000:1.0:1784044200.344577:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044200.344672:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565192192 00000100:00100000:0.0:1784044200.344684:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565192192 00000100:00100000:0.0:1784044200.344747:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 46 00000100:00100000:0.0:1784044200.344758:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397f9e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+22:12352:x1870705565192192:12345-192.168.202.40@tcp:35:lfs.0 00000100:00100000:0.0:1784044200.345000:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397f9e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+23:12352:x1870705565192192:12345-192.168.202.40@tcp:35:lfs.0 Request processed in 242us (432us total) trans 4294967454 rc 0/0 00000100:00100000:0.0:1784044200.345008:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 46 00000100:00100000:3.0:1784044200.380233:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1784044200.380459:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565192448 00000100:00100000:1.0:1784044200.380469:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565192448 00000100:00100000:1.0:1784044200.380529:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 180 00000100:00100000:1.0:1784044200.380539:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3844537b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+23:12355:x1870705565192448:12345-192.168.202.40@tcp:101:lfs.0 00010000:00010000:1.0:1784044200.380567:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784044200.380591:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc200/0x89871fc3aba18bc5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcd3dffad52ca68d8 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044200.380704:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd600/0x89871fc3aba18bcc lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044200.380719:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd600/0x89871fc3aba18bcc lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044200.380730:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd600/0x89871fc3aba18bcc lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044200.380743:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fda00/0x89871fc3aba18bd3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044200.380750:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fda00/0x89871fc3aba18bd3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044200.380756:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fda00/0x89871fc3aba18bd3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044200.380870:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc400/0x89871fc3aba18bda lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044200.380882:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc400/0x89871fc3aba18bda lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044200.380890:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc400/0x89871fc3aba18bda lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784044200.380901:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:1.0:1784044200.380974:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd600/0x89871fc3aba18bcc lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044200.380979:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd600/0x89871fc3aba18bcc lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044200.380988:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd600/0x89871fc3aba18bcc lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044200.380992:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38426fd600 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:1.0:1784044200.380995:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd600/0x89871fc3aba18bcc lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044200.381000:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd600/0x89871fc3aba18bcc lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044200.381010:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9b3842777a00) 00010000:00010000:1.0:1784044200.381012:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784044200.381015:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd600/0x89871fc3aba18bcc lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044200.381019:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd600/0x89871fc3aba18bcc lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044200.381028:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fda00/0x89871fc3aba18bd3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044200.381031:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fda00/0x89871fc3aba18bd3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044200.381034:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fda00/0x89871fc3aba18bd3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044200.381038:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38426fda00 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:1.0:1784044200.381040:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fda00/0x89871fc3aba18bd3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044200.381048:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fda00/0x89871fc3aba18bd3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044200.381053:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9b384361b300) 00010000:00010000:1.0:1784044200.381055:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784044200.381056:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fda00/0x89871fc3aba18bd3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044200.381059:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fda00/0x89871fc3aba18bd3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044200.381090:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc200/0x89871fc3aba18bc5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca68d8 expref: 26 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044200.381100:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc400/0x89871fc3aba18bda lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca68d8 expref: 25 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044200.381106:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9b397b61ba00) 00010000:00010000:1.0:1784044200.381108:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784044200.381110:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b38426fc400, rc 0) 00000100:00100000:1.0:1784044200.381213:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3844537b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+25:12355:x1870705565192448:12345-192.168.202.40@tcp:101:lfs.0 Request processed in 675us (988us total) trans 4294967455 rc 0/0 00000100:00100000:1.0:1784044200.381219:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 180 00000100:00100000:1.0:1784044200.385549:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1784044200.385596:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044200.385656:0:13808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565192576 00000100:00100000:2.0:1784044200.385666:0:13808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565192576 00000100:00100000:2.0:1784044200.385736:0:13808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 181 00000100:00100000:2.0:1784044200.385746:0:13808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39459b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a93fdf3c-d42f-420a-95ea-b0cbfe954363+25:12355:x1870705565192576:12345-192.168.202.40@tcp:54:lfs.0 00010000:00010000:2.0:1784044200.385818:0:13808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798400/0x89871fc3aba18be8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044200.385834:0:13808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798400/0x89871fc3aba18be8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044200.385845:0:13808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798400/0x89871fc3aba18be8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044200.385907:0:13808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798400/0x89871fc3aba18be8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044200.385913:0:13808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798400/0x89871fc3aba18be8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044200.385918:0:13808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798400/0x89871fc3aba18be8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044200.385921:0:13808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3843798400 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:2.0:1784044200.385925:0:13808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798400/0x89871fc3aba18be8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044200.385931:0:13808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798400/0x89871fc3aba18be8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044200.385940:0:13808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9b397b61ba00) 00010000:00010000:2.0:1784044200.385942:0:13808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1784044200.385945:0:13808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798400/0x89871fc3aba18be8 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044200.385949:0:13808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798400/0x89871fc3aba18be8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044200.386020:0:13808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39459b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a93fdf3c-d42f-420a-95ea-b0cbfe954363+25:12355:x1870705565192576:12345-192.168.202.40@tcp:54:lfs.0 Request processed in 275us (480us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044200.386025:0:13808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 181 00000100:00100000:3.0:1784044200.386508:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565192704 00000100:00100000:3.0:1784044200.386513:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565192704 00000100:00100000:3.0:1784044200.386561:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 13 00000100:00100000:3.0:1784044200.386570:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39459b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+25:2410:x1870705565192704:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784044200.386582:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784044200.386600:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc400/0x89871fc3aba18bda lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca68d8 expref: 25 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044200.386609:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9b397b61ba00) 00010000:00010000:3.0:1784044200.386612:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784044200.386640:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39459b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+24:2410:x1870705565192704:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 73us (1044us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044200.386645:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 13 00000100:00100000:1.0:1784044200.394369:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044200.394486:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565192960 00000100:00100000:0.0:1784044200.394495:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565192960 00000100:00100000:0.0:1784044200.394551:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 47 00000100:00100000:0.0:1784044200.394563:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39459b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+24:12355:x1870705565192960:12345-192.168.202.40@tcp:35:lfs.0 00000100:00100000:0.0:1784044200.394828:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39459b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+25:12355:x1870705565192960:12345-192.168.202.40@tcp:35:lfs.0 Request processed in 266us (469us total) trans 4294967456 rc 0/0 00000100:00100000:0.0:1784044200.394833:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 47 00000100:00100000:0.0:1784044200.538696:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044200.538807:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565193216 00000100:00100000:2.0:1784044200.538822:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565193216 00000100:00100000:2.0:1784044200.538964:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 182 00000100:00100000:2.0:1784044200.538996:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843e0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+25:12373:x1870705565193216:12345-192.168.202.40@tcp:101:cat.0 00010000:00010000:2.0:1784044200.539030:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784044200.539057:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798400/0x89871fc3aba18bef lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcd3dffad52ca68df expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044200.539344:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799400/0x89871fc3aba18bf6 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044200.539364:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799400/0x89871fc3aba18bf6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044200.539378:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799400/0x89871fc3aba18bf6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784044200.539392:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:2.0:1784044200.539541:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798400/0x89871fc3aba18bef lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca68df expref: 28 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044200.539563:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799400/0x89871fc3aba18bf6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca68df expref: 27 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044200.539573:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9b397b61ba00) 00010000:00010000:2.0:1784044200.539576:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1784044200.539580:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3843799400, rc 0) 00000100:00100000:2.0:1784044200.539715:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843e0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+27:12373:x1870705565193216:12345-192.168.202.40@tcp:101:cat.0 Request processed in 721us (1032us total) trans 4294967457 rc 0/0 00000100:00100000:2.0:1784044200.539723:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 182 00000100:00100000:1.0:1784044200.583728:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044200.583980:0:9501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565193344 00000100:00100000:3.0:1784044200.583991:0:9501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565193344 00000100:00100000:3.0:1784044200.584091:0:9501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 183 00000100:00100000:3.0:1784044200.584103:0:9501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39459b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a93fdf3c-d42f-420a-95ea-b0cbfe954363+27:12374:x1870705565193344:12345-192.168.202.40@tcp:101:lfs.0 00010000:00010000:3.0:1784044200.584132:0:9501:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784044200.584154:0:9501:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166b600/0x89871fc3aba18c04 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcd3dffad52ca68e6 expref: -99 pid: 9501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044200.584292:0:9501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166aa00/0x89871fc3aba18c0b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044200.584318:0:9501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166aa00/0x89871fc3aba18c0b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044200.584330:0:9501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166aa00/0x89871fc3aba18c0b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784044200.584382:0:9501:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:3.0:1784044200.584386:0:9501:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1784044200.584407:0:9501:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166aa00/0x89871fc3aba18c0b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044200.584444:0:9501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166b600/0x89871fc3aba18c04 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca68e6 expref: 29 pid: 9501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044200.584463:0:9501:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166aa00/0x89871fc3aba18c0b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca68e6 expref: 28 pid: 9501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044200.584472:0:9501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9b3842777a00) 00010000:00010000:3.0:1784044200.584474:0:9501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1784044200.584478:0:9501:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b394166aa00, rc 0) 00000100:00100000:3.0:1784044200.584543:0:9501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39459b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a93fdf3c-d42f-420a-95ea-b0cbfe954363+28:12374:x1870705565193344:12345-192.168.202.40@tcp:101:lfs.0 Request processed in 443us (825us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044200.584550:0:9501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 183 00010000:00010000:2.0:1784044200.589619:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784044200.595559:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044200.596068:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565193728 00000100:00100000:2.0:1784044200.596101:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565193728 00000100:00100000:2.0:1784044200.596218:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 48 00000100:00100000:2.0:1784044200.596230:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843e0d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+28:12374:x1870705565193728:12345-192.168.202.40@tcp:35:lfs.0 00000100:00100000:2.0:1784044200.599822:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843e0d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+29:12374:x1870705565193728:12345-192.168.202.40@tcp:35:lfs.0 Request processed in 933us (1612us total) trans 4294967458 rc 0/0 00000100:00100000:2.0:1784044200.599835:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 48 00000100:00100000:0.0:1784044200.604386:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044200.604623:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565193856 00000100:00100000:3.0:1784044200.604634:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565193856 00000100:00100000:3.0:1784044200.604717:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 14 00000100:00100000:3.0:1784044200.604727:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843e0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+29:12374:x1870705565193856:12345-192.168.202.40@tcp:103:lfs.0 00010000:00010000:3.0:1784044200.604745:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1784044200.604788:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166ae00/0x89871fc3aba18b9b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca68ca expref: 29 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044200.604812:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799400/0x89871fc3aba18bf6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca68df expref: 28 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044200.604824:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798000/0x89871fc3aba18a91 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6884 expref: 27 pid: 13808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044200.604835:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9b397b61ba00) 00010000:00010000:3.0:1784044200.604839:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784044200.604910:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843e0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+26:12374:x1870705565193856:12345-192.168.202.40@tcp:103:lfs.0 Request processed in 185us (543us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044200.604918:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 14 00000100:00100000:1.0:1784044200.609934:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044200.610096:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565193984 00000100:00100000:0.0:1784044200.610107:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565193984 00000100:00100000:0.0:1784044200.610212:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 184 00000100:00100000:0.0:1784044200.610224:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843cae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+26:12374:x1870705565193984:12345-192.168.202.40@tcp:58:lfs.0 00010000:00010000:0.0:1784044200.610366:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6600/0x89871fc3aba18c12 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044200.610509:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6600/0x89871fc3aba18c12 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044200.610529:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6600/0x89871fc3aba18c12 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1784044200.610639:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:0.0:1784044200.610750:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843cae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+26:12374:x1870705565193984:12345-192.168.202.40@tcp:58:lfs.0 Request processed in 527us (823us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044200.610758:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 184 00000100:00100000:0.0:1784044200.646715:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044200.646931:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565194112 00000100:00100000:2.0:1784044200.646939:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565194112 00000100:00100000:2.0:1784044200.647035:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 185 00000100:00100000:2.0:1784044200.647046:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3975b88a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+26:12376:x1870705565194112:12345-192.168.202.40@tcp:101:lfs.0 00010000:00010000:2.0:1784044200.647067:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784044200.647086:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798400/0x89871fc3aba18c19 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcd3dffad52ca68ed expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044200.647150:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798000/0x89871fc3aba18c20 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044200.647165:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798000/0x89871fc3aba18c20 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044200.647223:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798000/0x89871fc3aba18c20 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044200.647236:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799400/0x89871fc3aba18c27 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044200.647241:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799400/0x89871fc3aba18c27 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044200.647246:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799400/0x89871fc3aba18c27 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044200.647329:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799000/0x89871fc3aba18c2e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044200.647339:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799000/0x89871fc3aba18c2e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044200.647346:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799000/0x89871fc3aba18c2e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784044200.647393:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:2.0:1784044200.647398:0:6511:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1784044200.647428:0:6511:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799000/0x89871fc3aba18c2e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044200.647443:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799000/0x89871fc3aba18c2e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044200.647451:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798000/0x89871fc3aba18c20 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044200.647455:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798000/0x89871fc3aba18c20 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044200.647460:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798000/0x89871fc3aba18c20 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044200.647463:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3843798000 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:2.0:1784044200.647467:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798000/0x89871fc3aba18c20 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044200.647471:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798000/0x89871fc3aba18c20 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044200.647486:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9b3842777a00) 00010000:00010000:2.0:1784044200.647488:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784044200.647492:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798000/0x89871fc3aba18c20 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044200.647496:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798000/0x89871fc3aba18c20 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044200.647506:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799400/0x89871fc3aba18c27 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044200.647509:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799400/0x89871fc3aba18c27 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044200.647513:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799400/0x89871fc3aba18c27 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044200.647516:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3843799400 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:2.0:1784044200.647518:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799400/0x89871fc3aba18c27 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044200.647529:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799400/0x89871fc3aba18c27 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044200.647533:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9b397b61b500) 00010000:00010000:2.0:1784044200.647535:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784044200.647536:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799400/0x89871fc3aba18c27 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044200.647540:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799400/0x89871fc3aba18c27 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044200.647571:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798400/0x89871fc3aba18c19 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca68ed expref: 28 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044200.647580:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799000/0x89871fc3aba18c2e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca68ed expref: 27 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044200.647585:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9b397b61ba00) 00010000:00010000:2.0:1784044200.647586:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1784044200.647588:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3843799000, rc 0) 00000100:00100000:2.0:1784044200.647632:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3975b88a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+27:12376:x1870705565194112:12345-192.168.202.40@tcp:101:lfs.0 Request processed in 590us (931us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044200.647637:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 185 00000100:00100000:2.0:1784044201.038657:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1870705580994048:0@lo:400:kworker.0 00000100:00100000:2.0:1784044201.038733:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044201.038782:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3640:1870705580994560:0@lo:400:kworker.0 00000100:00100000:3.0:1784044201.038794:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843cfc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:3641:1870705580993664:0@lo:400:kworker.0 00000100:00100000:2.0:1784044201.038805:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044201.038826:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044201.038831:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843c8a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1870705580995072:0@lo:400:kworker.0 00000100:00100000:3.0:1784044201.038847:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d3d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1870705580994176:0@lo:400:kworker.0 00000100:00100000:2.0:1784044201.038855:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044201.038868:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044201.038883:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843c88000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3641:1870705580994688:0@lo:400:kworker.0 00000100:00100000:2.0:1784044201.038902:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843cffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1870705580993792:0@lo:400:kworker.0 00000100:00100000:3.0:1784044201.038903:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044201.038919:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843c88e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1870705580995200:0@lo:400:kworker.0 00000100:00100000:2.0:1784044201.038923:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044201.039311:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1870705580994304:0@lo:400:kworker.0 00000100:00100000:2.0:1784044201.039338:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044201.039362:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843c8b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3638:1870705580994816:0@lo:400:kworker.0 00000100:00100000:2.0:1784044201.039454:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044201.039490:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1784044201.039496:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39503bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1870705580993920:0@lo:400:kworker.0 00000100:00100000:2.0:1784044201.039583:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044201.039607:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d3c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1870705580994432:0@lo:400:kworker.0 00000100:00100000:2.0:1784044201.039630:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044201.039648:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843c88380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3638:1870705580994944:0@lo:400:kworker.0 00000100:00100000:2.0:1784044201.039667:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044201.039697:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580994048 00000100:00100000:2.0:1784044201.039703:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580994048 00000100:00100000:2.0:1784044201.039744:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580994560 00000100:00100000:2.0:1784044201.039747:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580994560 00000100:00100000:2.0:1784044201.039772:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580994688 00000100:00100000:2.0:1784044201.039775:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580994688 00000100:00100000:2.0:1784044201.039787:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580993792 00000100:00100000:2.0:1784044201.039789:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580993792 00000100:00100000:2.0:1784044201.039798:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580994816 00000100:00100000:2.0:1784044201.039800:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580994816 00000100:00100000:2.0:1784044201.039811:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580994944 00000100:00100000:2.0:1784044201.039813:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580994944 00000100:00100000:2.0:1784044201.039828:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 354 00000100:00100000:2.0:1784044201.039835:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843c8bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1870705580994048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784044201.039985:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580995072 00000100:00100000:0.0:1784044201.039990:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580995072 00000100:00100000:0.0:1784044201.040021:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580994304 00000100:00100000:0.0:1784044201.040024:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580994304 00000100:00100000:0.0:1784044201.040036:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580994432 00000100:00100000:0.0:1784044201.040039:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580994432 00000100:00100000:0.0:1784044201.040050:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1784044201.040056:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397f9df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1870705580995072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784044201.040101:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397f9df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1870705580995072:12345-0@lo:400:kworker.0 Request processed in 45us (1244us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044201.040109:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1784044201.040125:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1784044201.040131:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397f9dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1870705580994304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784044201.040201:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397f9dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1870705580994304:12345-0@lo:400:kworker.0 Request processed in 70us (862us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044201.040207:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1784044201.040219:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1784044201.040225:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397aa54e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1870705580994432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784044201.040251:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397aa54e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1870705580994432:12345-0@lo:400:kworker.0 Request processed in 27us (620us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044201.040257:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1784044201.040501:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843c8bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1870705580994048:12345-0@lo:400:kworker.0 Request processed in 664us (1766us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044201.040508:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 354 00000100:00100000:2.0:1784044201.040595:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 355 00000100:00100000:2.0:1784044201.040603:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843c89180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1870705580994560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784044201.040637:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843c89180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1870705580994560:12345-0@lo:400:kworker.0 Request processed in 36us (1830us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044201.040643:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 355 00000100:00100000:2.0:1784044201.040670:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 356 00000100:00100000:2.0:1784044201.040676:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3844534380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1870705580994688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784044201.040708:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3844534380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1870705580994688:12345-0@lo:400:kworker.0 Request processed in 33us (1803us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044201.040714:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 356 00000100:00100000:2.0:1784044201.040726:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 357 00000100:00100000:2.0:1784044201.040732:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397f9dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1870705580993792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784044201.040759:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397f9dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1870705580993792:12345-0@lo:400:kworker.0 Request processed in 28us (1835us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044201.040765:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 357 00000100:00100000:2.0:1784044201.040777:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 358 00000100:00100000:2.0:1784044201.040783:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397f9dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1870705580994816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784044201.040807:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397f9dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1870705580994816:12345-0@lo:400:kworker.0 Request processed in 25us (1354us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044201.040812:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 358 00000100:00100000:2.0:1784044201.040821:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 359 00000100:00100000:2.0:1784044201.040826:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397aa55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1870705580994944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784044201.040852:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397aa55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1870705580994944:12345-0@lo:400:kworker.0 Request processed in 26us (1183us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044201.040857:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 359 00000100:00100000:2.0:1784044201.040970:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580994176 00000100:00100000:2.0:1784044201.040977:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580994176 00000100:00100000:2.0:1784044201.041016:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580993920 00000100:00100000:2.0:1784044201.041021:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580993920 00000100:00100000:2.0:1784044201.041034:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:2.0:1784044201.041040:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3844535c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1870705580994176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784044201.041084:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3844535c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1870705580994176:12345-0@lo:400:kworker.0 Request processed in 44us (2215us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044201.041091:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:2.0:1784044201.041103:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:2.0:1784044201.041108:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397aa54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1870705580993920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784044201.041136:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397aa54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1870705580993920:12345-0@lo:400:kworker.0 Request processed in 28us (1553us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044201.041142:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00080000:2.0:1784044201.041355:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1784044201.041361:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1784044201.041363:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784044201.041485:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1870705580994048:0@lo:400:kworker.0 00000100:00100000:2.0:1784044201.041497:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3640:1870705580994560:0@lo:400:kworker.0 00000100:00100000:2.0:1784044201.041508:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843c8a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1870705580995072:0@lo:400:kworker.0 00000100:00100000:2.0:1784044201.041695:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39503bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1870705580993920:0@lo:400:kworker.0 00000100:00100000:2.0:1784044201.041706:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d3c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1870705580994432:0@lo:400:kworker.0 00010000:00080000:2.0:1784044201.041718:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b3843c88380 x1870705580994944/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044217 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784044201.041727:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843c88380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3638:1870705580994944:0@lo:400:kworker.0 00000100:00100000:2.0:1784044201.041736:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843cffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1870705580993792:0@lo:400:kworker.0 00000100:00100000:2.0:1784044201.041747:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1870705580994304:0@lo:400:kworker.0 00000100:00100000:2.0:1784044201.041755:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843c8b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3638:1870705580994816:0@lo:400:kworker.0 00000100:00100000:0.0:1784044201.042311:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580993664 00000100:00100000:0.0:1784044201.042318:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580993664 00000100:00100000:0.0:1784044201.042364:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 419 00000100:00100000:0.0:1784044201.042453:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3950370c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+24:3641:x1870705580993664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784044201.042510:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3950370c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+24:3641:x1870705580993664:12345-0@lo:400:kworker.0 Request processed in 138us (3683us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044201.042536:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 419 00000100:00100000:2.0:1784044201.043979:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1784044201.043999:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843cffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1870705580995328:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784044201.044050:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044201.044095:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580995328 00000100:00100000:2.0:1784044201.044100:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580995328 00000100:00100000:2.0:1784044201.044141:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1784044201.044148:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39503bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3639:x1870705580995328:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1784044201.044266:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33971904 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784044201.044308:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39503bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3639:x1870705580995328:12345-0@lo:13:osp-pre-1-0.0 Request processed in 160us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044201.044315:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1784044201.044359:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843cffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1870705580995328:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784044201.044715:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3975b8a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1870705580995456:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1784044201.044742:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044201.044807:0:10713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580995456 00000100:00100000:0.0:1784044201.044811:0:10713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580995456 00000100:00100000:0.0:1784044201.044881:0:10713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1784044201.044888:0:10713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843cffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1870705580995456:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1784044201.044900:0:10713:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33971904 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784044201.044937:0:10713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843cffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1870705580995456:12345-0@lo:13:osp-pre-1-1.0 Request processed in 49us (193us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044201.044944:0:10713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1784044201.044993:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3975b8a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1870705580995456:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1784044201.045050:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044201.045103:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580995200 00000100:00100000:2.0:1784044201.045106:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580995200 00000100:00100000:2.0:1784044201.045198:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1784044201.045206:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3844534000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3641:x1870705580995200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784044201.045238:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3844534000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3641:x1870705580995200:12345-0@lo:400:kworker.0 Request processed in 34us (188us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044201.045240:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843cfc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:3641:1870705580993664:0@lo:400:kworker.0 00000100:00100000:2.0:1784044201.045245:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1784044201.046170:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d3d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1870705580994176:0@lo:400:kworker.0 00010000:00080000:3.0:1784044201.046216:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b3843c88000 x1870705580994688/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044217 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784044201.046235:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843c88000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3641:1870705580994688:0@lo:400:kworker.0 00000100:00100000:3.0:1784044201.046250:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843c88e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1870705580995200:0@lo:400:kworker.0 00000040:00080000:0.0:1784044201.293556:0:13763:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1784044201.293566:0:13763:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1784044201.293607:0:13763:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:0.0:1784044201.293616:0:13763:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1784044201.293761:0:13763:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3975b88380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13763:1870705580995584:192.168.202.40@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1784044201.293863:0:13763:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3975ba9240 going to sleep for 11 seconds 00000100:00100000:1.0:1784044201.308257:0:13763:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3975b88380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13763:1870705580995584:192.168.202.40@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1784044201.318805:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044201.318978:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565194240 00000100:00100000:2.0:1784044201.318988:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565194240 00000100:00100000:2.0:1784044201.319059:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 186 00000100:00100000:2.0:1784044201.319392:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3975b88380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+27:12387:x1870705565194240:12345-192.168.202.40@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1784044201.319447:0:6512:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1784044201.319751:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3975b88380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+27:12387:x1870705565194240:12345-192.168.202.40@tcp:53:lhsmtool_posix.0 Request processed in 681us (958us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044201.319761:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 186 00000100:00100000:2.0:1784044201.342138:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1784044201.344405:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565194368 00000100:00100000:1.0:1784044201.344431:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565194368 00000100:00100000:1.0:1784044201.344549:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 187 00000100:00100000:1.0:1784044201.344560:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843cfc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+27:12387:x1870705565194368:12345-192.168.202.40@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1784044201.344639:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd400/0x89871fc3aba18c35 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044201.344660:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd400/0x89871fc3aba18c35 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044201.344676:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd400/0x89871fc3aba18c35 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044201.344725:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc000/0x89871fc3aba18c3c lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044201.344733:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc000/0x89871fc3aba18c3c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044201.344740:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc000/0x89871fc3aba18c3c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044201.344767:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fdc00/0x89871fc3aba18c43 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044201.344776:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fdc00/0x89871fc3aba18c43 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044201.344783:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fdc00/0x89871fc3aba18c43 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784044201.344845:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:1.0:1784044201.344849:0:6511:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1784044201.344864:0:6511:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fdc00/0x89871fc3aba18c43 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044201.345816:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd400/0x89871fc3aba18c35 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044201.345831:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd400/0x89871fc3aba18c35 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044201.345841:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd400/0x89871fc3aba18c35 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044201.345848:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38426fd400 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:1.0:1784044201.345852:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd400/0x89871fc3aba18c35 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044201.345860:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd400/0x89871fc3aba18c35 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044201.345948:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9b396f2a8900) 00010000:00010000:1.0:1784044201.345953:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784044201.345959:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd400/0x89871fc3aba18c35 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044201.345966:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd400/0x89871fc3aba18c35 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044201.345978:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc000/0x89871fc3aba18c3c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044201.345998:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc000/0x89871fc3aba18c3c lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044201.346004:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc000/0x89871fc3aba18c3c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044201.346009:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38426fc000 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:1.0:1784044201.346013:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc000/0x89871fc3aba18c3c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044201.346019:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc000/0x89871fc3aba18c3c lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044201.346027:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xdc6beff1 (ffff9b384361bc00) 00010000:00010000:1.0:1784044201.346029:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784044201.346033:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc000/0x89871fc3aba18c3c lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044201.346038:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc000/0x89871fc3aba18c3c lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044201.346054:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fdc00/0x89871fc3aba18c43 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044201.346061:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fdc00/0x89871fc3aba18c43 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044201.346066:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fdc00/0x89871fc3aba18c43 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044201.346071:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38426fdc00 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:1.0:1784044201.346079:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fdc00/0x89871fc3aba18c43 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044201.346086:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fdc00/0x89871fc3aba18c43 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044201.346094:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9b397b61ba00) 00010000:00010000:1.0:1784044201.346097:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784044201.346100:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fdc00/0x89871fc3aba18c43 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044201.346106:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fdc00/0x89871fc3aba18c43 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044201.346274:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843cfc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+27:12387:x1870705565194368:12345-192.168.202.40@tcp:34:lhsmtool_posix.0 Request processed in 1712us (4146us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044201.346283:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 187 00000100:00100000:0.0:1784044201.354326:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044201.354462:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565194624 00000100:00100000:3.0:1784044201.354472:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565194624 00000100:00100000:3.0:1784044201.354548:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 188 00000100:00100000:3.0:1784044201.354560:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3975b8a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+27:12387:x1870705565194624:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1784044201.354586:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784044201.354608:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166ae00/0x89871fc3aba18c4a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcd3dffad52ca68f4 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044201.354729:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166b600/0x89871fc3aba18c51 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044201.354747:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166b600/0x89871fc3aba18c51 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044201.354759:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166b600/0x89871fc3aba18c51 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784044201.354771:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:3.0:1784044201.354866:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166b600/0x89871fc3aba18c51 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044201.354888:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166b600/0x89871fc3aba18c51 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044201.354894:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166b600/0x89871fc3aba18c51 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044201.354918:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b394166b600 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:3.0:1784044201.354922:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166b600/0x89871fc3aba18c51 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044201.354929:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166b600/0x89871fc3aba18c51 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044201.354942:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9b397b61ba00) 00010000:00010000:3.0:1784044201.354946:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1784044201.354951:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166b600/0x89871fc3aba18c51 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044201.354957:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166b600/0x89871fc3aba18c51 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044201.354999:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166ae00/0x89871fc3aba18c4a lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca68f4 expref: 29 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044201.355009:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9b396f2a8900) 00010000:00010000:3.0:1784044201.355011:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1784044201.355015:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166ae00/0x89871fc3aba18c4a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca68f4 expref: 29 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044201.355024:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b394166ae00, rc 0) 00000100:00100000:3.0:1784044201.355092:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3975b8a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+28:12387:x1870705565194624:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 Request processed in 534us (778us total) trans 4294967459 rc 301/301 00000100:00100000:3.0:1784044201.355100:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 188 00000100:00100000:0.0:1784044201.359329:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044201.359995:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565194752 00000100:00100000:2.0:1784044201.360006:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565194752 00000100:00100000:2.0:1784044201.360072:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 189 00000100:00100000:2.0:1784044201.360082:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38435eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+28:12387:x1870705565194752:12345-192.168.202.40@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1784044201.360120:0:6512:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1784044201.360269:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38435eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+28:12387:x1870705565194752:12345-192.168.202.40@tcp:53:lhsmtool_posix.0 Request processed in 188us (951us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044201.360277:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 189 00000100:00100000:3.0:1784044201.370809:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044201.370979:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565195008 00000100:00100000:0.0:1784044201.370989:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565195008 00000100:00100000:0.0:1784044201.371051:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 190 00000100:00100000:0.0:1784044201.371061:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3844534700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+28:12387:x1870705565195008:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1784044201.371082:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784044201.371085:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1784044201.371113:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166aa00/0x89871fc3aba18c0b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca68e6 expref: 28 pid: 9501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044201.371146:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9b3842777a00) 00010000:00010000:0.0:1784044201.371157:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784044201.371199:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7000/0x89871fc3aba18c5f lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcd3dffad52ca68fb expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1784044201.371638:0:6513:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x5:0x0], index 0: 0 00010000:00010000:0.0:1784044201.371782:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7600/0x89871fc3aba18c66 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044201.371795:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7600/0x89871fc3aba18c66 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044201.371805:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7600/0x89871fc3aba18c66 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044201.371858:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7000/0x89871fc3aba18c5f lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca68fb expref: 30 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044201.371875:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7600/0x89871fc3aba18c66 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca68fb expref: 29 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044201.371882:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9b3974d3ad00) 00010000:00010000:0.0:1784044201.371884:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784044201.371887:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b38410b7600, rc 0) 00000100:00100000:0.0:1784044201.371951:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3844534700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+29:12387:x1870705565195008:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 Request processed in 891us (1152us total) trans 4294967460 rc 0/0 00000100:00100000:0.0:1784044201.371960:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 190 00000100:00100000:2.0:1784044201.394071:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044201.394195:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565195264 00000100:00100000:0.0:1784044201.394205:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565195264 00000100:00100000:0.0:1784044201.394271:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 191 00000100:00100000:0.0:1784044201.394282:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843c88e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+29:12387:x1870705565195264:12345-192.168.202.40@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1784044201.394349:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784044201.394380:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7600/0x89871fc3aba18c66 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca68fb expref: 29 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044201.394401:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9b3974d3ad00) 00010000:00010000:0.0:1784044201.394419:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784044201.394447:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7000/0x89871fc3aba18c74 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044201.394462:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7000/0x89871fc3aba18c74 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044201.394473:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7000/0x89871fc3aba18c74 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044201.394488:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7c00/0x89871fc3aba18c7b lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x7a03fe9d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044201.394495:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7c00/0x89871fc3aba18c7b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x7a03fe9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044201.394502:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7c00/0x89871fc3aba18c7b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x7a03fe9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044201.394563:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7000/0x89871fc3aba18c74 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044201.394581:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7000/0x89871fc3aba18c74 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044201.394587:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7000/0x89871fc3aba18c74 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044201.394593:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38410b7000 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:0.0:1784044201.394597:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7000/0x89871fc3aba18c74 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044201.394604:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7000/0x89871fc3aba18c74 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044201.394613:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9b3842777a00) 00010000:00010000:0.0:1784044201.394616:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784044201.394620:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7000/0x89871fc3aba18c74 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044201.394626:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7000/0x89871fc3aba18c74 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044201.394635:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7c00/0x89871fc3aba18c7b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x7a03fe9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044201.394640:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7c00/0x89871fc3aba18c7b lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x7a03fe9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044201.394645:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7c00/0x89871fc3aba18c7b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x7a03fe9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044201.394650:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38410b7c00 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:0.0:1784044201.394659:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7c00/0x89871fc3aba18c7b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x7a03fe9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044201.394666:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7c00/0x89871fc3aba18c7b lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x7a03fe9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044201.394674:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x7a03fe9d (ffff9b3974d3a800) 00010000:00010000:0.0:1784044201.394676:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784044201.394679:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7c00/0x89871fc3aba18c7b lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x7a03fe9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044201.394684:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7c00/0x89871fc3aba18c7b lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x7a03fe9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044201.394783:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843c88e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+28:12387:x1870705565195264:12345-192.168.202.40@tcp:36:lhsmtool_posix.0 Request processed in 502us (720us total) trans 0 rc -2/-2 00000100:00100000:0.0:1784044201.394791:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 191 00000100:00100000:3.0:1784044201.403226:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1784044201.403307:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565195392 00000100:00100000:1.0:1784044201.403316:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565195392 00000100:00100000:1.0:1784044201.403371:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 192 00000100:00100000:1.0:1784044201.403380:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397bbbfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+28:12387:x1870705565195392:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1784044201.403400:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784044201.403432:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fdc00/0x89871fc3aba18c82 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcd3dffad52ca6902 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044201.403467:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc000/0x89871fc3aba18c89 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044201.403482:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc000/0x89871fc3aba18c89 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044201.403509:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc000/0x89871fc3aba18c89 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044201.403618:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fdc00/0x89871fc3aba18c82 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6902 expref: 30 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044201.403635:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc000/0x89871fc3aba18c89 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6902 expref: 29 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044201.403643:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9b384361bc00) 00010000:00010000:1.0:1784044201.403646:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1784044201.403649:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b38426fc000, rc 0) 00000100:00100000:1.0:1784044201.403702:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397bbbfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+29:12387:x1870705565195392:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 Request processed in 324us (484us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044201.403709:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 192 00000100:00100000:0.0:1784044201.410654:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044201.410699:0:13808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565195648 00000100:00100000:0.0:1784044201.410709:0:13808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565195648 00000100:00100000:0.0:1784044201.410763:0:13808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 193 00000100:00100000:0.0:1784044201.410773:0:13808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38435ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a93fdf3c-d42f-420a-95ea-b0cbfe954363+29:12387:x1870705565195648:12345-192.168.202.40@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1784044201.410859:0:13808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6800/0x89871fc3aba18c90 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044201.410892:0:13808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6800/0x89871fc3aba18c90 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044201.410904:0:13808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6800/0x89871fc3aba18c90 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1784044201.411128:0:13808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].6, 88 off8648 00000004:00080000:0.0:1784044201.411139:0:13808:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 394581963616ns, next at 395581960764ns, rc = 0 00000004:00010000:0.0:1784044201.411233:0:13808:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000bd248e83 reply state 000000005e24928a transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6800/0x89871fc3aba18c90 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044201.411247:0:13808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6800/0x89871fc3aba18c90 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044201.411254:0:13808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9b384361bc00) 00010000:00010000:0.0:1784044201.411257:0:13808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1784044201.411260:0:13808:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1784044201.411367:0:13808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38435ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a93fdf3c-d42f-420a-95ea-b0cbfe954363+31:12387:x1870705565195648:12345-192.168.202.40@tcp:36:lhsmtool_posix.0 Request processed in 595us (722us total) trans 4294967461 rc 0/0 00000100:00100000:0.0:1784044201.411374:0:13808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 193 00000100:00100000:2.0:1784044201.415379:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044201.415480:0:9501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565195776 00000100:00100000:0.0:1784044201.415490:0:9501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565195776 00000100:00100000:0.0:1784044201.415956:0:9501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 194 00000100:00100000:0.0:1784044201.415967:0:9501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843c88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a93fdf3c-d42f-420a-95ea-b0cbfe954363+31:12387:x1870705565195776:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1784044201.415993:0:9501:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784044201.416015:0:9501:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6a00/0x89871fc3aba18c97 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcd3dffad52ca6909 expref: -99 pid: 9501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044201.416073:0:9501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6a00/0x89871fc3aba18c97 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6909 expref: 32 pid: 9501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044201.416088:0:9501:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6a00/0x89871fc3aba18c97 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6909 expref: 32 pid: 9501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044201.416124:0:9501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9b384361bc00) 00010000:00010000:0.0:1784044201.416128:0:9501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1784044201.416132:0:9501:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b38410b6a00, rc 0) 00000100:00100000:0.0:1784044201.416723:0:9501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843c88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a93fdf3c-d42f-420a-95ea-b0cbfe954363+32:12387:x1870705565195776:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 Request processed in 755us (1351us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044201.416731:0:9501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 194 00000100:00100000:3.0:1784044201.419627:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044201.419700:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565195904 00000100:00100000:0.0:1784044201.419709:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565195904 00000100:00100000:0.0:1784044201.419776:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 61 00000100:00100000:0.0:1784044201.419787:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397bbbdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+6:2410:x1870705565195904:12345-192.168.202.40@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1784044201.420008:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397bbbdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+7:2410:x1870705565195904:12345-192.168.202.40@tcp:2:lhsmtool_posix.0 Request processed in 222us (389us total) trans 4294967314 rc 0/0 00000100:00100000:0.0:1784044201.420015:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 61 00000100:00080000:3.0:1784044201.420378:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784044201.424240:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044201.424319:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565196160 00000100:00100000:0.0:1784044201.424328:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565196160 00000100:00100000:0.0:1784044201.424387:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 49 00000100:00100000:0.0:1784044201.424397:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397bbbc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+32:12387:x1870705565196160:12345-192.168.202.40@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1784044201.424643:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397bbbc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+33:12387:x1870705565196160:12345-192.168.202.40@tcp:35:lhsmtool_posix.0 Request processed in 247us (412us total) trans 4294967462 rc 0/0 00000100:00100000:0.0:1784044201.424651:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 49 00000100:00100000:1.0:1784044201.430250:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1784044201.430308:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565196416 00000100:00100000:1.0:1784044201.430317:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565196416 00000100:00100000:1.0:1784044201.430376:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 195 00000100:00100000:1.0:1784044201.430387:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843cad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+33:12387:x1870705565196416:12345-192.168.202.40@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1784044201.431030:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843cad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+33:12387:x1870705565196416:12345-192.168.202.40@tcp:57:lhsmtool_posix.0 Request processed in 642us (785us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044201.431039:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 195 00000040:00080000:0.0:1784044201.434387:0:14660:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1784044201.434397:0:14660:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1784044201.434443:0:14660:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:0.0:1784044201.434450:0:14660:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1784044201.438817:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1784044201.438940:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565196544 00000100:00100000:1.0:1784044201.438950:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565196544 00000100:00100000:1.0:1784044201.439066:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 196 00000100:00100000:1.0:1784044201.439083:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397bbbd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+33:12387:x1870705565196544:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1784044201.439101:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784044201.439121:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fdc00/0x89871fc3aba18c9e lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcd3dffad52ca6910 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044201.439244:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd000/0x89871fc3aba18ca5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044201.439259:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd000/0x89871fc3aba18ca5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044201.439272:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd000/0x89871fc3aba18ca5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784044201.439317:0:6512:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1784044201.439336:0:6512:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd000/0x89871fc3aba18ca5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044201.439360:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fdc00/0x89871fc3aba18c9e lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6910 expref: 35 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044201.439377:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd000/0x89871fc3aba18ca5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6910 expref: 34 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044201.439385:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9b384361bc00) 00010000:00010000:1.0:1784044201.439388:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1784044201.439392:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b38426fd000, rc 0) 00000100:00100000:1.0:1784044201.439460:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397bbbd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+34:12387:x1870705565196544:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 Request processed in 379us (650us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044201.439476:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 196 00000100:00100000:1.0:1784044201.450984:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044201.451127:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565196672 00000100:00100000:3.0:1784044201.451137:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565196672 00000100:00100000:0.0:1784044201.456336:0:9822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 62 00000100:00100000:0.0:1784044201.456357:0:9822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843ce6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a93fdf3c-d42f-420a-95ea-b0cbfe954363+7:2409:x1870705565196672:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1784044201.456379:0:9822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784044201.456400:0:9822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dd76b27e/0x89871fc3aba18cac lrc: 2/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcd3dffad52ca6917 expref: -99 pid: 9822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784044201.456442:0:9822:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a565aa9, blocks: 0x0 00010000:00010000:0.0:1784044201.456464:0:9822:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=394s v=(0 0) 00010000:00010000:0.0:1784044201.456470:0:9822:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784044201.456480:0:9822:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dd76b27e/0x89871fc3aba18cac lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6917 expref: 8 pid: 9822 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044201.456501:0:9822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000dd76b27e/0x89871fc3aba18cac lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6917 expref: 8 pid: 9822 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044201.456515:0:9822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b38410b7000, rc 0) 00000100:00100000:0.0:1784044201.456588:0:9822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843ce6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a93fdf3c-d42f-420a-95ea-b0cbfe954363+8:2409:x1870705565196672:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 Request processed in 239us (5610us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044201.456597:0:9822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 62 00000100:00100000:1.0:1784044201.459729:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044201.460166:0:9501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565196928 00000100:00100000:0.0:1784044201.460198:0:9501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565196928 00000100:00100000:0.0:1784044201.460246:0:9501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 197 00000100:00100000:0.0:1784044201.460255:0:9501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a93fdf3c-d42f-420a-95ea-b0cbfe954363+34:12387:x1870705565196928:12345-192.168.202.40@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1784044201.460346:0:9501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a93fdf3c-d42f-420a-95ea-b0cbfe954363+34:12387:x1870705565196928:12345-192.168.202.40@tcp:57:lhsmtool_posix.0 Request processed in 91us (624us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044201.460353:0:9501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 197 00000100:00100000:0.0:1784044201.482362:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044201.482433:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565197056 00000100:00100000:2.0:1784044201.482445:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565197056 00000100:00100000:2.0:1784044201.482511:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 63 00000100:00100000:2.0:1784044201.482593:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38435ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+8:12387:x1870705565197056:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1784044201.482614:0:8426:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784044201.482633:0:8426:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003c1ecb33/0x89871fc3aba18cb3 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcd3dffad52ca691e expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044201.482669:0:8426:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000dd76b27e/0x89871fc3aba18cac lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6917 expref: 9 pid: 9822 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044201.482691:0:8426:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784044201.482696:0:8426:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784044201.482703:0:8426:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003c1ecb33/0x89871fc3aba18cb3 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca691e expref: 9 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044201.482742:0:8426:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000dd76b27e/0x89871fc3aba18cac lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6917 expref: 9 pid: 9822 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044201.482757:0:8426:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000dd76b27e/0x89871fc3aba18cac lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6917 expref: 9 pid: 9822 timeout: 494 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044201.482774:0:8426:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843c8b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8426:1870705580995712:192.168.202.40@tcp:104: 00000100:00100000:2.0:1784044201.482882:0:8426:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b397b8d3cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1784044201.487574:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044201.487656:0:8426:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843c8b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8426:1870705580995712:192.168.202.40@tcp:104: 00010000:00010000:3.0:1784044201.487688:0:8426:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003c1ecb33/0x89871fc3aba18cb3 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca691e expref: 9 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044201.487708:0:8426:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3843799800, rc 0) 00000100:00100000:3.0:1784044201.487764:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38435ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+9:12387:x1870705565197056:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 Request processed in 5176us (5413us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044201.487771:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 63 00000100:00100000:3.0:1784044201.487814:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565197184 00000100:00100000:3.0:1784044201.487818:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565197184 00010000:00010000:3.0:1784044201.487841:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000dd76b27e/0x89871fc3aba18cac lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6917 expref: 9 pid: 9822 timeout: 494 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044201.487861:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 93 00000100:00100000:3.0:1784044201.487867:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d4f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+9:2410:x1870705565197184:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784044201.487879:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784044201.487900:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000dd76b27e/0x89871fc3aba18cac lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6917 expref: 9 pid: 9822 timeout: 494 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044201.487913:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000dd76b27e/0x89871fc3aba18cac lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6917 expref: 9 pid: 9822 timeout: 494 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044201.487946:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dd76b27e/0x89871fc3aba18cac lrc: 0/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6917 expref: 9 pid: 9822 timeout: 494 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044201.487956:0:6496:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784044201.487960:0:6496:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784044201.487966:0:6496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003c1ecb33/0x89871fc3aba18cb3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca691e expref: 8 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044201.487973:0:6496:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003c1ecb33/0x89871fc3aba18cb3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca691e expref: 8 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044201.488001:0:6496:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000003c1ecb33/0x89871fc3aba18cb3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca691e expref: 8 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044201.488013:0:6496:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397bbbca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6496:1870705580995840:192.168.202.40@tcp:105: 00000100:00100000:3.0:1784044201.488055:0:6496:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3943259180 going to sleep for 11 seconds 00000100:00100000:3.0:1784044201.491998:0:6496:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397bbbca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6496:1870705580995840:192.168.202.40@tcp:105: 00010000:00010000:3.0:1784044201.492025:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784044201.492084:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d4f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+8:2410:x1870705565197184:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 4216us (4522us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044201.492096:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 93 00000100:00100000:1.0:1784044201.497047:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044201.497280:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565197312 00000100:00100000:0.0:1784044201.497300:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565197312 00002000:00100000:0.0:1784044201.497350:0:8431:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff9b3843737b80 x1870705565197312/t0(0) o4->a93fdf3c-d42f-420a-95ea-b0cbfe954363@192.168.202.40@tcp:352/0 lens 504/0 e 0 to 0 dl 1784044212 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784044201.497359:0:8431:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b3843737b80 with x1870705565197312 ext(0->8) 00002000:00010000:0.0:1784044201.497364:0:8431:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b3843737b80 00000100:00100000:0.0:1784044201.497391:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4 00000100:00100000:0.0:1784044201.497400:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843737b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+8:2409:x1870705565197312:12345-192.168.202.40@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1784044201.498767:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843737b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+10:2409:x1870705565197312:12345-192.168.202.40@tcp:4:lhsmtool_posix.0 Request processed in 1361us (1722us total) trans 4294967315 rc 0/0 00000100:00100000:0.0:1784044201.498778:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4 00002000:00100000:0.0:1784044201.498789:0:8431:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff9b3843737b80 x1870705565197312/t4294967315(0) o4->a93fdf3c-d42f-420a-95ea-b0cbfe954363@192.168.202.40@tcp:352/0 lens 504/448 e 0 to 0 dl 1784044212 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784044201.498799:0:8431:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b3843737b80 with x1870705565197312 ext(0->8) 00002000:00010000:0.0:1784044201.498804:0:8431:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b3843737b80 00000100:00100000:0.0:1784044201.501537:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1784044201.501611:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565197440 00000100:00100000:1.0:1784044201.501620:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565197440 00000100:00100000:1.0:1784044201.501712:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 198 00000100:00100000:1.0:1784044201.501723:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38420aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+34:12387:x1870705565197440:12345-192.168.202.40@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1784044201.503574:0:6490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967462 is committed 00000004:00080000:0.0:1784044201.503589:0:6490:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 7 committed 00010000:00010000:2.0:1784044201.503684:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6200/0x89871fc3aba18b86 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044201.503696:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6200/0x89871fc3aba18b86 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044201.503704:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6200/0x89871fc3aba18b86 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044201.503711:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38410b6200 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:2.0:1784044201.503715:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6200/0x89871fc3aba18b86 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044201.503723:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6200/0x89871fc3aba18b86 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044201.503746:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9b397b61ba00) 00010000:00010000:2.0:1784044201.503749:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784044201.503753:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6200/0x89871fc3aba18b86 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044201.503760:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6200/0x89871fc3aba18b86 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044201.503778:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6800/0x89871fc3aba18c90 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044201.503784:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6800/0x89871fc3aba18c90 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044201.503790:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6800/0x89871fc3aba18c90 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044201.503794:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38410b6800 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:2.0:1784044201.503797:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6800/0x89871fc3aba18c90 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044201.503802:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6800/0x89871fc3aba18c90 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044201.503810:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9b384361bc00) 00010000:00010000:2.0:1784044201.503813:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1784044201.503816:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6800/0x89871fc3aba18c90 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044201.503822:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6800/0x89871fc3aba18c90 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044201.504020:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1784044201.504035:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843735880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1870705580995968:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1784044201.504095:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044201.504135:0:9822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580995968 00000100:00100000:1.0:1784044201.504140:0:9822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580995968 00000100:00100000:1.0:1784044201.504392:0:9822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1784044201.504401:0:9822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843737480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3641:x1870705580995968:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1784044201.504532:0:9822:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1784044201.504535:0:9822:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1784044201 00002000:00010000:1.0:1784044201.504537:0:9822:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1784044201.504539:0:9822:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 1784044201 -> 1784044201 00002000:00010000:1.0:1784044201.504542:0:9822:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:1.0:1784044201.504581:0:9822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843737480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3641:x1870705580995968:12345-0@lo:2:osp-syn-0-0.0 Request processed in 181us (485us total) trans 4294967316 rc 0/0 00000100:00100000:1.0:1784044201.504588:0:9822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000020:00080000:0.0:1784044201.504698:0:6490:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000020:00080000:1.0:1784044201.504782:0:6544:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000020:00080000:1.0:1784044201.504793:0:6544:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000004:00080000:1.0:1784044201.504833:0:3641:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b3843735880/2, rc 0, transno 4294967316 00000100:00100000:1.0:1784044201.504839:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843735880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1870705580995968:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1784044201.505047:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38420aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+19:12387:x1870705565197440:12345-192.168.202.40@tcp:44:lhsmtool_posix.0 Request processed in 3323us (3517us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044201.505056:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 198 00000100:00100000:0.0:1784044201.511008:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044201.511062:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565197568 00000100:00100000:2.0:1784044201.511072:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565197568 00000100:00100000:2.0:1784044201.511140:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 65 00000100:00100000:2.0:1784044201.511161:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38420ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+10:2410:x1870705565197568:12345-192.168.202.40@tcp:16:lhsmtool_posix.0 00000001:00080000:1.0:1784044201.522039:0:8421:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967316 is committed 00000001:00080000:1.0:1784044201.522053:0:8421:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967315 is committed 00000100:00100000:0.0:1784044201.522576:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38420ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+7:2410:x1870705565197568:12345-192.168.202.40@tcp:16:lhsmtool_posix.0 Request processed in 11420us (11569us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044201.522587:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 65 00000100:00100000:2.0:1784044201.537896:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044201.537977:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565197824 00000100:00100000:0.0:1784044201.537993:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565197824 00000100:00100000:0.0:1784044201.538054:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 199 00000100:00100000:0.0:1784044201.538064:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843c88380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+19:12387:x1870705565197824:12345-192.168.202.40@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1784044201.538118:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784044201.538143:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd000/0x89871fc3aba18ca5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6910 expref: 19 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044201.538161:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9b384361bc00) 00010000:00010000:0.0:1784044201.538166:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784044201.538219:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7a00/0x89871fc3aba18cba lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044201.538233:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7a00/0x89871fc3aba18cba lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044201.538243:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7a00/0x89871fc3aba18cba lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784044201.538369:0:6512:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000029f95478 reply state 00000000603c0b77 transno 4294967463 ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7a00/0x89871fc3aba18cba lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044201.538383:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7a00/0x89871fc3aba18cba lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044201.538389:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9b384361bc00) 00010000:00010000:0.0:1784044201.538392:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1784044201.538395:0:6512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1784044201.538497:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843c88380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+20:12387:x1870705565197824:12345-192.168.202.40@tcp:36:lhsmtool_posix.0 Request processed in 434us (611us total) trans 4294967463 rc 0/0 00000100:00100000:0.0:1784044201.538505:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 199 00000100:00100000:2.0:1784044201.543883:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044201.543973:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565197952 00000100:00100000:3.0:1784044201.543982:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565197952 00000100:00100000:3.0:1784044201.544042:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 66 00000100:00100000:3.0:1784044201.544065:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843c8a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+7:2409:x1870705565197952:12345-192.168.202.40@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1784044201.544253:0:8428:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:3.0:1784044201.544257:0:8428:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 1784044201 -> 1784044199 00002000:00010000:3.0:1784044201.544259:0:8428:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 0 -> 1784044198 00002000:00010000:3.0:1784044201.544261:0:8428:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 1784044201 -> 1784044199 00002000:00010000:3.0:1784044201.544263:0:8428:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:3.0:1784044201.544315:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843c8a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+8:2409:x1870705565197952:12345-192.168.202.40@tcp:2:lhsmtool_posix.0 Request processed in 251us (443us total) trans 4294967317 rc 0/0 00000100:00100000:3.0:1784044201.544323:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 66 00000100:00100000:0.0:1784044201.558966:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044201.559054:0:13808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565198208 00000100:00100000:2.0:1784044201.559063:0:13808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565198208 00000100:00100000:2.0:1784044201.559123:0:13808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 200 00000100:00100000:2.0:1784044201.559134:0:13808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38420ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a93fdf3c-d42f-420a-95ea-b0cbfe954363+20:12387:x1870705565198208:12345-192.168.202.40@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1784044201.559222:0:13808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798a00/0x89871fc3aba18cc1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044201.559240:0:13808:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc000/0x89871fc3aba18c89 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6902 expref: 20 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044201.559251:0:13808:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798a00/0x89871fc3aba18cc1 lrc: 4/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044201.559289:0:13808:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc000/0x89871fc3aba18c89 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6902 expref: 20 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044201.559304:0:13808:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc000/0x89871fc3aba18c89 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6902 expref: 20 pid: 6511 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044201.559319:0:13808:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843c8b480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13808:1870705580996096:192.168.202.40@tcp:104: 00000100:00100000:2.0:1784044201.559405:0:13808:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b397b8d3000 going to sleep for 11 seconds 00000100:00100000:2.0:1784044201.574677:0:13808:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843c8b480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13808:1870705580996096:192.168.202.40@tcp:104: 00010000:00010000:2.0:1784044201.574706:0:13808:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798a00/0x89871fc3aba18cc1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044201.578626:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044201.578671:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565198336 00000100:00100000:0.0:1784044201.578680:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565198336 00010000:00010000:0.0:1784044201.578719:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc000/0x89871fc3aba18c89 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6902 expref: 21 pid: 6511 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044201.578764:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 94 00000100:00100000:0.0:1784044201.578774:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38420ab100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+21:2409:x1870705565198336:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784044201.578790:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784044201.578797:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc000/0x89871fc3aba18c89 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6902 expref: 21 pid: 6511 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044201.578816:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc000/0x89871fc3aba18c89 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6902 expref: 21 pid: 6511 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044201.578837:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc000/0x89871fc3aba18c89 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6902 expref: 21 pid: 6511 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044201.578852:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9b384361bc00) 00010000:00010000:0.0:1784044201.578857:0:6498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798a00/0x89871fc3aba18cc1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044201.578866:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798a00/0x89871fc3aba18cc1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044201.578880:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798a00/0x89871fc3aba18cc1 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044201.578918:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784044201.578969:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38420ab100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+20:2409:x1870705565198336:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 196us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044201.578978:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 94 00010000:00010000:2.0:1784044201.581072:0:13808:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798a00/0x89871fc3aba18cc1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044201.581088:0:13808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798a00/0x89871fc3aba18cc1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044201.581132:0:13808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798a00/0x89871fc3aba18cc1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044201.581139:0:13808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798a00/0x89871fc3aba18cc1 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044201.581147:0:13808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798a00/0x89871fc3aba18cc1 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044201.581153:0:13808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3843798a00 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:2.0:1784044201.581158:0:13808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798a00/0x89871fc3aba18cc1 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044201.581165:0:13808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798a00/0x89871fc3aba18cc1 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044201.581299:0:13808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9b384361bc00) 00010000:00010000:2.0:1784044201.581303:0:13808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1784044201.581308:0:13808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798a00/0x89871fc3aba18cc1 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044201.581325:0:13808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798a00/0x89871fc3aba18cc1 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044201.581445:0:13808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38420ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a93fdf3c-d42f-420a-95ea-b0cbfe954363+19:12387:x1870705565198208:12345-192.168.202.40@tcp:55:lhsmtool_posix.0 Request processed in 22310us (22485us total) trans 0 rc -22/-22 00000100:00100000:2.0:1784044201.581455:0:13808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 200 00000100:00100000:0.0:1784044201.587912:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044201.587986:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565198464 00000100:00100000:2.0:1784044201.587996:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565198464 00000100:00100000:2.0:1784044201.588052:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 67 00000100:00100000:2.0:1784044201.588063:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3975b7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+8:2410:x1870705565198464:12345-192.168.202.40@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1784044201.588107:0:8426:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b50d9c4e/0x89871fc3aba18cc8 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044201.588128:0:8426:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003c1ecb33/0x89871fc3aba18cb3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca691e expref: 8 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044201.588140:0:8426:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784044201.588144:0:8426:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1784044201.588150:0:8426:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b50d9c4e/0x89871fc3aba18cc8 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044201.588500:0:8426:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003c1ecb33/0x89871fc3aba18cb3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca691e expref: 8 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044201.588515:0:8426:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003c1ecb33/0x89871fc3aba18cb3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca691e expref: 8 pid: 8426 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044201.588544:0:8426:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843c8b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8426:1870705580996224:192.168.202.40@tcp:104: 00000100:00100000:2.0:1784044201.588651:0:8426:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b397b8d3000 going to sleep for 11 seconds 00000100:00100000:1.0:1784044201.592265:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044201.592302:0:8426:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843c8b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8426:1870705580996224:192.168.202.40@tcp:104: 00010000:00010000:3.0:1784044201.592327:0:8426:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b50d9c4e/0x89871fc3aba18cc8 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044201.592357:0:13182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565198592 00000100:00100000:3.0:1784044201.592363:0:13182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565198592 00010000:00010000:3.0:1784044201.592396:0:13182:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003c1ecb33/0x89871fc3aba18cb3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca691e expref: 9 pid: 8426 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044201.592438:0:13182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 95 00000100:00100000:3.0:1784044201.592448:0:13182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843736300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a93fdf3c-d42f-420a-95ea-b0cbfe954363+9:2409:x1870705565198592:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784044201.592462:0:13182:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784044201.592482:0:13182:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003c1ecb33/0x89871fc3aba18cb3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca691e expref: 9 pid: 8426 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044201.592494:0:13182:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003c1ecb33/0x89871fc3aba18cb3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca691e expref: 9 pid: 8426 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044201.592594:0:13182:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003c1ecb33/0x89871fc3aba18cb3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca691e expref: 9 pid: 8426 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044201.592608:0:13182:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1784044201.592612:0:13182:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1784044201.592619:0:13182:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b50d9c4e/0x89871fc3aba18cc8 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044201.592628:0:13182:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b50d9c4e/0x89871fc3aba18cc8 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044201.592650:0:13182:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784044201.596432:0:13182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843736300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a93fdf3c-d42f-420a-95ea-b0cbfe954363+8:2409:x1870705565198592:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 3964us (4152us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044201.596446:0:13182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 95 00010000:00010000:3.0:1784044201.597505:0:8426:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b50d9c4e/0x89871fc3aba18cc8 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044201.597618:0:8426:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b50d9c4e/0x89871fc3aba18cc8 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044201.597655:0:8426:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b50d9c4e/0x89871fc3aba18cc8 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044201.597664:0:8426:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b50d9c4e/0x89871fc3aba18cc8 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044201.597684:0:8426:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b50d9c4e/0x89871fc3aba18cc8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044201.597691:0:8426:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3843799400 already unused, calling callback (ffffffffc0b56230) 00010000:00010000:3.0:1784044201.597695:0:8426:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b50d9c4e/0x89871fc3aba18cc8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044201.597703:0:8426:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b50d9c4e/0x89871fc3aba18cc8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044201.597725:0:8426:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b50d9c4e/0x89871fc3aba18cc8 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044201.597733:0:8426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b50d9c4e/0x89871fc3aba18cc8 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044201.598472:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3975b7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+7:2410:x1870705565198464:12345-192.168.202.40@tcp:1:lhsmtool_posix.0 Request processed in 10405us (10565us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044201.598484:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 67 00000100:00100000:1.0:1784044201.600555:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044201.600659:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565198848 00000100:00100000:2.0:1784044201.600668:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565198848 00000100:00100000:2.0:1784044201.600738:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 201 00000100:00100000:2.0:1784044201.600746:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39412eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+19:12387:x1870705565198848:12345-192.168.202.40@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1784044201.600816:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798a00/0x89871fc3aba18ccf lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044201.600831:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798600/0x89871fc3aba18b16 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca68a7 expref: 19 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044201.600838:0:6513:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798a00/0x89871fc3aba18ccf lrc: 4/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044201.600879:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798600/0x89871fc3aba18b16 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca68a7 expref: 19 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044201.600889:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798600/0x89871fc3aba18b16 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca68a7 expref: 19 pid: 6511 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044201.600899:0:6513:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843c8b480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6513:1870705580996352:192.168.202.40@tcp:104: 00000100:00100000:2.0:1784044201.600961:0:6513:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b397b8d3180 going to sleep for 11 seconds 00000100:00100000:2.0:1784044201.603473:0:6513:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843c8b480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6513:1870705580996352:192.168.202.40@tcp:104: 00000100:00100000:0.0:1784044201.603474:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00010000:00010000:2.0:1784044201.603497:0:6513:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798a00/0x89871fc3aba18ccf lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044201.603595:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565198976 00000100:00100000:3.0:1784044201.603601:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565198976 00010000:00010000:3.0:1784044201.603631:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798600/0x89871fc3aba18b16 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca68a7 expref: 20 pid: 6511 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044201.603680:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 96 00000100:00100000:2.0:1784044201.603691:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3955a39450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+20:2410:x1870705565198976:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784044201.603706:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784044201.603714:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798600/0x89871fc3aba18b16 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca68a7 expref: 20 pid: 6511 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044201.603725:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798600/0x89871fc3aba18b16 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca68a7 expref: 20 pid: 6511 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044201.603744:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798600/0x89871fc3aba18b16 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca68a7 expref: 20 pid: 6511 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044201.603758:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9b397b61ba00) 00010000:00010000:2.0:1784044201.603763:0:6497:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798a00/0x89871fc3aba18ccf lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044201.603773:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798a00/0x89871fc3aba18ccf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044201.603780:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798a00/0x89871fc3aba18ccf lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044201.603849:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784044201.603899:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3955a39450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+19:2410:x1870705565198976:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 209us (429us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044201.603906:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 96 00010000:00010000:1.0:1784044201.604740:0:6513:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798a00/0x89871fc3aba18ccf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044201.604748:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798a00/0x89871fc3aba18ccf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044201.604942:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd600/0x89871fc3aba18cd6 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044201.604952:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6a00/0x89871fc3aba18c97 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6909 expref: 19 pid: 9501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044201.604958:0:6513:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd600/0x89871fc3aba18cd6 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044201.604982:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6a00/0x89871fc3aba18c97 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6909 expref: 19 pid: 9501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044201.604992:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6a00/0x89871fc3aba18c97 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6909 expref: 19 pid: 9501 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044201.605014:0:6513:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3975b50380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6513:1870705580996480:192.168.202.40@tcp:104: 00000100:00100000:1.0:1784044201.605071:0:6513:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b395829f3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784044201.608439:0:6513:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3975b50380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6513:1870705580996480:192.168.202.40@tcp:104: 00010000:00010000:1.0:1784044201.608471:0:6513:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd600/0x89871fc3aba18cd6 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044201.609270:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044201.609673:0:13182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565199104 00000100:00100000:3.0:1784044201.609697:0:13182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565199104 00010000:00010000:3.0:1784044201.609734:0:13182:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6a00/0x89871fc3aba18c97 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6909 expref: 20 pid: 9501 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044201.609779:0:13182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 97 00000100:00100000:3.0:1784044201.609790:0:13182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3975b7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a93fdf3c-d42f-420a-95ea-b0cbfe954363+20:2410:x1870705565199104:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784044201.609806:0:13182:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784044201.609814:0:13182:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6a00/0x89871fc3aba18c97 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6909 expref: 20 pid: 9501 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044201.609827:0:13182:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6a00/0x89871fc3aba18c97 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6909 expref: 20 pid: 9501 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044201.609849:0:13182:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6a00/0x89871fc3aba18c97 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6909 expref: 20 pid: 9501 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044201.609866:0:13182:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9b384361bc00) 00010000:00010000:3.0:1784044201.609882:0:13182:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd600/0x89871fc3aba18cd6 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044201.609891:0:13182:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd600/0x89871fc3aba18cd6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044201.609899:0:13182:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd600/0x89871fc3aba18cd6 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044201.609927:0:13182:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784044201.609980:0:13182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3975b7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a93fdf3c-d42f-420a-95ea-b0cbfe954363+19:2410:x1870705565199104:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 189us (712us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044201.609997:0:13182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 97 00010000:00010000:2.0:1784044201.610600:0:6513:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd600/0x89871fc3aba18cd6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044201.610614:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd600/0x89871fc3aba18cd6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1784044201.610705:0:6513:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000001:00080000:2.0:1784044201.610811:0:6513:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000001:00080000:2.0:1784044201.610834:0:6513:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967466 00000100:00100000:2.0:1784044201.610906:0:6513:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843c8b480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6513:1870705580996608:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1784044201.610957:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044201.610982:0:6513:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b397b8d3cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1784044201.611245:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580996608 00000100:00100000:3.0:1784044201.611251:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580996608 00000100:00100000:3.0:1784044201.611300:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:3.0:1784044201.611306:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397f9e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6513:x1870705580996608:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1784044201.611365:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397f9e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6513:x1870705580996608:12345-0@lo:1000:mdt00_002.0 Request processed in 60us (408us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044201.611370:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:2.0:1784044201.611589:0:6513:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967316 gen 2 00000004:00080000:2.0:1784044201.611595:0:6513:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b3843735880, transno 4294967316 00000100:00100000:2.0:1784044201.611656:0:6513:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843c8b480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6513:1870705580996608:0@lo:1000:mdt00_002.0 00000001:00080000:2.0:1784044201.611770:0:6513:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00000100:00100000:2.0:1784044201.611818:0:6513:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843c8b480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6513:1870705580996736:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1784044201.611848:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044201.611883:0:6513:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b397b8d3000 going to sleep for 11 seconds 00000100:00100000:0.0:1784044201.611977:0:7768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580996736 00000100:00100000:0.0:1784044201.611982:0:7768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580996736 00000100:00100000:0.0:1784044201.612016:0:7768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:0.0:1784044201.612024:0:7768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39459b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6513:x1870705580996736:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1784044201.612124:0:7768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39459b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6513:x1870705580996736:12345-0@lo:1000:mdt00_002.0 Request processed in 101us (275us total) trans 4294967318 rc 0/0 00000100:00100000:0.0:1784044201.612131:0:7768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:2.0:1784044201.612474:0:6513:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843c8b480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6513:1870705580996736:0@lo:1000:mdt00_002.0 00010000:00010000:2.0:1784044201.612507:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd600/0x89871fc3aba18cd6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044201.612515:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd600/0x89871fc3aba18cd6 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044201.612522:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd600/0x89871fc3aba18cd6 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044201.612529:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38426fd600 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:2.0:1784044201.612533:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd600/0x89871fc3aba18cd6 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044201.612554:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd600/0x89871fc3aba18cd6 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044201.612569:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9b384361bc00) 00010000:00010000:2.0:1784044201.612572:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1784044201.612577:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd600/0x89871fc3aba18cd6 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044201.612583:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd600/0x89871fc3aba18cd6 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044201.612604:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6600/0x89871fc3aba18c12 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044201.612610:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6600/0x89871fc3aba18c12 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044201.612615:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6600/0x89871fc3aba18c12 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044201.612619:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38410b6600 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:2.0:1784044201.612622:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6600/0x89871fc3aba18c12 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044201.612627:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6600/0x89871fc3aba18c12 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044201.612635:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9b397b61ba00) 00010000:00010000:2.0:1784044201.612638:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1784044201.612640:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6600/0x89871fc3aba18c12 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044201.612656:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6600/0x89871fc3aba18c12 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044201.612681:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798000/0x89871fc3aba18cdd lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044201.612695:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799000/0x89871fc3aba18c2e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca68ed expref: 22 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044201.612705:0:6513:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798000/0x89871fc3aba18cdd lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044201.612733:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799000/0x89871fc3aba18c2e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca68ed expref: 22 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044201.612746:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799000/0x89871fc3aba18c2e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca68ed expref: 22 pid: 6511 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044201.612756:0:6513:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843e0fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6513:1870705580996864:192.168.202.40@tcp:104: 00000100:00100000:2.0:1784044201.612854:0:6513:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b397b8d3000 going to sleep for 11 seconds 00010000:00010000:2.0:1784044201.613638:0:10330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784044201.616837:0:6513:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843e0fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6513:1870705580996864:192.168.202.40@tcp:104: 00000100:00100000:0.0:1784044201.616843:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00010000:00010000:2.0:1784044201.616868:0:6513:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798000/0x89871fc3aba18cdd lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044201.617039:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565199232 00000100:00100000:3.0:1784044201.617045:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565199232 00010000:00010000:3.0:1784044201.617080:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799000/0x89871fc3aba18c2e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca68ed expref: 23 pid: 6511 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044201.617122:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 98 00000100:00100000:3.0:1784044201.617131:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3975b7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+23:2410:x1870705565199232:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784044201.617432:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784044201.617441:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799000/0x89871fc3aba18c2e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca68ed expref: 23 pid: 6511 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044201.617451:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799000/0x89871fc3aba18c2e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca68ed expref: 23 pid: 6511 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044201.617468:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799000/0x89871fc3aba18c2e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca68ed expref: 23 pid: 6511 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044201.617479:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9b397b61ba00) 00010000:00010000:3.0:1784044201.617495:0:6498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798000/0x89871fc3aba18cdd lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044201.617503:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798000/0x89871fc3aba18cdd lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044201.617508:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798000/0x89871fc3aba18cdd lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044201.617566:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784044201.617621:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3975b7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+22:2410:x1870705565199232:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 492us (779us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044201.617627:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 98 00010000:00010000:2.0:1784044201.618429:0:6513:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798000/0x89871fc3aba18cdd lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044201.618442:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798000/0x89871fc3aba18cdd lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044201.618463:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798000/0x89871fc3aba18cdd lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044201.618468:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798000/0x89871fc3aba18cdd lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044201.618473:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798000/0x89871fc3aba18cdd lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044201.618476:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3843798000 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:2.0:1784044201.618480:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798000/0x89871fc3aba18cdd lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044201.618484:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798000/0x89871fc3aba18cdd lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044201.618493:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9b397b61ba00) 00010000:00010000:2.0:1784044201.618495:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784044201.618497:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798000/0x89871fc3aba18cdd lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044201.618500:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798000/0x89871fc3aba18cdd lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044201.618510:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798a00/0x89871fc3aba18ccf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044201.618514:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798a00/0x89871fc3aba18ccf lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044201.618520:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798a00/0x89871fc3aba18ccf lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044201.618530:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3843798a00 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:2.0:1784044201.618533:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798a00/0x89871fc3aba18ccf lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044201.618539:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798a00/0x89871fc3aba18ccf lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044201.618547:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9b397b61ba00) 00010000:00010000:2.0:1784044201.618550:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1784044201.618552:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798a00/0x89871fc3aba18ccf lrc: 2/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044201.618558:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798a00/0x89871fc3aba18ccf lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044201.618718:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39412eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+21:12387:x1870705565198848:12345-192.168.202.40@tcp:57:lhsmtool_posix.0 Request processed in 17969us (18170us total) trans 4294967468 rc 0/0 00000100:00100000:2.0:1784044201.618727:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 201 00000020:00080000:2.0:1784044201.618731:0:6513:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1784044201.618765:0:13763:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1784044201.618771:0:13763:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1784044201.619313:0:13763:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:1.0:1784044201.619322:0:13763:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1784044201.621398:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044201.621451:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565199488 00000100:00100000:0.0:1784044201.621461:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565199488 00000100:00100000:0.0:1784044201.621524:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 50 00000100:00100000:0.0:1784044201.621533:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3974226c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+21:12387:x1870705565199488:12345-192.168.202.40@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1784044201.621777:0:6515:0:(mdd_object.c:4016:mdd_close()) Object [0x200000402:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1784044201.621809:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967469 00010000:00010000:0.0:1784044201.621840:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7000/0x89871fc3aba18ce4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044201.621855:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7000/0x89871fc3aba18ce4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044201.621890:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7000/0x89871fc3aba18ce4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044201.621899:0:6515:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7000/0x89871fc3aba18ce4 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044201.621905:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7000/0x89871fc3aba18ce4 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044201.621911:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7000/0x89871fc3aba18ce4 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044201.621935:0:6515:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1784044201.622019:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3974226c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+23:12387:x1870705565199488:12345-192.168.202.40@tcp:35:lhsmtool_posix.0 Request processed in 486us (629us total) trans 4294967470 rc 0/0 00000100:00100000:0.0:1784044201.622027:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 50 00000020:00080000:0.0:1784044201.622032:0:6515:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1784044201.622168:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784044201.622208:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7000/0x89871fc3aba18ce4 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044201.622216:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38410b7000 already unused, calling callback (ffffffffc0b56230) 00010000:00010000:3.0:1784044201.622221:0:6500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7000/0x89871fc3aba18ce4 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044201.622228:0:6500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7000/0x89871fc3aba18ce4 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044201.622242:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9b384361bc00) 00010000:00010000:3.0:1784044201.622245:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1784044201.622249:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7000/0x89871fc3aba18ce4 lrc: 1/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044201.622255:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7000/0x89871fc3aba18ce4 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044201.622276:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784044201.622278:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784044201.622280:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784044202.637493:0:10331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1784044203.313982:0:14711:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1784044203.313990:0:14711:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1784044203.314013:0:14711:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:3.0:1784044203.314019:0:14711:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1784044203.437013:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1784044203.437248:0:9501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565199744 00000100:00100000:1.0:1784044203.437258:0:9501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565199744 00000100:00100000:1.0:1784044203.437421:0:9501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 202 00000100:00080000:3.0:1784044203.437431:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784044203.437433:0:9501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397bbbca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a93fdf3c-d42f-420a-95ea-b0cbfe954363+23:12406:x1870705565199744:12345-192.168.202.40@tcp:101:lfs.0 00010000:00010000:1.0:1784044203.437461:0:9501:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784044203.437482:0:9501:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fde00/0x89871fc3aba18ceb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcd3dffad52ca6925 expref: -99 pid: 9501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044203.437606:0:9501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc400/0x89871fc3aba18cf2 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044203.437624:0:9501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc400/0x89871fc3aba18cf2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044203.437638:0:9501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc400/0x89871fc3aba18cf2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784044203.437663:0:9501:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:1.0:1784044203.437776:0:9501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fde00/0x89871fc3aba18ceb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6925 expref: 26 pid: 9501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044203.437793:0:9501:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc400/0x89871fc3aba18cf2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6925 expref: 25 pid: 9501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044203.437801:0:9501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9b3842777a00) 00010000:00010000:1.0:1784044203.437804:0:9501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1784044203.437808:0:9501:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b38426fc400, rc 0) 00000100:00100000:1.0:1784044203.437884:0:9501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397bbbca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a93fdf3c-d42f-420a-95ea-b0cbfe954363+25:12406:x1870705565199744:12345-192.168.202.40@tcp:101:lfs.0 Request processed in 454us (879us total) trans 4294967471 rc 0/0 00000100:00100000:1.0:1784044203.437891:0:9501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 202 00000100:00100000:1.0:1784044203.453295:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044203.454899:0:13808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565199872 00000100:00100000:3.0:1784044203.454912:0:13808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565199872 00000100:00100000:3.0:1784044203.455445:0:13808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 203 00000100:00100000:3.0:1784044203.455459:0:13808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3975b50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a93fdf3c-d42f-420a-95ea-b0cbfe954363+25:12406:x1870705565199872:12345-192.168.202.40@tcp:34:lfs.0 00010000:00010000:3.0:1784044203.455534:0:13808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166ae00/0x89871fc3aba18d00 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044203.455553:0:13808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166ae00/0x89871fc3aba18d00 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044203.455565:0:13808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166ae00/0x89871fc3aba18d00 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044203.455580:0:13808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166bc00/0x89871fc3aba18d07 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044203.455587:0:13808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166bc00/0x89871fc3aba18d07 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044203.455593:0:13808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166bc00/0x89871fc3aba18d07 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044203.455759:0:13808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166b600/0x89871fc3aba18d0e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044203.455768:0:13808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166b600/0x89871fc3aba18d0e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044203.455776:0:13808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166b600/0x89871fc3aba18d0e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784044203.455825:0:13808:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166b600/0x89871fc3aba18d0e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044203.455838:0:13808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166ae00/0x89871fc3aba18d00 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044203.455844:0:13808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166ae00/0x89871fc3aba18d00 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044203.455851:0:13808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166ae00/0x89871fc3aba18d00 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044203.455857:0:13808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b394166ae00 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:3.0:1784044203.455862:0:13808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166ae00/0x89871fc3aba18d00 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044203.455868:0:13808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166ae00/0x89871fc3aba18d00 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044203.455881:0:13808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9b3842777a00) 00010000:00010000:3.0:1784044203.455883:0:13808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784044203.455888:0:13808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166ae00/0x89871fc3aba18d00 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044203.455900:0:13808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166ae00/0x89871fc3aba18d00 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044203.455913:0:13808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166bc00/0x89871fc3aba18d07 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044203.455919:0:13808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166bc00/0x89871fc3aba18d07 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044203.455924:0:13808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166bc00/0x89871fc3aba18d07 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044203.455929:0:13808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b394166bc00 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:3.0:1784044203.455932:0:13808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166bc00/0x89871fc3aba18d07 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044203.455938:0:13808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166bc00/0x89871fc3aba18d07 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044203.455945:0:13808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9b397aa61700) 00010000:00010000:3.0:1784044203.455947:0:13808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784044203.455950:0:13808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166bc00/0x89871fc3aba18d07 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044203.455956:0:13808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166bc00/0x89871fc3aba18d07 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044203.455973:0:13808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166b600/0x89871fc3aba18d0e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044203.455978:0:13808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166b600/0x89871fc3aba18d0e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044203.455989:0:13808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166b600/0x89871fc3aba18d0e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044203.455994:0:13808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b394166b600 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:3.0:1784044203.455997:0:13808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166b600/0x89871fc3aba18d0e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044203.456002:0:13808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166b600/0x89871fc3aba18d0e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044203.456009:0:13808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9b397aa61500) 00010000:00010000:3.0:1784044203.456011:0:13808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784044203.456013:0:13808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166b600/0x89871fc3aba18d0e lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044203.456019:0:13808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166b600/0x89871fc3aba18d0e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044203.456105:0:13808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3975b50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a93fdf3c-d42f-420a-95ea-b0cbfe954363+25:12406:x1870705565199872:12345-192.168.202.40@tcp:34:lfs.0 Request processed in 648us (2818us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044203.456113:0:13808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 203 00000100:00100000:3.0:1784044203.539736:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044203.539927:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565200128 00000100:00100000:2.0:1784044203.539949:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565200128 00000100:00100000:2.0:1784044203.540023:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 204 00000100:00100000:2.0:1784044203.540035:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397bbbe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+25:12409:x1870705565200128:12345-192.168.202.40@tcp:101:lfs.0 00010000:00010000:2.0:1784044203.540070:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784044203.540095:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798400/0x89871fc3aba18d15 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcd3dffad52ca692c expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044203.540836:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798600/0x89871fc3aba18d1c lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044203.540871:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798600/0x89871fc3aba18d1c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044203.540884:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798600/0x89871fc3aba18d1c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044203.540998:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166b600/0x89871fc3aba18d23 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044203.541008:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166b600/0x89871fc3aba18d23 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044203.541017:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166b600/0x89871fc3aba18d23 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044203.541323:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166bc00/0x89871fc3aba18d2a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044203.541333:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166bc00/0x89871fc3aba18d2a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044203.541341:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166bc00/0x89871fc3aba18d2a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784044203.541352:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:3.0:1784044203.541448:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798600/0x89871fc3aba18d1c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044203.541457:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798600/0x89871fc3aba18d1c lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044203.541464:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798600/0x89871fc3aba18d1c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044203.541470:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3843798600 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:3.0:1784044203.541476:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798600/0x89871fc3aba18d1c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044203.541483:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798600/0x89871fc3aba18d1c lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044203.541494:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9b3842777a00) 00010000:00010000:3.0:1784044203.541497:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784044203.541800:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798600/0x89871fc3aba18d1c lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044203.541823:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798600/0x89871fc3aba18d1c lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044203.541838:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166b600/0x89871fc3aba18d23 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044203.541845:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166b600/0x89871fc3aba18d23 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044203.541851:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166b600/0x89871fc3aba18d23 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044203.541855:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b394166b600 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:3.0:1784044203.541858:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166b600/0x89871fc3aba18d23 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044203.541864:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166b600/0x89871fc3aba18d23 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044203.541872:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9b397aa61500) 00010000:00010000:3.0:1784044203.541875:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784044203.541878:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166b600/0x89871fc3aba18d23 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044203.541884:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166b600/0x89871fc3aba18d23 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044203.541933:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798400/0x89871fc3aba18d15 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca692c expref: 28 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044203.541947:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166bc00/0x89871fc3aba18d2a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca692c expref: 27 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044203.541962:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9b397aa61700) 00010000:00010000:3.0:1784044203.541964:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784044203.541967:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b394166bc00, rc 0) 00000100:00100000:3.0:1784044203.542168:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397bbbe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+27:12409:x1870705565200128:12345-192.168.202.40@tcp:101:lfs.0 Request processed in 2134us (2442us total) trans 4294967472 rc 0/0 00000100:00100000:3.0:1784044203.542199:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 204 00000100:00100000:1.0:1784044203.548236:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044203.548352:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565200256 00000100:00100000:2.0:1784044203.548361:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565200256 00000100:00100000:2.0:1784044203.548455:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 205 00000100:00100000:2.0:1784044203.548467:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3842704700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+27:12409:x1870705565200256:12345-192.168.202.40@tcp:54:lfs.0 00010000:00010000:2.0:1784044203.548538:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798000/0x89871fc3aba18d38 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044203.548556:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798000/0x89871fc3aba18d38 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044203.548568:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798000/0x89871fc3aba18d38 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044203.548605:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798000/0x89871fc3aba18d38 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044203.548612:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798000/0x89871fc3aba18d38 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044203.548619:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798000/0x89871fc3aba18d38 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044203.548626:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3843798000 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:2.0:1784044203.548631:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798000/0x89871fc3aba18d38 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044203.548829:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798000/0x89871fc3aba18d38 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044203.548843:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9b397aa61700) 00010000:00010000:2.0:1784044203.548847:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1784044203.548851:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798000/0x89871fc3aba18d38 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044203.548858:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798000/0x89871fc3aba18d38 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044203.548943:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3842704700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+27:12409:x1870705565200256:12345-192.168.202.40@tcp:54:lfs.0 Request processed in 477us (771us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044203.548951:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 205 00000100:00100000:0.0:1784044203.553870:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044203.553950:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565200512 00000100:00100000:2.0:1784044203.553960:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565200512 00000100:00100000:2.0:1784044203.554022:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 51 00000100:00100000:2.0:1784044203.554034:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397f9e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+27:12409:x1870705565200512:12345-192.168.202.40@tcp:35:lfs.0 00000100:00100000:2.0:1784044203.554313:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397f9e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+28:12409:x1870705565200512:12345-192.168.202.40@tcp:35:lfs.0 Request processed in 280us (452us total) trans 4294967473 rc 0/0 00000100:00100000:2.0:1784044203.554321:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 51 00000100:00100000:3.0:1784044203.592538:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044203.592662:0:13808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565200768 00000100:00100000:2.0:1784044203.592672:0:13808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565200768 00000100:00100000:2.0:1784044203.592740:0:13808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 206 00000100:00100000:2.0:1784044203.592750:0:13808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397bbbc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a93fdf3c-d42f-420a-95ea-b0cbfe954363+28:11933:x1870705565200768:12345-192.168.202.40@tcp:101:bash.0 00010000:00010000:2.0:1784044203.592773:0:13808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784044203.592794:0:13808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798000/0x89871fc3aba18d3f lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcd3dffad52ca6933 expref: -99 pid: 13808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044203.592923:0:13808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798a00/0x89871fc3aba18d46 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044203.592938:0:13808:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166bc00/0x89871fc3aba18d2a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca692c expref: 29 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044203.592947:0:13808:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798a00/0x89871fc3aba18d46 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044203.592982:0:13808:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166bc00/0x89871fc3aba18d2a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca692c expref: 29 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044203.592993:0:13808:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166bc00/0x89871fc3aba18d2a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca692c expref: 29 pid: 6513 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044203.593006:0:13808:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843e0fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13808:1870705580996992:192.168.202.40@tcp:104: 00000100:00100000:2.0:1784044203.593111:0:13808:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b397b8d3900 going to sleep for 11 seconds 00000100:00100000:1.0:1784044203.600090:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044203.600223:0:13182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565200896 00000100:00100000:3.0:1784044203.600232:0:13182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565200896 00000100:00100000:2.0:1784044203.600234:0:13808:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843e0fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13808:1870705580996992:192.168.202.40@tcp:104: 00010000:00010000:2.0:1784044203.600262:0:13808:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798a00/0x89871fc3aba18d46 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044203.600275:0:13182:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166bc00/0x89871fc3aba18d2a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca692c expref: 30 pid: 6513 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044203.600321:0:13182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 99 00000100:00100000:3.0:1784044203.600331:0:13182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3842707480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a93fdf3c-d42f-420a-95ea-b0cbfe954363+30:2410:x1870705565200896:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784044203.600354:0:13182:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784044203.600361:0:13182:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166bc00/0x89871fc3aba18d2a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca692c expref: 30 pid: 6513 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044203.600374:0:13182:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166bc00/0x89871fc3aba18d2a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca692c expref: 30 pid: 6513 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044203.600554:0:13182:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166bc00/0x89871fc3aba18d2a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca692c expref: 30 pid: 6513 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044203.600573:0:13182:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9b397aa61700) 00010000:00010000:3.0:1784044203.600590:0:13182:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798a00/0x89871fc3aba18d46 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044203.600601:0:13182:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798a00/0x89871fc3aba18d46 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044203.600609:0:13182:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798a00/0x89871fc3aba18d46 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044203.600642:0:13182:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784044203.600693:0:13182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3842707480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a93fdf3c-d42f-420a-95ea-b0cbfe954363+29:2410:x1870705565200896:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 363us (612us total) trans 0 rc 0/0 00010000:00010000:2.0:1784044203.600699:0:13808:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798a00/0x89871fc3aba18d46 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044203.600705:0:13182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 99 00010000:00010000:2.0:1784044203.600714:0:13808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798a00/0x89871fc3aba18d46 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784044203.600732:0:13808:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:2.0:1784044203.600865:0:13808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798000/0x89871fc3aba18d3f lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6933 expref: 30 pid: 13808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044203.600881:0:13808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798a00/0x89871fc3aba18d46 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6933 expref: 29 pid: 13808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044203.600889:0:13808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9b397aa61700) 00010000:00010000:2.0:1784044203.600962:0:13808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1784044203.600966:0:13808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3843798a00, rc 0) 00000100:00100000:2.0:1784044203.600995:0:13808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397bbbc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a93fdf3c-d42f-420a-95ea-b0cbfe954363+29:11933:x1870705565200768:12345-192.168.202.40@tcp:101:bash.0 Request processed in 8246us (8468us total) trans 4294967474 rc 0/0 00000100:00100000:2.0:1784044203.601002:0:13808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 206 00000001:00080000:2.0:1784044203.602545:0:9505:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00000001:00080000:2.0:1784044203.602560:0:9505:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967306 is committed 00000100:00100000:0.0:1784044203.608565:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044203.613019:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565201024 00000100:00100000:3.0:1784044203.613036:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565201024 00000100:00100000:3.0:1784044203.613103:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 207 00000100:00100000:3.0:1784044203.613114:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397f9e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+29:11933:x1870705565201024:12345-192.168.202.40@tcp:101:bash.0 00010000:00010000:3.0:1784044203.613139:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784044203.613161:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166bc00/0x89871fc3aba18d54 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcd3dffad52ca693a expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044203.613227:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166ae00/0x89871fc3aba18d5b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044203.613242:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166ae00/0x89871fc3aba18d5b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044203.613254:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166ae00/0x89871fc3aba18d5b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044203.613504:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166bc00/0x89871fc3aba18d54 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca693a expref: 31 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044203.613525:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166ae00/0x89871fc3aba18d5b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca693a expref: 30 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044203.613534:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9b397aa61700) 00010000:00010000:2.0:1784044203.613537:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1784044203.613541:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b394166ae00, rc 0) 00000100:00100000:2.0:1784044203.613609:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397f9e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+30:11933:x1870705565201024:12345-192.168.202.40@tcp:101:bash.0 Request processed in 497us (5058us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044203.613618:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 207 00000100:00100000:0.0:1784044203.617575:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044203.617659:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565201280 00000100:00100000:2.0:1784044203.617669:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565201280 00000100:00100000:2.0:1784044203.617744:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 208 00000100:00100000:2.0:1784044203.617755:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39459b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+30:11933:x1870705565201280:12345-192.168.202.40@tcp:36:bash.0 00010000:00010000:2.0:1784044203.617985:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798000/0x89871fc3aba18d62 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044203.618003:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798000/0x89871fc3aba18d62 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044203.618014:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798000/0x89871fc3aba18d62 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1784044203.618056:0:6511:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967475 00000004:00010000:2.0:1784044203.618094:0:6511:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000009aad85ce reply state 0000000060c0d8c0 transno 4294967476 ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798000/0x89871fc3aba18d62 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044203.618107:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798000/0x89871fc3aba18d62 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044203.618114:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9b397aa61700) 00010000:00010000:2.0:1784044203.618117:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1784044203.618120:0:6511:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:2.0:1784044203.618164:0:6511:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967476 00000100:00100000:2.0:1784044203.618523:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39459b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+34:11933:x1870705565201280:12345-192.168.202.40@tcp:36:bash.0 Request processed in 768us (955us total) trans 4294967477 rc 0/0 00000100:00100000:2.0:1784044203.618531:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 208 00000020:00080000:2.0:1784044203.618537:0:6511:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:1.0:1784044203.624774:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044203.624874:0:13808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565201408 00000100:00100000:2.0:1784044203.624886:0:13808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565201408 00000100:00100000:2.0:1784044203.624952:0:13808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 209 00000100:00100000:2.0:1784044203.624962:0:13808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3842706a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a93fdf3c-d42f-420a-95ea-b0cbfe954363+34:11933:x1870705565201408:12345-192.168.202.40@tcp:101:bash.0 00010000:00010000:2.0:1784044203.625004:0:13808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784044203.625025:0:13808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799000/0x89871fc3aba18d69 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcd3dffad52ca6941 expref: -99 pid: 13808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044203.625099:0:13808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799000/0x89871fc3aba18d69 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6941 expref: 35 pid: 13808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044203.625114:0:13808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799000/0x89871fc3aba18d69 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6941 expref: 35 pid: 13808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044203.625132:0:13808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9b397aa61700) 00010000:00010000:2.0:1784044203.625135:0:13808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1784044203.625150:0:13808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3843799000, rc 0) 00000100:00100000:2.0:1784044203.625249:0:13808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3842706a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a93fdf3c-d42f-420a-95ea-b0cbfe954363+35:11933:x1870705565201408:12345-192.168.202.40@tcp:101:bash.0 Request processed in 288us (485us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044203.625256:0:13808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 209 00000100:00100000:0.0:1784044203.636598:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044203.636732:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565201536 00000100:00100000:3.0:1784044203.636765:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565201536 00000100:00100000:3.0:1784044203.636861:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 68 00000100:00100000:3.0:1784044203.636873:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843e3b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+7:11933:x1870705565201536:12345-192.168.202.40@tcp:101:bash.0 00010000:00010000:3.0:1784044203.636893:0:8428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00080000:2.0:1784044203.636908:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1784044203.636913:0:8428:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d3f761c5/0x89871fc3aba18d70 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcd3dffad52ca6948 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784044203.636941:0:8428:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 9, mtime: 0x6a565aa7, atime: 0x6a565aa6, ctime: 0x6a565aa7, blocks: 0x8 00010000:00010000:3.0:1784044203.636965:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=396s v=(0 0) 00010000:00010000:3.0:1784044203.636970:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784044203.636977:0:8428:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d3f761c5/0x89871fc3aba18d70 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6948 expref: 8 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044203.636996:0:8428:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d3f761c5/0x89871fc3aba18d70 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6948 expref: 8 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044203.637008:0:8428:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b394166b600, rc 0) 00000100:00100000:3.0:1784044203.637085:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843e3b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+8:11933:x1870705565201536:12345-192.168.202.40@tcp:101:bash.0 Request processed in 214us (495us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044203.637092:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 68 00000100:00100000:3.0:1784044203.651561:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044203.651643:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565201664 00000100:00100000:0.0:1784044203.651656:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565201664 00002000:00010000:0.0:1784044203.651708:0:8433:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/5 (0->18446744073709551615) 00002000:00100000:0.0:1784044203.651714:0:8433:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b3843d80000 with x1870705565201664 ext(0->18446744073709551615) 00002000:00010000:0.0:1784044203.651728:0:8433:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b3843d80000. 00000100:00100000:0.0:1784044203.651766:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 5 00000100:00100000:0.0:1784044203.651775:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d80000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+8:2409:x1870705565201664:12345-192.168.202.40@tcp:10:bash.0 00002000:00010000:0.0:1784044203.652089:0:8433:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:0.0:1784044203.652093:0:8433:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 1784044199 -> 1784044203 00002000:00010000:0.0:1784044203.652096:0:8433:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 1784044198 -> 1784044198 00002000:00010000:0.0:1784044203.652098:0:8433:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 1784044199 -> 1784044203 00002000:00010000:0.0:1784044203.652100:0:8433:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:0.0:1784044203.652550:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d80000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+9:2409:x1870705565201664:12345-192.168.202.40@tcp:10:bash.0 Request processed in 400us (625us total) trans 4294967319 rc 0/0 00000100:00100000:0.0:1784044203.652560:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 5 00002000:00010000:0.0:1784044203.652564:0:8433:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/5 (0->18446744073709551615) 00002000:00100000:0.0:1784044203.652567:0:8433:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b3843d80000 with x1870705565201664 ext(0->18446744073709551615) 00002000:00010000:0.0:1784044203.652573:0:8433:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b3843d80000. 00010000:00010000:2.0:1784044203.663337:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784044203.749874:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044203.749903:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044203.749932:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1784044203.749967:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565202048 00000100:00100000:1.0:1784044203.749978:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565202048 00000100:00100000:0.0:1784044203.750011:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565201792 00000100:00100000:0.0:1784044203.750016:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565201792 00000100:00100000:1.0:1784044203.750045:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 137 00000100:00100000:0.0:1784044203.750045:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 420 00000100:00100000:1.0:1784044203.750056:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843e0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+5:2407:x1870705565202048:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:0.0:1784044203.750065:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3950371850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4a09ad9-a185-4679-99bb-b6a07b865440+13:2407:x1870705565201792:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:1.0:1784044203.750146:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843e0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+5:2407:x1870705565202048:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 92us (240us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044203.750154:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 137 00000100:00080000:1.0:1784044203.750218:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784044203.750320:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565202304 00000100:00100000:3.0:1784044203.750325:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565202304 00000100:00100000:3.0:1784044203.750362:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 360 00000100:00100000:3.0:1784044203.750370:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843e0d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68dfcea6-5d83-4dbb-8fa3-e35542d621e5+5:2407:x1870705565202304:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:0.0:1784044203.750484:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3950371850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4a09ad9-a185-4679-99bb-b6a07b865440+13:2407:x1870705565201792:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 429us (616us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044203.750494:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 420 00000100:00080000:0.0:1784044203.750525:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1784044203.750650:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1784044203.750771:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1784044203.750852:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044203.750870:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565201920 00000100:00100000:0.0:1784044203.750874:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565201920 00000100:00100000:0.0:1784044203.750907:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565202432 00000100:00100000:0.0:1784044203.750910:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565202432 00000100:00100000:0.0:1784044203.750929:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 361 00000100:00100000:0.0:1784044203.750936:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843dbd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+5:2407:x1870705565201920:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:0.0:1784044203.750972:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843dbd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+5:2407:x1870705565201920:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 36us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044203.750985:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 361 00000100:00100000:0.0:1784044203.751001:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 210 00000100:00100000:0.0:1784044203.751007:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843dbc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+35:12423:x1870705565202432:12345-192.168.202.40@tcp:34:lfs.0 00010000:00010000:0.0:1784044203.751066:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6600/0x89871fc3aba18d77 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044203.751083:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6600/0x89871fc3aba18d77 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044203.751094:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6600/0x89871fc3aba18d77 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044203.751109:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6a00/0x89871fc3aba18d7e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044203.751116:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6a00/0x89871fc3aba18d7e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044203.751123:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6a00/0x89871fc3aba18d7e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044203.751239:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7600/0x89871fc3aba18d85 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044203.751248:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7600/0x89871fc3aba18d85 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044203.751255:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7600/0x89871fc3aba18d85 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1784044203.751312:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00010000:0.0:1784044203.751315:0:6511:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7600/0x89871fc3aba18d85 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044203.751334:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6600/0x89871fc3aba18d77 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044203.751340:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6600/0x89871fc3aba18d77 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044203.751348:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6600/0x89871fc3aba18d77 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044203.751354:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38410b6600 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:0.0:1784044203.751359:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6600/0x89871fc3aba18d77 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044203.751366:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6600/0x89871fc3aba18d77 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044203.751378:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9b3842777a00) 00010000:00010000:0.0:1784044203.751381:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784044203.751385:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6600/0x89871fc3aba18d77 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044203.751405:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6600/0x89871fc3aba18d77 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044203.751418:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6a00/0x89871fc3aba18d7e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044203.751424:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6a00/0x89871fc3aba18d7e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044203.751430:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6a00/0x89871fc3aba18d7e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044203.751441:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38410b6a00 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:0.0:1784044203.751444:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6a00/0x89871fc3aba18d7e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044203.751450:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6a00/0x89871fc3aba18d7e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044203.751458:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9b39758c1c00) 00010000:00010000:0.0:1784044203.751460:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784044203.751463:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6a00/0x89871fc3aba18d7e lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044203.751468:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6a00/0x89871fc3aba18d7e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044203.751482:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7600/0x89871fc3aba18d85 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044203.751488:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7600/0x89871fc3aba18d85 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044203.751493:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7600/0x89871fc3aba18d85 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044203.751498:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38410b7600 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:0.0:1784044203.751500:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7600/0x89871fc3aba18d85 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044203.751506:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7600/0x89871fc3aba18d85 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044203.751524:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9b397aa61700) 00010000:00010000:0.0:1784044203.751527:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784044203.751530:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7600/0x89871fc3aba18d85 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044203.751536:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7600/0x89871fc3aba18d85 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044203.751573:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843dbc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+35:12423:x1870705565202432:12345-192.168.202.40@tcp:34:lfs.0 Request processed in 565us (801us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044203.751580:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 210 00000100:00100000:3.0:1784044203.751598:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843e0d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68dfcea6-5d83-4dbb-8fa3-e35542d621e5+5:2407:x1870705565202304:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 1228us (1664us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044203.751612:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 360 00000100:00100000:2.0:1784044203.760066:0:13808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565202176 00000100:00100000:2.0:1784044203.760084:0:13808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565202176 00000100:00100000:2.0:1784044203.760235:0:13808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 362 00000100:00100000:2.0:1784044203.760245:0:13808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843dbfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:68dfcea6-5d83-4dbb-8fa3-e35542d621e5+5:2407:x1870705565202176:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:2.0:1784044203.760348:0:13808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843dbfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:68dfcea6-5d83-4dbb-8fa3-e35542d621e5+5:2407:x1870705565202176:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 103us (9494us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044203.760370:0:13808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 362 00000100:00080000:0.0:1784044203.761507:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784044203.812255:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044203.812336:0:9501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565202688 00000100:00100000:2.0:1784044203.812347:0:9501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565202688 00000100:00100000:2.0:1784044203.812450:0:9501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 211 00000100:00100000:2.0:1784044203.812462:0:9501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843dbd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a93fdf3c-d42f-420a-95ea-b0cbfe954363+35:12426:x1870705565202688:12345-192.168.202.40@tcp:101:lfs.0 00010000:00010000:2.0:1784044203.812484:0:9501:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784044203.812528:0:9501:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799c00/0x89871fc3aba18d8c lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcd3dffad52ca694f expref: -99 pid: 9501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044203.812601:0:9501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799800/0x89871fc3aba18d93 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044203.812615:0:9501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799800/0x89871fc3aba18d93 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044203.812625:0:9501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799800/0x89871fc3aba18d93 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044203.814087:0:9501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799e00/0x89871fc3aba18d9a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044203.814101:0:9501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799e00/0x89871fc3aba18d9a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044203.814110:0:9501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799e00/0x89871fc3aba18d9a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044203.814258:0:9501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799a00/0x89871fc3aba18da1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044203.814285:0:9501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799a00/0x89871fc3aba18da1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044203.814294:0:9501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799a00/0x89871fc3aba18da1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784044203.814305:0:9501:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:2.0:1784044203.814408:0:9501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799800/0x89871fc3aba18d93 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044203.814415:0:9501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799800/0x89871fc3aba18d93 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044203.814422:0:9501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799800/0x89871fc3aba18d93 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044203.814427:0:9501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3843799800 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:2.0:1784044203.814431:0:9501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799800/0x89871fc3aba18d93 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044203.814438:0:9501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799800/0x89871fc3aba18d93 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044203.814449:0:9501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9b3842777a00) 00010000:00010000:2.0:1784044203.814452:0:9501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784044203.814455:0:9501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799800/0x89871fc3aba18d93 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044203.814461:0:9501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799800/0x89871fc3aba18d93 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044203.814472:0:9501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799e00/0x89871fc3aba18d9a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044203.814483:0:9501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799e00/0x89871fc3aba18d9a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044203.814488:0:9501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799e00/0x89871fc3aba18d9a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044203.814606:0:9501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3843799e00 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:2.0:1784044203.814610:0:9501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799e00/0x89871fc3aba18d9a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044203.814616:0:9501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799e00/0x89871fc3aba18d9a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044203.814623:0:9501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9b397b61ba00) 00010000:00010000:2.0:1784044203.814626:0:9501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784044203.814629:0:9501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799e00/0x89871fc3aba18d9a lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044203.814701:0:9501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799e00/0x89871fc3aba18d9a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044203.814746:0:9501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799c00/0x89871fc3aba18d8c lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca694f expref: 38 pid: 9501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044203.814761:0:9501:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799a00/0x89871fc3aba18da1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca694f expref: 37 pid: 9501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044203.814768:0:9501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9b397aa61700) 00010000:00010000:2.0:1784044203.814771:0:9501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1784044203.814779:0:9501:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3843799a00, rc 0) 00000100:00100000:2.0:1784044203.814845:0:9501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843dbd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a93fdf3c-d42f-420a-95ea-b0cbfe954363+37:12426:x1870705565202688:12345-192.168.202.40@tcp:101:lfs.0 Request processed in 2386us (2599us total) trans 4294967478 rc 0/0 00000100:00100000:2.0:1784044203.814855:0:9501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 211 00000100:00100000:1.0:1784044203.824809:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044203.825266:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565202816 00000100:00100000:3.0:1784044203.825276:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565202816 00000100:00100000:3.0:1784044203.825337:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 212 00000100:00100000:3.0:1784044203.825349:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+37:12426:x1870705565202816:12345-192.168.202.40@tcp:54:lfs.0 00010000:00010000:3.0:1784044203.825432:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166b800/0x89871fc3aba18daf lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044203.825446:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798a00/0x89871fc3aba18d46 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6933 expref: 37 pid: 13808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044203.825453:0:6513:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166b800/0x89871fc3aba18daf lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044203.825481:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798a00/0x89871fc3aba18d46 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6933 expref: 37 pid: 13808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044203.825503:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798a00/0x89871fc3aba18d46 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6933 expref: 37 pid: 13808 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044203.825521:0:6513:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d82d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6513:1870705580997120:192.168.202.40@tcp:104: 00000100:00100000:3.0:1784044203.825621:0:6513:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3943259d80 going to sleep for 11 seconds 00000100:00100000:2.0:1784044203.828902:0:6513:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d82d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6513:1870705580997120:192.168.202.40@tcp:104: 00000100:00100000:3.0:1784044203.828904:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00010000:00010000:2.0:1784044203.828929:0:6513:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166b800/0x89871fc3aba18daf lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044203.828997:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565203072 00000100:00100000:0.0:1784044203.829004:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565203072 00000100:00100000:0.0:1784044203.829093:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 52 00000100:00100000:0.0:1784044203.829104:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+38:6177:x1870705565203072:12345-192.168.202.40@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1784044203.829445:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+39:6177:x1870705565203072:12345-192.168.202.40@tcp:35:ldlm_bl.0 Request processed in 342us (541us total) trans 4294967479 rc 0/0 00000100:00100000:0.0:1784044203.829453:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 52 00000100:00100000:1.0:1784044203.833585:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044203.833809:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565203200 00000100:00100000:2.0:1784044203.833818:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565203200 00010000:00010000:2.0:1784044203.833860:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798a00/0x89871fc3aba18d46 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6933 expref: 39 pid: 13808 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044203.833898:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 100 00000100:00100000:2.0:1784044203.833908:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d44000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+39:2409:x1870705565203200:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784044203.833924:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784044203.833932:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798a00/0x89871fc3aba18d46 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6933 expref: 39 pid: 13808 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044203.833945:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798a00/0x89871fc3aba18d46 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6933 expref: 39 pid: 13808 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044203.833970:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798a00/0x89871fc3aba18d46 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6933 expref: 39 pid: 13808 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044203.833987:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9b397aa61700) 00010000:00010000:2.0:1784044203.833992:0:6497:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166b800/0x89871fc3aba18daf lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044203.834018:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166b800/0x89871fc3aba18daf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044203.834025:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166b800/0x89871fc3aba18daf lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044203.834052:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784044203.834269:0:6513:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166b800/0x89871fc3aba18daf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044203.834278:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166b800/0x89871fc3aba18daf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044203.834333:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166b800/0x89871fc3aba18daf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044203.834342:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166b800/0x89871fc3aba18daf lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044203.834349:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166b800/0x89871fc3aba18daf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044203.834355:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b394166b800 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:3.0:1784044203.834359:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166b800/0x89871fc3aba18daf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044203.834367:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166b800/0x89871fc3aba18daf lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044203.834377:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9b397aa61700) 00010000:00010000:3.0:1784044203.834380:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1784044203.834383:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166b800/0x89871fc3aba18daf lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044203.834397:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166b800/0x89871fc3aba18daf lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044203.834478:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+38:12426:x1870705565202816:12345-192.168.202.40@tcp:54:lfs.0 Request processed in 9130us (9675us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044203.834489:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 212 00000100:00100000:2.0:1784044203.834814:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d44000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+38:2409:x1870705565203200:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 905us (1238us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044203.834822:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 100 00000100:00100000:1.0:1784044203.842405:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044203.842451:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565203456 00000100:00100000:2.0:1784044203.842461:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565203456 00000100:00100000:2.0:1784044203.842534:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 53 00000100:00100000:2.0:1784044203.842545:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+37:12426:x1870705565203456:12345-192.168.202.40@tcp:35:lfs.0 00000100:00100000:2.0:1784044203.842784:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+38:12426:x1870705565203456:12345-192.168.202.40@tcp:35:lfs.0 Request processed in 240us (396us total) trans 4294967480 rc 0/0 00000100:00100000:2.0:1784044203.842791:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 53 00000100:00100000:1.0:1784044203.923717:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044203.923774:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565203712 00000100:00100000:3.0:1784044203.923784:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565203712 00000100:00100000:3.0:1784044203.923897:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 213 00000100:00100000:3.0:1784044203.923916:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38427b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+38:12437:x1870705565203712:12345-192.168.202.40@tcp:101:cat.0 00010000:00010000:3.0:1784044203.923939:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784044203.923955:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166b800/0x89871fc3aba18db6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcd3dffad52ca6956 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044203.924014:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166bc00/0x89871fc3aba18dbd lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044203.924025:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166bc00/0x89871fc3aba18dbd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044203.924033:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166bc00/0x89871fc3aba18dbd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044203.924043:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166aa00/0x89871fc3aba18dc4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044203.924048:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166aa00/0x89871fc3aba18dc4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044203.924052:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166aa00/0x89871fc3aba18dc4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044203.924155:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166ac00/0x89871fc3aba18dcb lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044203.924165:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166ac00/0x89871fc3aba18dcb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044203.924205:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166ac00/0x89871fc3aba18dcb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784044203.924229:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 8 00010000:00010000:2.0:1784044203.924370:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166bc00/0x89871fc3aba18dbd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044203.924378:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166bc00/0x89871fc3aba18dbd lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044203.924384:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166bc00/0x89871fc3aba18dbd lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044203.924401:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b394166bc00 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:2.0:1784044203.924405:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166bc00/0x89871fc3aba18dbd lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044203.924421:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166bc00/0x89871fc3aba18dbd lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044203.924433:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9b3842777a00) 00010000:00010000:2.0:1784044203.924436:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784044203.924440:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166bc00/0x89871fc3aba18dbd lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044203.924446:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166bc00/0x89871fc3aba18dbd lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044203.924460:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166aa00/0x89871fc3aba18dc4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044203.924466:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166aa00/0x89871fc3aba18dc4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044203.924472:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166aa00/0x89871fc3aba18dc4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044203.924477:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b394166aa00 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:2.0:1784044203.924479:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166aa00/0x89871fc3aba18dc4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044203.924485:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166aa00/0x89871fc3aba18dc4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044203.924491:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9b397aa61f00) 00010000:00010000:2.0:1784044203.924493:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784044203.924496:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166aa00/0x89871fc3aba18dc4 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044203.924511:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166aa00/0x89871fc3aba18dc4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044203.924556:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166b800/0x89871fc3aba18db6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6956 expref: 41 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044203.924570:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166ac00/0x89871fc3aba18dcb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6956 expref: 40 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044203.924579:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9b397aa61700) 00010000:00010000:2.0:1784044203.924581:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784044203.924583:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b394166ac00, rc 0) 00000100:00100000:2.0:1784044203.924812:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38427b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+40:12437:x1870705565203712:12345-192.168.202.40@tcp:101:cat.0 Request processed in 894us (1105us total) trans 4294967481 rc 0/0 00000100:00100000:2.0:1784044203.924821:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 213 00000100:00100000:1.0:1784044203.929272:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044203.929364:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565203968 00000100:00100000:2.0:1784044203.929373:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565203968 00000100:00100000:2.0:1784044203.929448:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 54 00000100:00100000:2.0:1784044203.929458:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+40:12437:x1870705565203968:12345-192.168.202.40@tcp:35:cat.0 00000100:00100000:2.0:1784044203.929773:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+41:12437:x1870705565203968:12345-192.168.202.40@tcp:35:cat.0 Request processed in 316us (506us total) trans 4294967482 rc 0/0 00000100:00100000:2.0:1784044203.929782:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 54 00000100:00100000:1.0:1784044203.963219:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044203.963301:0:9501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565204224 00000100:00100000:2.0:1784044203.963310:0:9501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565204224 00000100:00100000:2.0:1784044203.963385:0:9501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 214 00000100:00100000:2.0:1784044203.963405:0:9501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a93fdf3c-d42f-420a-95ea-b0cbfe954363+41:12438:x1870705565204224:12345-192.168.202.40@tcp:36:rm.0 00010000:00010000:2.0:1784044203.963484:0:9501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:2.0:1784044203.963512:0:9501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799000/0x89871fc3aba18d69 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6941 expref: 41 pid: 13808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044203.963535:0:9501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166ac00/0x89871fc3aba18dcb lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6956 expref: 40 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044203.963549:0:9501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799a00/0x89871fc3aba18da1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca694f expref: 39 pid: 9501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044203.963557:0:9501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166ae00/0x89871fc3aba18d5b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca693a expref: 38 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044203.963563:0:9501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9b397aa61700) 00010000:00010000:2.0:1784044203.963567:0:9501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784044203.963585:0:9501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798a00/0x89871fc3aba18dd9 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044203.963596:0:9501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798a00/0x89871fc3aba18dd9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044203.963603:0:9501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798a00/0x89871fc3aba18dd9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044203.963612:0:9501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799c00/0x89871fc3aba18de0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044203.963616:0:9501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799c00/0x89871fc3aba18de0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044203.963629:0:9501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799c00/0x89871fc3aba18de0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044203.963705:0:9501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799e00/0x89871fc3aba18de7 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044203.963711:0:9501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799e00/0x89871fc3aba18de7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044203.963716:0:9501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799e00/0x89871fc3aba18de7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1784044203.963891:0:9501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].7, 64 off8712 00000004:00080000:2.0:1784044203.963902:0:9501:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 397134726819ns, next at 398134724231ns, rc = 0 00010000:00010000:2.0:1784044203.963944:0:9501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799800/0x89871fc3aba18dee lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044203.963950:0:9501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799800/0x89871fc3aba18dee lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044203.963955:0:9501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799800/0x89871fc3aba18dee lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044203.963960:0:9501:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799800/0x89871fc3aba18dee lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044203.963964:0:9501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799800/0x89871fc3aba18dee lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044203.963968:0:9501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799800/0x89871fc3aba18dee lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044203.963995:0:9501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784044203.964017:0:9501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799e00/0x89871fc3aba18de7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044203.964023:0:9501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799e00/0x89871fc3aba18de7 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044203.964029:0:9501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799e00/0x89871fc3aba18de7 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044203.964035:0:9501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3843799e00 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:2.0:1784044203.964040:0:9501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799e00/0x89871fc3aba18de7 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044203.964040:0:10330:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784044203.964046:0:10330:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799800/0x89871fc3aba18dee lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x40010480000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044203.964047:0:9501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799e00/0x89871fc3aba18de7 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044203.964052:0:10330:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3843799800 already unused, calling callback (ffffffffc0b56230) 00010000:00010000:2.0:1784044203.964057:0:9501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9b397aa61700) 00010000:00010000:0.0:1784044203.964057:0:10330:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799800/0x89871fc3aba18dee lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044203.964060:0:9501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1784044203.964064:0:9501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799e00/0x89871fc3aba18de7 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044203.964064:0:10330:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799800/0x89871fc3aba18dee lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044203.964070:0:9501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799e00/0x89871fc3aba18de7 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044203.964079:0:10330:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9b397aa61700) 00010000:00010000:0.0:1784044203.964081:0:10330:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1784044203.964083:0:9501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798a00/0x89871fc3aba18dd9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044203.964084:0:10330:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799800/0x89871fc3aba18dee lrc: 1/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044203.964090:0:10330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799800/0x89871fc3aba18dee lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044203.964091:0:9501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798a00/0x89871fc3aba18dd9 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044203.964096:0:9501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798a00/0x89871fc3aba18dd9 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044203.964100:0:10330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784044203.964102:0:10330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784044203.964104:0:10330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784044203.964106:0:9501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3843798a00 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:2.0:1784044203.964109:0:9501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798a00/0x89871fc3aba18dd9 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044203.964114:0:9501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798a00/0x89871fc3aba18dd9 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044203.964122:0:9501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9b3842777a00) 00010000:00010000:2.0:1784044203.964125:0:9501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784044203.964128:0:9501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798a00/0x89871fc3aba18dd9 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044203.964134:0:9501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798a00/0x89871fc3aba18dd9 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784044203.964145:0:9501:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000005f76c97a reply state 00000000313d9bfd transno 4294967483 ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799c00/0x89871fc3aba18de0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044203.964155:0:9501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799c00/0x89871fc3aba18de0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044203.964161:0:9501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9b397b61ba00) 00010000:00010000:2.0:1784044203.964163:0:9501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1784044203.964166:0:9501:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1784044203.964278:0:9501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a93fdf3c-d42f-420a-95ea-b0cbfe954363+39:12438:x1870705565204224:12345-192.168.202.40@tcp:36:rm.0 Request processed in 875us (1065us total) trans 4294967483 rc 0/0 00000100:00100000:2.0:1784044203.964286:0:9501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 214 00000100:00100000:1.0:1784044204.023793:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044204.029246:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565204480 00000100:00100000:3.0:1784044204.029263:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565204480 00000100:00100000:3.0:1784044204.029341:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 215 00000100:00100000:3.0:1784044204.029363:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3958084450 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+39:12444:x1870705565204480:12345-192.168.202.40@tcp:101:bash.0 00010000:00010000:3.0:1784044204.029422:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784044204.029445:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166a400/0x89871fc3aba18df5 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcd3dffad52ca695d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044204.029556:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166ae00/0x89871fc3aba18dfc lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044204.029573:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166ae00/0x89871fc3aba18dfc lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044204.029585:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166ae00/0x89871fc3aba18dfc lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044204.029597:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166ac00/0x89871fc3aba18e03 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044204.029604:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166ac00/0x89871fc3aba18e03 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044204.029611:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166ac00/0x89871fc3aba18e03 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1784044204.029938:0:6513:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x5:0x0], index 1: 0 00010000:00010000:3.0:1784044204.030094:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166b800/0x89871fc3aba18e0a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044204.030117:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166b800/0x89871fc3aba18e0a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044204.030125:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166b800/0x89871fc3aba18e0a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044204.030162:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166ae00/0x89871fc3aba18dfc lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044204.030169:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166ae00/0x89871fc3aba18dfc lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044204.030206:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166ae00/0x89871fc3aba18dfc lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044204.030212:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b394166ae00 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:3.0:1784044204.030217:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166ae00/0x89871fc3aba18dfc lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044204.030225:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166ae00/0x89871fc3aba18dfc lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044204.030236:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9b3842777a00) 00010000:00010000:3.0:1784044204.030240:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784044204.030244:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166ae00/0x89871fc3aba18dfc lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044204.030250:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166ae00/0x89871fc3aba18dfc lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784044204.030265:0:6513:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000004d09658c reply state 00000000454afae0 transno 4294967484 ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166ac00/0x89871fc3aba18e03 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044204.030283:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166ac00/0x89871fc3aba18e03 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044204.030290:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9b397b61ba00) 00010000:00010000:3.0:1784044204.030292:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1784044204.030295:0:6513:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1784044204.030323:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166a400/0x89871fc3aba18df5 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca695d expref: 42 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044204.030337:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166b800/0x89871fc3aba18e0a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca695d expref: 41 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044204.030345:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9b397aa61400) 00010000:00010000:3.0:1784044204.030347:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784044204.030349:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b394166b800, rc 0) 00000100:00100000:3.0:1784044204.030428:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3958084450 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+42:12444:x1870705565204480:12345-192.168.202.40@tcp:101:bash.0 Request processed in 1077us (6645us total) trans 4294967484 rc 0/0 00000100:00100000:3.0:1784044204.030435:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 215 00000100:00100000:0.0:1784044204.042849:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044204.042943:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565204608 00000100:00100000:3.0:1784044204.042953:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565204608 00000100:00100000:3.0:1784044204.043014:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 69 00000100:00100000:3.0:1784044204.043025:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843e39f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+5:2410:x1870705565204608:12345-192.168.202.40@tcp:101:bash.0 00010000:00010000:3.0:1784044204.043044:0:8428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784044204.043079:0:8428:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009e35d841/0x89871fc3aba18e18 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcd3dffad52ca6964 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784044204.043106:0:8428:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784044204.043140:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=397s v=(0 0) 00010000:00010000:3.0:1784044204.043146:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784044204.043156:0:8428:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009e35d841/0x89871fc3aba18e18 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6964 expref: 6 pid: 8428 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044204.044165:0:8428:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009e35d841/0x89871fc3aba18e18 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6964 expref: 6 pid: 8428 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044204.044204:0:8428:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b394166a400, rc 0) 00000100:00100000:2.0:1784044204.044669:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843e39f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+6:2410:x1870705565204608:12345-192.168.202.40@tcp:101:bash.0 Request processed in 1642us (1825us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044204.044679:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 69 00000100:00100000:1.0:1784044204.057874:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044204.058004:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565204736 00000100:00100000:0.0:1784044204.058014:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565204736 00000100:00100000:0.0:1784044204.058084:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 70 00000100:00100000:0.0:1784044204.058095:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+6:12444:x1870705565204736:12345-192.168.202.40@tcp:101:bash.0 00010000:00010000:0.0:1784044204.058114:0:8427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784044204.058133:0:8427:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f5a0ba8d/0x89871fc3aba18e1f lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcd3dffad52ca696b expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044204.058166:0:8427:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009e35d841/0x89871fc3aba18e18 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6964 expref: 7 pid: 8428 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044204.058212:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784044204.058216:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784044204.058222:0:8427:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f5a0ba8d/0x89871fc3aba18e1f lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca696b expref: 7 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044204.058274:0:8427:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009e35d841/0x89871fc3aba18e18 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6964 expref: 7 pid: 8428 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044204.058300:0:8427:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009e35d841/0x89871fc3aba18e18 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6964 expref: 7 pid: 8428 timeout: 497 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044204.058316:0:8427:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843e39c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8427:1870705580997248:192.168.202.40@tcp:104: 00000100:00100000:0.0:1784044204.058428:0:8427:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3975b85780 going to sleep for 11 seconds 00000100:00100000:0.0:1784044204.061717:0:8427:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843e39c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8427:1870705580997248:192.168.202.40@tcp:104: 00010000:00010000:0.0:1784044204.061759:0:8427:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f5a0ba8d/0x89871fc3aba18e1f lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca696b expref: 7 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044204.061781:0:8427:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b38410b6a00, rc 0) 00000100:00100000:0.0:1784044204.061847:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+7:12444:x1870705565204736:12345-192.168.202.40@tcp:101:bash.0 Request processed in 3753us (3982us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044204.061856:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 70 00000100:00100000:2.0:1784044204.064296:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044204.064543:0:13182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565204864 00000100:00100000:3.0:1784044204.064554:0:13182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565204864 00010000:00010000:3.0:1784044204.064598:0:13182:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009e35d841/0x89871fc3aba18e18 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6964 expref: 7 pid: 8428 timeout: 497 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044204.064646:0:13182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 101 00000100:00100000:3.0:1784044204.064657:0:13182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843e0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a93fdf3c-d42f-420a-95ea-b0cbfe954363+7:2410:x1870705565204864:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784044204.064673:0:13182:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784044204.064698:0:13182:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009e35d841/0x89871fc3aba18e18 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6964 expref: 7 pid: 8428 timeout: 497 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044204.064713:0:13182:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009e35d841/0x89871fc3aba18e18 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6964 expref: 7 pid: 8428 timeout: 497 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044204.064738:0:13182:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009e35d841/0x89871fc3aba18e18 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6964 expref: 7 pid: 8428 timeout: 497 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044204.064778:0:13182:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784044204.064783:0:13182:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784044204.064793:0:13182:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f5a0ba8d/0x89871fc3aba18e1f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca696b expref: 6 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044204.064806:0:13182:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f5a0ba8d/0x89871fc3aba18e1f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca696b expref: 6 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044204.064853:0:13182:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000f5a0ba8d/0x89871fc3aba18e1f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca696b expref: 6 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044204.064869:0:13182:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d82a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:13182:1870705580997376:192.168.202.40@tcp:105: 00000100:00100000:3.0:1784044204.064963:0:13182:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3942f27900 going to sleep for 11 seconds 00000100:00100000:3.0:1784044204.073966:0:13182:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d82a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:13182:1870705580997376:192.168.202.40@tcp:105: 00010000:00010000:3.0:1784044204.073991:0:13182:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784044204.074054:0:13182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843e0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a93fdf3c-d42f-420a-95ea-b0cbfe954363+6:2410:x1870705565204864:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 9397us (9772us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044204.074076:0:13182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 101 00000100:00100000:2.0:1784044204.080161:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044204.080485:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565205120 00000100:00100000:0.0:1784044204.080496:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565205120 00000100:00100000:0.0:1784044204.080565:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 55 00000100:00100000:0.0:1784044204.080576:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843e0d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+42:12444:x1870705565205120:12345-192.168.202.40@tcp:35:bash.0 00000100:00100000:0.0:1784044204.080897:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843e0d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+43:12444:x1870705565205120:12345-192.168.202.40@tcp:35:bash.0 Request processed in 322us (747us total) trans 4294967485 rc 0/0 00000100:00100000:0.0:1784044204.080906:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 55 00000100:00100000:2.0:1784044204.109459:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784044204.109488:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843e39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1870705580997504:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1784044204.109568:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044204.109666:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580997504 00000100:00100000:0.0:1784044204.109674:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580997504 00000100:00100000:0.0:1784044204.109733:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:0.0:1784044204.109743:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843e0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1870705580997504:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1784044204.109779:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:0.0:1784044204.109838:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843e0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1870705580997504:12345-0@lo:41:osp-pre-0-1.0 Request processed in 96us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044204.109846:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:3.0:1784044204.110286:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843e39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1870705580997504:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1784044204.373591:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044204.373705:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565205248 00000100:00100000:0.0:1784044204.373716:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565205248 00000100:00100000:0.0:1784044204.373783:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 216 00000100:00100000:0.0:1784044204.373793:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843e0e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+43:12460:x1870705565205248:12345-192.168.202.40@tcp:101:lfs.0 00010000:00010000:0.0:1784044204.373816:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784044204.373840:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6600/0x89871fc3aba18e26 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcd3dffad52ca6972 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044204.373915:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7c00/0x89871fc3aba18e2d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044204.373928:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7c00/0x89871fc3aba18e2d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044204.373940:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7c00/0x89871fc3aba18e2d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784044204.373982:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:0.0:1784044204.373986:0:6512:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1784044204.374007:0:6512:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7c00/0x89871fc3aba18e2d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044204.374051:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6600/0x89871fc3aba18e26 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6972 expref: 45 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044204.374071:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7c00/0x89871fc3aba18e2d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6972 expref: 44 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044204.374080:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9b3842777a00) 00010000:00010000:0.0:1784044204.374083:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1784044204.374087:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b38410b7c00, rc 0) 00000100:00100000:0.0:1784044204.374165:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843e0e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+44:12460:x1870705565205248:12345-192.168.202.40@tcp:101:lfs.0 Request processed in 373us (583us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044204.374434:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 216 00000100:00100000:1.0:1784044204.378011:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044204.378102:0:13808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565205504 00000100:00100000:3.0:1784044204.378112:0:13808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565205504 00000100:00100000:3.0:1784044204.378277:0:13808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 217 00000100:00100000:3.0:1784044204.378301:0:13808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a93fdf3c-d42f-420a-95ea-b0cbfe954363+44:12460:x1870705565205504:12345-192.168.202.40@tcp:101:lfs.0 00010000:00010000:3.0:1784044204.378339:0:13808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784044204.378360:0:13808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166a400/0x89871fc3aba18e34 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcd3dffad52ca6979 expref: -99 pid: 13808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044204.378486:0:13808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166ae00/0x89871fc3aba18e3b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044204.378501:0:13808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166ae00/0x89871fc3aba18e3b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044204.378513:0:13808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166ae00/0x89871fc3aba18e3b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784044204.378525:0:13808:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:3.0:1784044204.378629:0:13808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166a400/0x89871fc3aba18e34 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6979 expref: 47 pid: 13808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044204.378648:0:13808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166ae00/0x89871fc3aba18e3b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6979 expref: 46 pid: 13808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044204.378657:0:13808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9b397aa61400) 00010000:00010000:3.0:1784044204.378660:0:13808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784044204.378664:0:13808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b394166ae00, rc 0) 00000100:00100000:3.0:1784044204.378721:0:13808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a93fdf3c-d42f-420a-95ea-b0cbfe954363+46:12460:x1870705565205504:12345-192.168.202.40@tcp:101:lfs.0 Request processed in 435us (719us total) trans 4294967486 rc 0/0 00000100:00100000:3.0:1784044204.378728:0:13808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 217 00000100:00100000:1.0:1784044204.383413:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044204.383569:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565205760 00000100:00100000:2.0:1784044204.383581:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565205760 00000100:00100000:2.0:1784044204.383650:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 218 00000100:00100000:2.0:1784044204.383661:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+46:12460:x1870705565205760:12345-192.168.202.40@tcp:101:lfs.0 00010000:00010000:2.0:1784044204.383686:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784044204.383708:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799000/0x89871fc3aba18e49 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcd3dffad52ca6980 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044204.383817:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799400/0x89871fc3aba18e50 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044204.383832:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799400/0x89871fc3aba18e50 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044204.383843:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799400/0x89871fc3aba18e50 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784044204.383855:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:2.0:1784044204.383963:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799000/0x89871fc3aba18e49 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6980 expref: 49 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044204.383982:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799400/0x89871fc3aba18e50 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6980 expref: 48 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044204.384010:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9b397aa61400) 00010000:00010000:2.0:1784044204.384013:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1784044204.384016:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3843799400, rc 0) 00000100:00100000:2.0:1784044204.384084:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+48:12460:x1870705565205760:12345-192.168.202.40@tcp:101:lfs.0 Request processed in 424us (709us total) trans 4294967487 rc 0/0 00000100:00100000:2.0:1784044204.384091:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 218 00000100:00100000:1.0:1784044204.387708:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044204.387837:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565205888 00000100:00100000:3.0:1784044204.387847:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565205888 00000100:00100000:3.0:1784044204.387914:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 15 00000100:00100000:3.0:1784044204.387939:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d2e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+48:2410:x1870705565205888:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784044204.387954:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784044204.387980:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166ae00/0x89871fc3aba18e3b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6979 expref: 48 pid: 13808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044204.388000:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9b397aa61400) 00010000:00010000:3.0:1784044204.388004:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784044204.390648:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d2e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+47:2410:x1870705565205888:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 2699us (2941us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044204.390663:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 15 00000100:00100000:1.0:1784044204.394836:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044204.395048:0:9822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565206016 00000100:00100000:2.0:1784044204.395059:0:9822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565206016 00000100:00100000:2.0:1784044204.395476:0:9822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 71 00000100:00100000:2.0:1784044204.395487:0:9822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d2df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a93fdf3c-d42f-420a-95ea-b0cbfe954363+6:2409:x1870705565206016:12345-192.168.202.40@tcp:1:lfs.0 00010000:00010000:2.0:1784044204.395534:0:9822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000045ec66be/0x89871fc3aba18e5e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044204.395556:0:9822:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f5a0ba8d/0x89871fc3aba18e1f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca696b expref: 6 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044204.395566:0:9822:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784044204.395570:0:9822:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1784044204.395575:0:9822:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000045ec66be/0x89871fc3aba18e5e lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044204.395615:0:9822:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f5a0ba8d/0x89871fc3aba18e1f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca696b expref: 6 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044204.397019:0:9822:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f5a0ba8d/0x89871fc3aba18e1f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca696b expref: 6 pid: 8427 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044204.397064:0:9822:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843e0c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9822:1870705580997632:192.168.202.40@tcp:104: 00000100:00100000:2.0:1784044204.397448:0:9822:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b397b8d3600 going to sleep for 11 seconds 00000100:00100000:2.0:1784044204.402114:0:9822:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843e0c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9822:1870705580997632:192.168.202.40@tcp:104: 00010000:00010000:2.0:1784044204.402168:0:9822:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000045ec66be/0x89871fc3aba18e5e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044204.404676:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044204.404965:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565206144 00000100:00100000:0.0:1784044204.404975:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565206144 00002000:00100000:0.0:1784044204.405025:0:8431:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff9b3843d2e680 x1870705565206144/t0(0) o4->a93fdf3c-d42f-420a-95ea-b0cbfe954363@192.168.202.40@tcp:355/0 lens 504/0 e 0 to 0 dl 1784044215 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784044204.405033:0:8431:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b3843d2e680 with x1870705565206144 ext(0->8) 00010000:00010000:0.0:1784044204.405041:0:8431:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000f5a0ba8d/0x89871fc3aba18e1f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca696b expref: 7 pid: 8427 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044204.405053:0:8431:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000f5a0ba8d/0x89871fc3aba18e1f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca696b expref: 7 pid: 8427 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784044204.405059:0:8431:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9b3843d2e680 00000100:00100000:0.0:1784044204.405090:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 3 00000100:00100000:0.0:1784044204.405099:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+7:2409:x1870705565206144:12345-192.168.202.40@tcp:4:lfs.0 00000100:00100000:0.0:1784044204.406481:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+9:2409:x1870705565206144:12345-192.168.202.40@tcp:4:lfs.0 Request processed in 1373us (1803us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1784044204.406494:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 3 00002000:00100000:0.0:1784044204.406505:0:8431:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff9b3843d2e680 x1870705565206144/t4294967309(0) o4->a93fdf3c-d42f-420a-95ea-b0cbfe954363@192.168.202.40@tcp:355/0 lens 504/448 e 0 to 0 dl 1784044215 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784044204.406515:0:8431:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b3843d2e680 with x1870705565206144 ext(0->8) 00010000:00010000:0.0:1784044204.406524:0:8431:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000f5a0ba8d/0x89871fc3aba18e1f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca696b expref: 9 pid: 8427 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044204.406539:0:8431:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000f5a0ba8d/0x89871fc3aba18e1f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca696b expref: 9 pid: 8427 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784044204.406546:0:8431:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9b3843d2e680 00000100:00100000:1.0:1784044204.410211:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044204.410348:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565206272 00000100:00100000:3.0:1784044204.410357:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565206272 00010000:00010000:3.0:1784044204.410420:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f5a0ba8d/0x89871fc3aba18e1f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca696b expref: 9 pid: 8427 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044204.410466:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 102 00000100:00100000:3.0:1784044204.410476:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3955a3b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+9:2409:x1870705565206272:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784044204.410494:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1784044204.410517:0:6496:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1784044204.410520:0:6496:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1784044203 00002000:00010000:3.0:1784044204.410522:0:6496:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 0 -> 1784044204 00002000:00010000:3.0:1784044204.410524:0:6496:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 0 -> 1784044203 00002000:00010000:3.0:1784044204.410526:0:6496:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1784044204.410532:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f5a0ba8d/0x89871fc3aba18e1f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca696b expref: 9 pid: 8427 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044204.410562:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f5a0ba8d/0x89871fc3aba18e1f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca696b expref: 9 pid: 8427 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044204.410585:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f5a0ba8d/0x89871fc3aba18e1f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca696b expref: 9 pid: 8427 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044204.410605:0:6496:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1784044204.410610:0:6496:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1784044204.410616:0:6496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000045ec66be/0x89871fc3aba18e5e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044204.410637:0:6496:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000045ec66be/0x89871fc3aba18e5e lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044204.410675:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784044204.410731:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3955a3b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+8:2409:x1870705565206272:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 257us (567us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044204.410739:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 102 00010000:00010000:2.0:1784044204.411006:0:9822:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000045ec66be/0x89871fc3aba18e5e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044204.411013:0:9822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000045ec66be/0x89871fc3aba18e5e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044204.411030:0:9822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000045ec66be/0x89871fc3aba18e5e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044204.411037:0:9822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000045ec66be/0x89871fc3aba18e5e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044204.411045:0:9822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000045ec66be/0x89871fc3aba18e5e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044204.411054:0:9822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3843798400 already unused, calling callback (ffffffffc0b56230) 00010000:00010000:2.0:1784044204.411058:0:9822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000045ec66be/0x89871fc3aba18e5e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044204.411079:0:9822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000045ec66be/0x89871fc3aba18e5e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044204.411091:0:9822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000045ec66be/0x89871fc3aba18e5e lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044204.411098:0:9822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000045ec66be/0x89871fc3aba18e5e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044204.411159:0:9822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d2df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a93fdf3c-d42f-420a-95ea-b0cbfe954363+7:2409:x1870705565206016:12345-192.168.202.40@tcp:1:lfs.0 Request processed in 15675us (16335us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044204.411167:0:9822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 71 00000100:00100000:1.0:1784044204.414497:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044204.414745:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565206528 00000100:00100000:0.0:1784044204.414756:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565206528 00000100:00100000:0.0:1784044204.414813:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 56 00000100:00100000:0.0:1784044204.414823:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3974224c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+47:12460:x1870705565206528:12345-192.168.202.40@tcp:35:lfs.0 00000004:00010000:0.0:1784044204.414899:0:6515:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799400/0x89871fc3aba18e50 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6980 expref: 47 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1784044204.415076:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00000001:00080000:0.0:1784044204.415111:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:0.0:1784044204.415441:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00010000:00010000:0.0:1784044204.415481:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6600/0x89871fc3aba18e65 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044204.415496:0:6515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166b800/0x89871fc3aba18e0a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca695d expref: 51 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044204.415519:0:6515:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6600/0x89871fc3aba18e65 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044204.415554:0:6515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166b800/0x89871fc3aba18e0a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca695d expref: 51 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044204.415570:0:6515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166b800/0x89871fc3aba18e0a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca695d expref: 51 pid: 6513 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044204.415585:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843e38e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6515:1870705580997760:192.168.202.40@tcp:104: 00000100:00100000:0.0:1784044204.415772:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3975b85e40 going to sleep for 11 seconds 00000100:00100000:0.0:1784044204.418418:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843e38e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6515:1870705580997760:192.168.202.40@tcp:104: 00010000:00010000:0.0:1784044204.418450:0:6515:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6600/0x89871fc3aba18e65 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044204.419673:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044204.419947:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565206656 00000100:00100000:2.0:1784044204.419954:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565206656 00010000:00010000:2.0:1784044204.419985:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166b800/0x89871fc3aba18e0a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca695d expref: 52 pid: 6513 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044204.420016:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 103 00000100:00100000:2.0:1784044204.420022:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d2c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+52:2409:x1870705565206656:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784044204.420035:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784044204.420042:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166b800/0x89871fc3aba18e0a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca695d expref: 52 pid: 6513 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044204.420054:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166b800/0x89871fc3aba18e0a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca695d expref: 52 pid: 6513 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044204.420099:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166b800/0x89871fc3aba18e0a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca695d expref: 52 pid: 6513 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044204.420118:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9b397aa61400) 00010000:00010000:2.0:1784044204.420134:0:6497:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6600/0x89871fc3aba18e65 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044204.420144:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6600/0x89871fc3aba18e65 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044204.420152:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6600/0x89871fc3aba18e65 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044204.420211:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784044204.420251:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d2c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+51:2409:x1870705565206656:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 229us (583us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044204.420257:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 103 00010000:00010000:0.0:1784044204.420631:0:6515:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6600/0x89871fc3aba18e65 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044204.420637:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6600/0x89871fc3aba18e65 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1784044204.420733:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000001:00080000:0.0:1784044204.420821:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00000100:00100000:0.0:1784044204.420904:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843e38e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6515:1870705580997888:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1784044204.420942:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044204.420973:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3975b85480 going to sleep for 11 seconds 00000100:00100000:3.0:1784044204.421072:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580997888 00000100:00100000:3.0:1784044204.421077:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580997888 00000100:00100000:3.0:1784044204.421142:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:3.0:1784044204.421150:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843e3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6515:x1870705580997888:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1784044204.421254:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843e3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6515:x1870705580997888:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 105us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044204.421259:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00080000:0.0:1784044204.421914:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784044204.421946:0:6515:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967308 gen 2 00000004:00080000:0.0:1784044204.421950:0:6515:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967307 committed transno 4294967308 00000004:00080000:0.0:1784044204.421967:0:6515:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b3844536300, transno 4294967308 00000100:00100000:0.0:1784044204.421983:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843e38e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6515:1870705580997888:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1784044204.422088:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00000100:00100000:0.0:1784044204.422147:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843e38e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6515:1870705580998016:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1784044204.422198:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044204.422216:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3975b85000 going to sleep for 11 seconds 00000100:00100000:2.0:1784044204.422324:0:7768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580998016 00000100:00100000:2.0:1784044204.422329:0:7768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580998016 00000100:00100000:2.0:1784044204.422365:0:7768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:2.0:1784044204.422371:0:7768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843e39180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6515:x1870705580998016:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1784044204.422477:0:7768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843e39180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6515:x1870705580998016:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 106us (278us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1784044204.422482:0:7768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:1.0:1784044204.422556:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843e38e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6515:1870705580998016:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1784044204.422585:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967494 00010000:00010000:1.0:1784044204.422610:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6600/0x89871fc3aba18e65 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044204.422616:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6600/0x89871fc3aba18e65 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044204.422620:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6600/0x89871fc3aba18e65 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044204.422644:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38410b6600 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:1.0:1784044204.422647:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6600/0x89871fc3aba18e65 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044204.422653:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6600/0x89871fc3aba18e65 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044204.422665:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9b397aa61400) 00010000:00010000:1.0:1784044204.422666:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1784044204.422669:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6600/0x89871fc3aba18e65 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044204.422673:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6600/0x89871fc3aba18e65 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1784044204.422743:0:6515:0:(mdd_object.c:4016:mdd_close()) Object [0x200000402:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1784044204.422789:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 64 off8512 00000004:00080000:1.0:1784044204.422796:0:6515:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 397593621718ns, next at 398593620687ns, rc = 0 00000001:00080000:1.0:1784044204.422801:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967495 00010000:00010000:1.0:1784044204.422815:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9b397aa61400) 00010000:00010000:1.0:1784044204.422817:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1784044204.422821:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799400/0x89871fc3aba18e50 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6980 expref: 55 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044204.422906:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3974224c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+54:12460:x1870705565206528:12345-192.168.202.40@tcp:35:lfs.0 Request processed in 8086us (8419us total) trans 4294967496 rc 0/0 00000100:00100000:1.0:1784044204.422912:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 56 00000020:00080000:1.0:1784044204.422914:0:6515:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1784044204.426653:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044204.426703:0:9501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565206784 00000100:00100000:2.0:1784044204.426710:0:9501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565206784 00000100:00100000:2.0:1784044204.426763:0:9501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 219 00000100:00100000:2.0:1784044204.426771:0:9501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a93fdf3c-d42f-420a-95ea-b0cbfe954363+54:12460:x1870705565206784:12345-192.168.202.40@tcp:101:lfs.0 00010000:00010000:2.0:1784044204.426800:0:9501:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784044204.426818:0:9501:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798600/0x89871fc3aba18e6c lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcd3dffad52ca6987 expref: -99 pid: 9501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044204.426875:0:9501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798600/0x89871fc3aba18e6c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6987 expref: 55 pid: 9501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044204.426887:0:9501:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798600/0x89871fc3aba18e6c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6987 expref: 55 pid: 9501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044204.426899:0:9501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9b397b61b500) 00010000:00010000:2.0:1784044204.426901:0:9501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1784044204.426904:0:9501:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3843798600, rc 0) 00000100:00100000:2.0:1784044204.426952:0:9501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a93fdf3c-d42f-420a-95ea-b0cbfe954363+55:12460:x1870705565206784:12345-192.168.202.40@tcp:101:lfs.0 Request processed in 182us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044204.426957:0:9501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 219 00000100:00100000:2.0:1784044204.430699:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044204.430759:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565207040 00000100:00100000:0.0:1784044204.430768:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565207040 00000100:00100000:0.0:1784044204.430811:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 57 00000100:00100000:0.0:1784044204.430818:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843e0c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+55:12460:x1870705565207040:12345-192.168.202.40@tcp:35:lfs.0 00000100:00100000:0.0:1784044204.431018:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843e0c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+56:12460:x1870705565207040:12345-192.168.202.40@tcp:35:lfs.0 Request processed in 201us (328us total) trans 4294967497 rc 0/0 00000100:00100000:0.0:1784044204.431024:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 57 00000100:00100000:1.0:1784044204.497560:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044204.497712:0:13808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565207168 00000100:00100000:3.0:1784044204.497721:0:13808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565207168 00000100:00100000:3.0:1784044204.497780:0:13808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 220 00000100:00100000:3.0:1784044204.497789:0:13808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a93fdf3c-d42f-420a-95ea-b0cbfe954363+56:12470:x1870705565207168:12345-192.168.202.40@tcp:34:lfs.0 00010000:00010000:3.0:1784044204.497861:0:13808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166ae00/0x89871fc3aba18e73 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044204.497880:0:13808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166ae00/0x89871fc3aba18e73 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044204.497892:0:13808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166ae00/0x89871fc3aba18e73 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044204.497904:0:13808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166a400/0x89871fc3aba18e7a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044204.497909:0:13808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166a400/0x89871fc3aba18e7a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044204.497914:0:13808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166a400/0x89871fc3aba18e7a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044204.498151:0:13808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166aa00/0x89871fc3aba18e81 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044204.498157:0:13808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166aa00/0x89871fc3aba18e81 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044204.498162:0:13808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166aa00/0x89871fc3aba18e81 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784044204.498231:0:13808:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166aa00/0x89871fc3aba18e81 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044204.498256:0:13808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166ae00/0x89871fc3aba18e73 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044204.498261:0:13808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166ae00/0x89871fc3aba18e73 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044204.498265:0:13808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166ae00/0x89871fc3aba18e73 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044204.498269:0:13808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b394166ae00 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:3.0:1784044204.498272:0:13808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166ae00/0x89871fc3aba18e73 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044204.498276:0:13808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166ae00/0x89871fc3aba18e73 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044204.498286:0:13808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9b3842777a00) 00010000:00010000:3.0:1784044204.498288:0:13808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784044204.498292:0:13808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166ae00/0x89871fc3aba18e73 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044204.498298:0:13808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166ae00/0x89871fc3aba18e73 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044204.498312:0:13808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166a400/0x89871fc3aba18e7a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044204.498318:0:13808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166a400/0x89871fc3aba18e7a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044204.498323:0:13808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166a400/0x89871fc3aba18e7a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044204.498334:0:13808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b394166a400 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:3.0:1784044204.498337:0:13808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166a400/0x89871fc3aba18e7a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044204.498344:0:13808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166a400/0x89871fc3aba18e7a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044204.498353:0:13808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9b397b61ba00) 00010000:00010000:3.0:1784044204.498355:0:13808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784044204.498358:0:13808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166a400/0x89871fc3aba18e7a lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044204.498363:0:13808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166a400/0x89871fc3aba18e7a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044204.498373:0:13808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166aa00/0x89871fc3aba18e81 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044204.498379:0:13808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166aa00/0x89871fc3aba18e81 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044204.498394:0:13808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166aa00/0x89871fc3aba18e81 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044204.498400:0:13808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b394166aa00 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:3.0:1784044204.498402:0:13808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166aa00/0x89871fc3aba18e81 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044204.498409:0:13808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166aa00/0x89871fc3aba18e81 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044204.498423:0:13808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9b397b61b500) 00010000:00010000:3.0:1784044204.498424:0:13808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784044204.498426:0:13808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166aa00/0x89871fc3aba18e81 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044204.498430:0:13808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166aa00/0x89871fc3aba18e81 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044204.498493:0:13808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a93fdf3c-d42f-420a-95ea-b0cbfe954363+56:12470:x1870705565207168:12345-192.168.202.40@tcp:34:lfs.0 Request processed in 705us (945us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044204.498499:0:13808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 220 00000100:00100000:2.0:1784044204.546075:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1784044204.547764:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565207424 00000100:00100000:1.0:1784044204.547778:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565207424 00000100:00100000:1.0:1784044204.547863:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 221 00000100:00100000:1.0:1784044204.547874:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843e0e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+56:12473:x1870705565207424:12345-192.168.202.40@tcp:101:lfs.0 00010000:00010000:1.0:1784044204.547897:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784044204.547918:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fca00/0x89871fc3aba18e88 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcd3dffad52ca698e expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044204.547993:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fce00/0x89871fc3aba18e8f lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044204.548008:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fce00/0x89871fc3aba18e8f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044204.548020:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fce00/0x89871fc3aba18e8f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044204.548031:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc000/0x89871fc3aba18e96 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044204.548036:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc000/0x89871fc3aba18e96 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044204.548040:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc000/0x89871fc3aba18e96 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044204.548158:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd000/0x89871fc3aba18e9d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044204.548167:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd000/0x89871fc3aba18e9d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044204.548222:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd000/0x89871fc3aba18e9d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784044204.548230:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:1.0:1784044204.548318:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fce00/0x89871fc3aba18e8f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044204.548325:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fce00/0x89871fc3aba18e8f lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044204.548331:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fce00/0x89871fc3aba18e8f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044204.548336:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38426fce00 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:1.0:1784044204.548340:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fce00/0x89871fc3aba18e8f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044204.548347:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fce00/0x89871fc3aba18e8f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044204.548359:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9b3842777a00) 00010000:00010000:1.0:1784044204.548361:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784044204.548367:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fce00/0x89871fc3aba18e8f lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044204.548372:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fce00/0x89871fc3aba18e8f lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044204.548395:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc000/0x89871fc3aba18e96 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044204.548400:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc000/0x89871fc3aba18e96 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044204.548412:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc000/0x89871fc3aba18e96 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044204.548417:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38426fc000 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:1.0:1784044204.548419:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc000/0x89871fc3aba18e96 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044204.548425:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc000/0x89871fc3aba18e96 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044204.548432:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9b397b61ba00) 00010000:00010000:1.0:1784044204.548434:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784044204.548436:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc000/0x89871fc3aba18e96 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044204.548441:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc000/0x89871fc3aba18e96 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044204.548479:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fca00/0x89871fc3aba18e88 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca698e expref: 59 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044204.548492:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd000/0x89871fc3aba18e9d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca698e expref: 58 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044204.548499:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9b397b61b500) 00010000:00010000:1.0:1784044204.548501:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784044204.548503:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b38426fd000, rc 0) 00000100:00100000:1.0:1784044204.548576:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843e0e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+58:12473:x1870705565207424:12345-192.168.202.40@tcp:101:lfs.0 Request processed in 703us (2510us total) trans 4294967498 rc 0/0 00000100:00100000:1.0:1784044204.548592:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 221 00000100:00100000:2.0:1784044204.553833:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044204.554607:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565207552 00000100:00100000:0.0:1784044204.554619:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565207552 00000100:00100000:0.0:1784044204.554697:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 222 00000100:00100000:0.0:1784044204.554708:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843e0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+58:12473:x1870705565207552:12345-192.168.202.40@tcp:54:lfs.0 00010000:00010000:0.0:1784044204.554781:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6600/0x89871fc3aba18eab lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044204.554795:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6600/0x89871fc3aba18eab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044204.554803:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6600/0x89871fc3aba18eab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044204.554861:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6600/0x89871fc3aba18eab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044204.554868:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6600/0x89871fc3aba18eab lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044204.554875:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6600/0x89871fc3aba18eab lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044204.554881:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38410b6600 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:0.0:1784044204.554885:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6600/0x89871fc3aba18eab lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044204.554893:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6600/0x89871fc3aba18eab lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044204.554906:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9b397b61b500) 00010000:00010000:0.0:1784044204.554909:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1784044204.554913:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6600/0x89871fc3aba18eab lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044204.554918:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6600/0x89871fc3aba18eab lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044204.554987:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843e0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+58:12473:x1870705565207552:12345-192.168.202.40@tcp:54:lfs.0 Request processed in 281us (1166us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044204.554995:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 222 00000100:00100000:3.0:1784044204.558613:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044204.558725:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565207808 00000100:00100000:0.0:1784044204.558736:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565207808 00000100:00100000:0.0:1784044204.558797:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 58 00000100:00100000:0.0:1784044204.558833:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+58:12473:x1870705565207808:12345-192.168.202.40@tcp:35:lfs.0 00000100:00100000:0.0:1784044204.559081:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+59:12473:x1870705565207808:12345-192.168.202.40@tcp:35:lfs.0 Request processed in 250us (476us total) trans 4294967499 rc 0/0 00000100:00100000:0.0:1784044204.559089:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 58 00000100:00100000:2.0:1784044204.634273:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044204.634612:0:13808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565208064 00000100:00100000:3.0:1784044204.634620:0:13808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565208064 00000100:00100000:3.0:1784044204.634738:0:13808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 223 00000100:00100000:3.0:1784044204.634747:0:13808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843e0dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a93fdf3c-d42f-420a-95ea-b0cbfe954363+59:12483:x1870705565208064:12345-192.168.202.40@tcp:101:bash.0 00010000:00010000:3.0:1784044204.634768:0:13808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784044204.634770:0:13808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1784044204.634793:0:13808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7c00/0x89871fc3aba18e2d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6972 expref: 59 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044204.634808:0:13808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9b3842777a00) 00010000:00010000:3.0:1784044204.634821:0:13808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784044204.634830:0:13808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166aa00/0x89871fc3aba18eb2 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcd3dffad52ca6995 expref: -99 pid: 13808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044204.634933:0:13808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166a400/0x89871fc3aba18eb9 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044204.634971:0:13808:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd000/0x89871fc3aba18e9d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca698e expref: 59 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044204.634981:0:13808:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166a400/0x89871fc3aba18eb9 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044204.635010:0:13808:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd000/0x89871fc3aba18e9d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca698e expref: 59 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044204.635019:0:13808:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd000/0x89871fc3aba18e9d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca698e expref: 59 pid: 6512 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044204.635030:0:13808:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d81c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13808:1870705580998144:192.168.202.40@tcp:104: 00000100:00100000:3.0:1784044204.635130:0:13808:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3942f27900 going to sleep for 11 seconds 00000100:00100000:2.0:1784044204.637735:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044204.637916:0:13808:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d81c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13808:1870705580998144:192.168.202.40@tcp:104: 00010000:00010000:3.0:1784044204.637941:0:13808:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166a400/0x89871fc3aba18eb9 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044204.638141:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565208192 00000100:00100000:1.0:1784044204.638148:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565208192 00010000:00010000:1.0:1784044204.638236:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd000/0x89871fc3aba18e9d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca698e expref: 60 pid: 6512 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044204.638270:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 104 00000100:00100000:1.0:1784044204.638280:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843e0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+60:2410:x1870705565208192:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784044204.638424:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784044204.638431:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd000/0x89871fc3aba18e9d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca698e expref: 60 pid: 6512 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044204.638440:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd000/0x89871fc3aba18e9d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca698e expref: 60 pid: 6512 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044204.638458:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd000/0x89871fc3aba18e9d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca698e expref: 60 pid: 6512 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044204.638471:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9b397b61b500) 00010000:00010000:1.0:1784044204.638475:0:6496:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166a400/0x89871fc3aba18eb9 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044204.638482:0:6496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166a400/0x89871fc3aba18eb9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044204.638487:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166a400/0x89871fc3aba18eb9 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044204.638550:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784044204.638610:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843e0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+59:2410:x1870705565208192:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 331us (886us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044204.638616:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 104 00010000:00010000:3.0:1784044204.638769:0:13808:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166a400/0x89871fc3aba18eb9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044204.638776:0:13808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166a400/0x89871fc3aba18eb9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784044204.638794:0:13808:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:3.0:1784044204.642064:0:13808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166aa00/0x89871fc3aba18eb2 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6995 expref: 60 pid: 13808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044204.642117:0:13808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166a400/0x89871fc3aba18eb9 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6995 expref: 59 pid: 13808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044204.642135:0:13808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9b397b61b500) 00010000:00010000:3.0:1784044204.642139:0:13808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1784044204.642142:0:13808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b394166a400, rc 0) 00000100:00100000:3.0:1784044204.642267:0:13808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843e0dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a93fdf3c-d42f-420a-95ea-b0cbfe954363+59:12483:x1870705565208064:12345-192.168.202.40@tcp:101:bash.0 Request processed in 7520us (8004us total) trans 4294967500 rc 0/0 00000100:00100000:3.0:1784044204.642275:0:13808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 223 00000100:00100000:2.0:1784044204.646467:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044204.646519:0:9501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565208320 00000100:00100000:0.0:1784044204.646529:0:9501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565208320 00000100:00100000:0.0:1784044204.646592:0:9501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 224 00000100:00100000:0.0:1784044204.646603:0:9501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843e0c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a93fdf3c-d42f-420a-95ea-b0cbfe954363+59:12483:x1870705565208320:12345-192.168.202.40@tcp:101:bash.0 00010000:00010000:0.0:1784044204.646629:0:9501:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784044204.646654:0:9501:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7600/0x89871fc3aba18ec7 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcd3dffad52ca699c expref: -99 pid: 9501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044204.646688:0:9501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7000/0x89871fc3aba18ece lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044204.646699:0:9501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7000/0x89871fc3aba18ece lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044204.646707:0:9501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7000/0x89871fc3aba18ece lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044204.646809:0:9501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7600/0x89871fc3aba18ec7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca699c expref: 61 pid: 9501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044204.646828:0:9501:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7000/0x89871fc3aba18ece lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca699c expref: 60 pid: 9501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044204.646836:0:9501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9b397b61b500) 00010000:00010000:0.0:1784044204.646845:0:9501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1784044204.646849:0:9501:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b38410b7000, rc 0) 00000100:00100000:0.0:1784044204.646913:0:9501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843e0c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a93fdf3c-d42f-420a-95ea-b0cbfe954363+60:12483:x1870705565208320:12345-192.168.202.40@tcp:101:bash.0 Request processed in 312us (638us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044204.646920:0:9501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 224 00000100:00100000:0.0:1784044204.649812:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044204.650030:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565208576 00000100:00100000:3.0:1784044204.650037:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565208576 00000100:00100000:1.0:1784044204.650244:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 225 00000100:00100000:1.0:1784044204.650258:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843e38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+60:12483:x1870705565208576:12345-192.168.202.40@tcp:36:bash.0 00010000:00010000:1.0:1784044204.650487:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fca00/0x89871fc3aba18ed5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044204.650500:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fca00/0x89871fc3aba18ed5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044204.650508:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fca00/0x89871fc3aba18ed5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1784044204.650540:0:6512:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967501 00000004:00010000:1.0:1784044204.650567:0:6512:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000008514e778 reply state 0000000088dc29ff transno 4294967502 ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fca00/0x89871fc3aba18ed5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044204.650575:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fca00/0x89871fc3aba18ed5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044204.650581:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9b397b61b500) 00010000:00010000:1.0:1784044204.650583:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784044204.650585:0:6512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1784044204.650798:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843e38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+63:12483:x1870705565208576:12345-192.168.202.40@tcp:36:bash.0 Request processed in 543us (994us total) trans 4294967502 rc 0/0 00000100:00100000:1.0:1784044204.650806:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 225 00000020:00080000:1.0:1784044204.650818:0:6512:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1784044204.652871:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044204.653024:0:13808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565208704 00000100:00100000:3.0:1784044204.653031:0:13808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565208704 00000100:00100000:3.0:1784044204.653113:0:13808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 226 00000100:00100000:3.0:1784044204.653121:0:13808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a93fdf3c-d42f-420a-95ea-b0cbfe954363+63:12483:x1870705565208704:12345-192.168.202.40@tcp:101:bash.0 00010000:00010000:3.0:1784044204.653146:0:13808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784044204.653160:0:13808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166aa00/0x89871fc3aba18edc lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcd3dffad52ca69a3 expref: -99 pid: 13808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044204.653258:0:13808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166ae00/0x89871fc3aba18ee3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044204.653269:0:13808:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166a400/0x89871fc3aba18eb9 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6995 expref: 64 pid: 13808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044204.653275:0:13808:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166ae00/0x89871fc3aba18ee3 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044204.653323:0:13808:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166a400/0x89871fc3aba18eb9 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6995 expref: 64 pid: 13808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044204.653336:0:13808:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166a400/0x89871fc3aba18eb9 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6995 expref: 64 pid: 13808 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044204.653350:0:13808:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d81c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13808:1870705580998272:192.168.202.40@tcp:104: 00000100:00100000:3.0:1784044204.653433:0:13808:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3942f27900 going to sleep for 11 seconds 00000100:00100000:2.0:1784044204.655543:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044204.655632:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565208832 00000100:00100000:0.0:1784044204.655641:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565208832 00010000:00010000:0.0:1784044204.655675:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166a400/0x89871fc3aba18eb9 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6995 expref: 65 pid: 13808 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044204.655714:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 105 00000100:00100000:0.0:1784044204.655721:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843e0f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+65:2410:x1870705565208832:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784044204.655732:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784044204.655737:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166a400/0x89871fc3aba18eb9 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6995 expref: 65 pid: 13808 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044204.655746:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166a400/0x89871fc3aba18eb9 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6995 expref: 65 pid: 13808 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044204.655762:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9b397b61b500) 00010000:00010000:0.0:1784044204.655765:0:6497:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166ae00/0x89871fc3aba18ee3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x8 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044204.655772:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166ae00/0x89871fc3aba18ee3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044204.655777:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166ae00/0x89871fc3aba18ee3 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044204.655801:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784044204.655857:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843e0f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+65:2410:x1870705565208832:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 135us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044204.655865:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 105 00010000:00010000:3.0:1784044204.656484:0:13808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166a400/0x89871fc3aba18eb9 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6995 expref: 64 pid: 13808 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044204.656499:0:13808:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d81c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13808:1870705580998272:192.168.202.40@tcp:104: 00010000:00010000:3.0:1784044204.656515:0:13808:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166ae00/0x89871fc3aba18ee3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044204.656734:0:13808:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166ae00/0x89871fc3aba18ee3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044204.656741:0:13808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166ae00/0x89871fc3aba18ee3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784044204.656809:0:13808:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:2.0:1784044204.656814:0:13808:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1784044204.656836:0:13808:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166ae00/0x89871fc3aba18ee3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044204.656915:0:13808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166aa00/0x89871fc3aba18edc lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca69a3 expref: 64 pid: 13808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044204.656927:0:13808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166ae00/0x89871fc3aba18ee3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca69a3 expref: 63 pid: 13808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044204.656933:0:13808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9b397b61b500) 00010000:00010000:2.0:1784044204.656935:0:13808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784044204.656937:0:13808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b394166ae00, rc 0) 00000100:00100000:2.0:1784044204.657018:0:13808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a93fdf3c-d42f-420a-95ea-b0cbfe954363+63:12483:x1870705565208704:12345-192.168.202.40@tcp:101:bash.0 Request processed in 3897us (4156us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044204.657025:0:13808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 226 00000100:00100000:2.0:1784044204.659776:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044204.659910:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565209088 00000100:00100000:0.0:1784044204.659920:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565209088 00000100:00100000:0.0:1784044204.660019:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 59 00000100:00100000:0.0:1784044204.660027:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843e0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+63:12483:x1870705565209088:12345-192.168.202.40@tcp:35:bash.0 00000100:00100000:0.0:1784044204.660404:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843e0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+64:12483:x1870705565209088:12345-192.168.202.40@tcp:35:bash.0 Request processed in 375us (631us total) trans 4294967503 rc 0/0 00000100:00100000:0.0:1784044204.660412:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 59 00010000:00010000:3.0:1784044204.690920:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784044204.740132:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044204.740330:0:9501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565209216 00000100:00100000:2.0:1784044204.740341:0:9501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565209216 00000100:00100000:2.0:1784044204.740443:0:9501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 227 00000100:00100000:2.0:1784044204.740455:0:9501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843e38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a93fdf3c-d42f-420a-95ea-b0cbfe954363+64:12489:x1870705565209216:12345-192.168.202.40@tcp:101:lfs.0 00010000:00010000:2.0:1784044204.740483:0:9501:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784044204.740509:0:9501:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799e00/0x89871fc3aba18eea lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcd3dffad52ca69aa expref: -99 pid: 9501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044204.740596:0:9501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799a00/0x89871fc3aba18ef1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044204.740642:0:9501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799a00/0x89871fc3aba18ef1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044204.740659:0:9501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799a00/0x89871fc3aba18ef1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784044204.740731:0:9501:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:2.0:1784044204.740735:0:9501:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1784044204.740761:0:9501:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799a00/0x89871fc3aba18ef1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044204.740790:0:9501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799e00/0x89871fc3aba18eea lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca69aa expref: 66 pid: 9501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044204.740813:0:9501:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799a00/0x89871fc3aba18ef1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca69aa expref: 65 pid: 9501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044204.740821:0:9501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9b3842777a00) 00010000:00010000:2.0:1784044204.740824:0:9501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1784044204.740827:0:9501:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3843799a00, rc 0) 00000100:00100000:2.0:1784044204.740905:0:9501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843e38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a93fdf3c-d42f-420a-95ea-b0cbfe954363+65:12489:x1870705565209216:12345-192.168.202.40@tcp:101:lfs.0 Request processed in 452us (796us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044204.740913:0:9501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 227 00000100:00100000:2.0:1784044204.751477:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1784044204.751557:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565209344 00000100:00100000:1.0:1784044204.751567:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565209344 00000100:00100000:1.0:1784044204.751636:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 228 00000100:00100000:1.0:1784044204.751648:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843e0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+65:12489:x1870705565209344:12345-192.168.202.40@tcp:101:lfs.0 00010000:00010000:1.0:1784044204.751673:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784044204.751694:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fce00/0x89871fc3aba18ef8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcd3dffad52ca69b1 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044204.751759:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd400/0x89871fc3aba18eff lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044204.751774:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd400/0x89871fc3aba18eff lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044204.751786:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd400/0x89871fc3aba18eff lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044204.751797:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd800/0x89871fc3aba18f06 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044204.751805:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd800/0x89871fc3aba18f06 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044204.751811:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd800/0x89871fc3aba18f06 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044204.751898:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fdc00/0x89871fc3aba18f0d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044204.751908:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fdc00/0x89871fc3aba18f0d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044204.751935:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fdc00/0x89871fc3aba18f0d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784044204.751980:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:1.0:1784044204.751985:0:6512:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1784044204.752004:0:6512:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fdc00/0x89871fc3aba18f0d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044204.752017:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fdc00/0x89871fc3aba18f0d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044204.752025:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd400/0x89871fc3aba18eff lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044204.752032:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd400/0x89871fc3aba18eff lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044204.752039:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd400/0x89871fc3aba18eff lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044204.752045:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38426fd400 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:1.0:1784044204.752049:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd400/0x89871fc3aba18eff lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044204.752057:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd400/0x89871fc3aba18eff lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044204.752070:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9b3842777a00) 00010000:00010000:1.0:1784044204.752072:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784044204.752076:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd400/0x89871fc3aba18eff lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044204.752092:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd400/0x89871fc3aba18eff lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044204.752106:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd800/0x89871fc3aba18f06 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044204.752112:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd800/0x89871fc3aba18f06 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044204.752118:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd800/0x89871fc3aba18f06 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044204.752135:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38426fd800 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:1.0:1784044204.752139:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd800/0x89871fc3aba18f06 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044204.752144:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd800/0x89871fc3aba18f06 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044204.752153:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9b397b61ba00) 00010000:00010000:1.0:1784044204.752156:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784044204.752159:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd800/0x89871fc3aba18f06 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044204.752164:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd800/0x89871fc3aba18f06 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044204.752231:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fce00/0x89871fc3aba18ef8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca69b1 expref: 67 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044204.752245:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fdc00/0x89871fc3aba18f0d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca69b1 expref: 66 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044204.752259:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9b397b61b500) 00010000:00010000:1.0:1784044204.752262:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784044204.752265:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b38426fdc00, rc 0) 00000100:00100000:1.0:1784044204.752439:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843e0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+66:12489:x1870705565209344:12345-192.168.202.40@tcp:101:lfs.0 Request processed in 793us (974us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044204.752447:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 228 00000100:00100000:1.0:1784044204.757358:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044204.757992:0:13808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565209728 00000100:00100000:2.0:1784044204.758003:0:13808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565209728 00000100:00100000:2.0:1784044204.758068:0:13808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 229 00000100:00100000:2.0:1784044204.758078:0:13808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a93fdf3c-d42f-420a-95ea-b0cbfe954363+66:12489:x1870705565209728:12345-192.168.202.40@tcp:101:lfs.0 00010000:00010000:2.0:1784044204.758114:0:13808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784044204.758147:0:13808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799e00/0x89871fc3aba18f14 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcd3dffad52ca69b8 expref: -99 pid: 13808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044204.758307:0:13808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798400/0x89871fc3aba18f1b lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044204.758323:0:13808:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166ae00/0x89871fc3aba18ee3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca69a3 expref: 67 pid: 13808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044204.758331:0:13808:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fdc00/0x89871fc3aba18f0d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca69b1 expref: 67 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044204.758340:0:13808:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798400/0x89871fc3aba18f1b lrc: 5/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044204.758377:0:13808:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fdc00/0x89871fc3aba18f0d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca69b1 expref: 67 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044204.758401:0:13808:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fdc00/0x89871fc3aba18f0d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca69b1 expref: 67 pid: 6512 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044204.758416:0:13808:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843e0d180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13808:1870705580998400:192.168.202.40@tcp:104: 00010000:00010000:2.0:1784044204.758520:0:13808:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166ae00/0x89871fc3aba18ee3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca69a3 expref: 67 pid: 13808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044204.758530:0:13808:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166ae00/0x89871fc3aba18ee3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca69a3 expref: 67 pid: 13808 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044204.758552:0:13808:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843e0d500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13808:1870705580998528:192.168.202.40@tcp:104: 00000100:00100000:2.0:1784044204.758578:0:13808:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b397b8d30c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784044204.762066:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044204.762147:0:13182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565209856 00000100:00100000:3.0:1784044204.762157:0:13182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565209856 00010000:00010000:3.0:1784044204.762231:0:13182:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166ae00/0x89871fc3aba18ee3 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca69a3 expref: 68 pid: 13808 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044204.762271:0:13182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 106 00000100:00100000:3.0:1784044204.762292:0:13182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843e3a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a93fdf3c-d42f-420a-95ea-b0cbfe954363+68:2408:x1870705565209856:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784044204.762301:0:13808:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.202.40@tcp) returned -22 from blocking AST (req@000000005b877df3 x1870705580998400) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fdc00/0x89871fc3aba18f0d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca69b1 expref: 68 pid: 6512 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044204.762310:0:13182:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784044204.762320:0:13182:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166ae00/0x89871fc3aba18ee3 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca69a3 expref: 68 pid: 13808 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044204.762325:0:13808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fdc00/0x89871fc3aba18f0d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca69b1 expref: 68 pid: 6512 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044204.762351:0:13808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fdc00/0x89871fc3aba18f0d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca69b1 expref: 68 pid: 6512 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044204.762355:0:13182:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166ae00/0x89871fc3aba18ee3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca69a3 expref: 68 pid: 13808 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044204.762391:0:13182:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9b397b61b500) 00000100:00100000:2.0:1784044204.762392:0:13808:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843e0d180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13808:1870705580998400:192.168.202.40@tcp:104: 00010000:00010000:3.0:1784044204.762399:0:13182:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798400/0x89871fc3aba18f1b lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044204.762411:0:13182:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798400/0x89871fc3aba18f1b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044204.762413:0:13808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166ae00/0x89871fc3aba18ee3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca69a3 expref: 67 pid: 13808 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044204.762429:0:13182:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798400/0x89871fc3aba18f1b lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044204.762435:0:13808:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843e0d500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13808:1870705580998528:192.168.202.40@tcp:104: 00010000:00010000:3.0:1784044204.762453:0:13182:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784044204.762460:0:13808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9b397b61b500) 00010000:00010000:2.0:1784044204.762468:0:13808:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798400/0x89871fc3aba18f1b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044204.762478:0:13808:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798400/0x89871fc3aba18f1b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044204.762484:0:13808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798400/0x89871fc3aba18f1b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044204.762512:0:13182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843e3a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a93fdf3c-d42f-420a-95ea-b0cbfe954363+66:2408:x1870705565209856:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 231us (455us total) trans 0 rc 0/0 00000004:00200000:2.0:1784044204.762515:0:13808:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000100:00100000:3.0:1784044204.762524:0:13182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 106 00010000:00010000:2.0:1784044204.762657:0:13808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799e00/0x89871fc3aba18f14 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca69b8 expref: 67 pid: 13808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044204.762675:0:13808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798400/0x89871fc3aba18f1b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca69b8 expref: 66 pid: 13808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044204.762682:0:13808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9b397b61b500) 00010000:00010000:2.0:1784044204.762685:0:13808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1784044204.762688:0:13808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3843798400, rc 0) 00000100:00100000:2.0:1784044204.762718:0:13808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a93fdf3c-d42f-420a-95ea-b0cbfe954363+66:12489:x1870705565209728:12345-192.168.202.40@tcp:101:lfs.0 Request processed in 4641us (5370us total) trans 4294967504 rc 0/0 00000100:00100000:2.0:1784044204.762725:0:13808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 229 00000100:00100000:1.0:1784044204.764673:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044204.764739:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565209472 00000100:00100000:0.0:1784044204.764748:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565209472 00000100:00100000:0.0:1784044204.764805:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16 00000100:00100000:0.0:1784044204.764814:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d2f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+66:2410:x1870705565209472:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784044204.764829:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784044204.764832:0:6497:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie 89871fc3aba18f0d) 00010000:00010000:0.0:1784044204.764834:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784044204.764925:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d2f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+66:2410:x1870705565209472:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 112us (261us total) trans 0 rc 116/116 00000100:00100000:0.0:1784044204.764933:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16 00000100:00100000:0.0:1784044204.769942:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044204.770060:0:13182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565210112 00000100:00100000:3.0:1784044204.770070:0:13182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565210112 00000100:00100000:3.0:1784044204.770147:0:13182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 17 00000100:00100000:3.0:1784044204.770157:0:13182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843e3b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a93fdf3c-d42f-420a-95ea-b0cbfe954363+66:12489:x1870705565210112:12345-192.168.202.40@tcp:103:lfs.0 00010000:00010000:3.0:1784044204.770197:0:13182:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784044204.770225:0:13182:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798600/0x89871fc3aba18e6c lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6987 expref: 66 pid: 9501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044204.770244:0:13182:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9b397b61b500) 00010000:00010000:3.0:1784044204.770249:0:13182:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784044204.770359:0:13182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843e3b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a93fdf3c-d42f-420a-95ea-b0cbfe954363+65:12489:x1870705565210112:12345-192.168.202.40@tcp:103:lfs.0 Request processed in 204us (439us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044204.770367:0:13182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 17 00000100:00100000:2.0:1784044204.776400:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044204.776866:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565210240 00000100:00100000:0.0:1784044204.776899:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565210240 00000100:00100000:0.0:1784044204.776966:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 230 00000100:00100000:0.0:1784044204.776977:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843e0d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+65:12489:x1870705565210240:12345-192.168.202.40@tcp:58:lfs.0 00010000:00010000:0.0:1784044204.777102:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6000/0x89871fc3aba18f29 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044204.777222:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6000/0x89871fc3aba18f29 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044204.777238:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6000/0x89871fc3aba18f29 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1784044204.777425:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:0.0:1784044204.777520:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843e0d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+65:12489:x1870705565210240:12345-192.168.202.40@tcp:58:lfs.0 Request processed in 543us (1138us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044204.777531:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 230 00000100:00100000:2.0:1784044204.785520:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044204.785703:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565210368 00000100:00100000:0.0:1784044204.785714:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565210368 00000100:00100000:0.0:1784044204.785777:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 231 00000100:00100000:0.0:1784044204.785788:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843e0d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+65:12489:x1870705565210368:12345-192.168.202.40@tcp:101:lfs.0 00010000:00010000:0.0:1784044204.785809:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784044204.785831:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6c00/0x89871fc3aba18f30 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcd3dffad52ca69bf expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044204.785906:0:6511:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6000/0x89871fc3aba18f29 lrc: 2/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044204.785919:0:6511:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6c00/0x89871fc3aba18f30 lrc: 4/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca69bf expref: 66 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044204.785962:0:6511:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6000/0x89871fc3aba18f29 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044204.785978:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6c00/0x89871fc3aba18f30 lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca69bf expref: 66 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044204.785993:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9b397b61b500) 00010000:00010000:0.0:1784044204.785996:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1784044204.785999:0:6511:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6c00/0x89871fc3aba18f30 lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca69bf expref: 66 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044204.786007:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b38410b6c00, rc 0) 00000100:00100000:0.0:1784044204.786264:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843e0d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+66:12489:x1870705565210368:12345-192.168.202.40@tcp:101:lfs.0 Request processed in 477us (755us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044204.786272:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 231 00000100:00100000:0.0:1784044205.133587:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784044205.133616:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1870705580998656:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1784044205.133705:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044205.133846:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580998656 00000100:00100000:1.0:1784044205.133858:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580998656 00000100:00100000:1.0:1784044205.133930:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1784044205.133944:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843e3b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1870705580998656:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1784044205.133993:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33914560 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1784044205.134042:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843e3b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1870705580998656:12345-0@lo:13:osp-pre-0-1.0 Request processed in 103us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044205.134051:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00080000:0.0:1784044205.134115:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784044205.134153:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1870705580998656:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1784044205.135013:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784044205.135030:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843e38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1870705580998784:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1784044205.135080:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044205.135120:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580998784 00000100:00100000:3.0:1784044205.135127:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580998784 00000004:00080000:0.0:1784044205.135319:0:8450:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 398306143210ns, next at 399306139661ns, rc = 0 00000100:00100000:0.0:1784044205.135341:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784044205.135350:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843e39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1870705580998912:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784044205.135395:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044205.135434:0:10713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580998912 00000100:00100000:0.0:1784044205.135454:0:10713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580998912 00000100:00100000:0.0:1784044205.135490:0:10713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1784044205.135497:0:10713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843e3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3641:x1870705580998912:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1784044205.135520:0:10713:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33914560 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1784044205.135560:0:10713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843e3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3641:x1870705580998912:12345-0@lo:13:osp-pre-0-0.0 Request processed in 63us (165us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044205.135567:0:10713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1784044205.135606:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843e39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1870705580998912:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1784044205.135624:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784044205.136741:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:3.0:1784044205.136759:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1870705580998784:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1784044205.136798:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1784044205.136876:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1870705580998784:12345-0@lo:41:osp-pre-1-0.0 Request processed in 123us (1795us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044205.136884:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:1.0:1784044205.137853:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843e38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1870705580998784:0@lo:41:osp-pre-1-0.0 00000040:00080000:1.0:1784044205.709654:0:13763:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1784044205.709664:0:13763:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1784044205.709692:0:13763:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:1.0:1784044205.709701:0:13763:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1784044205.709850:0:13763:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d2c380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13763:1870705580999040:192.168.202.40@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1784044205.709967:0:13763:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b39741e1180 going to sleep for 11 seconds 00010000:00010000:0.0:1784044205.710318:0:10331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784044205.730489:0:13763:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d2c380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13763:1870705580999040:192.168.202.40@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1784044205.730918:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044205.732494:0:13808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565210496 00000100:00100000:0.0:1784044205.732519:0:13808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565210496 00000100:00080000:0.0:1784044205.732687:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784044205.732771:0:13808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 232 00000100:00100000:0.0:1784044205.732790:0:13808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843e0ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a93fdf3c-d42f-420a-95ea-b0cbfe954363+66:12490:x1870705565210496:12345-192.168.202.40@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1784044205.732843:0:13808:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1784044205.733411:0:13808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843e0ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a93fdf3c-d42f-420a-95ea-b0cbfe954363+66:12490:x1870705565210496:12345-192.168.202.40@tcp:53:lhsmtool_posix.0 Request processed in 626us (2491us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044205.733422:0:13808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 232 00000100:00100000:2.0:1784044205.746665:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1784044205.746736:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565210624 00000100:00100000:1.0:1784044205.746751:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565210624 00000100:00100000:0.0:1784044205.746939:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 233 00000100:00100000:0.0:1784044205.746952:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+66:12490:x1870705565210624:12345-192.168.202.40@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1784044205.747069:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6800/0x89871fc3aba18f37 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044205.747091:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6800/0x89871fc3aba18f37 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044205.747138:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6800/0x89871fc3aba18f37 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044205.747160:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7600/0x89871fc3aba18f3e lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044205.747168:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7600/0x89871fc3aba18f3e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044205.747199:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7600/0x89871fc3aba18f3e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044205.747423:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6200/0x89871fc3aba18f45 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044205.747435:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6200/0x89871fc3aba18f45 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044205.747442:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6200/0x89871fc3aba18f45 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784044205.747507:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:0.0:1784044205.747512:0:6512:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1784044205.747540:0:6512:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6200/0x89871fc3aba18f45 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044205.747554:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6800/0x89871fc3aba18f37 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044205.747561:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6800/0x89871fc3aba18f37 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044205.747581:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6800/0x89871fc3aba18f37 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044205.747588:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38410b6800 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:0.0:1784044205.747593:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6800/0x89871fc3aba18f37 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044205.747601:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6800/0x89871fc3aba18f37 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044205.747616:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9b396f2a8900) 00010000:00010000:0.0:1784044205.747619:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784044205.747623:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6800/0x89871fc3aba18f37 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044205.747629:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6800/0x89871fc3aba18f37 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044205.747641:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7600/0x89871fc3aba18f3e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044205.747645:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7600/0x89871fc3aba18f3e lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044205.747649:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7600/0x89871fc3aba18f3e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044205.747652:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38410b7600 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:0.0:1784044205.747654:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7600/0x89871fc3aba18f3e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044205.747664:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7600/0x89871fc3aba18f3e lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044205.747670:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x69d7fe76 (ffff9b39758c1c00) 00010000:00010000:0.0:1784044205.747671:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784044205.747673:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7600/0x89871fc3aba18f3e lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044205.747677:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7600/0x89871fc3aba18f3e lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044205.747690:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6200/0x89871fc3aba18f45 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044205.747694:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6200/0x89871fc3aba18f45 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044205.747698:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6200/0x89871fc3aba18f45 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044205.747700:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38410b6200 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:0.0:1784044205.747702:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6200/0x89871fc3aba18f45 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044205.747705:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6200/0x89871fc3aba18f45 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044205.747708:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9b397b61b500) 00010000:00010000:0.0:1784044205.747710:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784044205.747712:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6200/0x89871fc3aba18f45 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044205.747721:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6200/0x89871fc3aba18f45 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044205.747811:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+66:12490:x1870705565210624:12345-192.168.202.40@tcp:34:lhsmtool_posix.0 Request processed in 860us (1162us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044205.747821:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 233 00000100:00100000:3.0:1784044205.751799:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044205.751946:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565210880 00000100:00100000:0.0:1784044205.751957:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565210880 00000100:00100000:0.0:1784044205.752044:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 234 00000100:00100000:0.0:1784044205.752058:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+66:12490:x1870705565210880:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1784044205.752089:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784044205.752122:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6a00/0x89871fc3aba18f4c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcd3dffad52ca69c6 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044205.752314:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7c00/0x89871fc3aba18f53 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044205.752334:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7c00/0x89871fc3aba18f53 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044205.752349:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7c00/0x89871fc3aba18f53 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784044205.752364:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:0.0:1784044205.752503:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7c00/0x89871fc3aba18f53 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044205.752512:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7c00/0x89871fc3aba18f53 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044205.752751:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7c00/0x89871fc3aba18f53 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044205.752757:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38410b7c00 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:0.0:1784044205.752761:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7c00/0x89871fc3aba18f53 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044205.752768:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7c00/0x89871fc3aba18f53 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044205.752781:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9b397b61b500) 00010000:00010000:0.0:1784044205.752784:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1784044205.752788:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7c00/0x89871fc3aba18f53 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044205.752793:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7c00/0x89871fc3aba18f53 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044205.752848:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6a00/0x89871fc3aba18f4c lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca69c6 expref: 68 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044205.752856:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9b396f2a8900) 00010000:00010000:0.0:1784044205.752858:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1784044205.752861:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6a00/0x89871fc3aba18f4c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca69c6 expref: 68 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044205.752870:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b38410b6a00, rc 0) 00000100:00100000:0.0:1784044205.752951:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+67:12490:x1870705565210880:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 Request processed in 897us (1165us total) trans 4294967505 rc 301/301 00000100:00100000:0.0:1784044205.752966:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 234 00000100:00100000:2.0:1784044205.774605:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044205.774960:0:13808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565211008 00000100:00100000:3.0:1784044205.774976:0:13808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565211008 00000100:00100000:3.0:1784044205.775565:0:13808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 235 00000100:00100000:3.0:1784044205.775581:0:13808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a93fdf3c-d42f-420a-95ea-b0cbfe954363+67:12490:x1870705565211008:12345-192.168.202.40@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1784044205.775638:0:13808:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1784044205.775801:0:13808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a93fdf3c-d42f-420a-95ea-b0cbfe954363+67:12490:x1870705565211008:12345-192.168.202.40@tcp:53:lhsmtool_posix.0 Request processed in 224us (1213us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044205.775810:0:13808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 235 00000100:00100000:2.0:1784044205.792554:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044205.792856:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565211264 00000100:00100000:0.0:1784044205.792870:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565211264 00000100:00100000:0.0:1784044205.793026:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 236 00000100:00100000:0.0:1784044205.794283:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+67:12490:x1870705565211264:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1784044205.794318:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784044205.794322:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1784044205.794365:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799a00/0x89871fc3aba18ef1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca69aa expref: 67 pid: 9501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044205.794406:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9b3842777a00) 00010000:00010000:0.0:1784044205.794413:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784044205.794437:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7c00/0x89871fc3aba18f61 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcd3dffad52ca69cd expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1784044205.794968:0:6512:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x6:0x0], index 0: 0 00010000:00010000:0.0:1784044205.795129:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6200/0x89871fc3aba18f68 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044205.796391:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6200/0x89871fc3aba18f68 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044205.796412:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6200/0x89871fc3aba18f68 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044205.796531:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7c00/0x89871fc3aba18f61 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca69cd expref: 69 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044205.796581:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6200/0x89871fc3aba18f68 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca69cd expref: 68 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044205.796591:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9b39758c1c00) 00010000:00010000:0.0:1784044205.796594:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784044205.796599:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b38410b6200, rc 0) 00000100:00100000:0.0:1784044205.796703:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+68:12490:x1870705565211264:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 Request processed in 3665us (4161us total) trans 4294967506 rc 0/0 00000100:00100000:0.0:1784044205.796713:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 236 00000100:00100000:0.0:1784044205.807584:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044205.807709:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565211520 00000100:00100000:3.0:1784044205.807723:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565211520 00000100:00100000:3.0:1784044205.807843:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 237 00000100:00100000:3.0:1784044205.807856:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843e39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+68:12490:x1870705565211520:12345-192.168.202.40@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1784044205.808245:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784044205.808287:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6200/0x89871fc3aba18f68 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca69cd expref: 68 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044205.808314:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9b39758c1c00) 00010000:00010000:3.0:1784044205.808329:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784044205.808362:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166a400/0x89871fc3aba18f76 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044205.808543:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166a400/0x89871fc3aba18f76 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044205.808558:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166a400/0x89871fc3aba18f76 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044205.808580:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166bc00/0x89871fc3aba18f7d lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x7429cffc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044205.808588:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166bc00/0x89871fc3aba18f7d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x7429cffc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044205.808595:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166bc00/0x89871fc3aba18f7d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x7429cffc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044205.808659:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166a400/0x89871fc3aba18f76 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044205.808666:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166a400/0x89871fc3aba18f76 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044205.808674:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166a400/0x89871fc3aba18f76 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044205.808689:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b394166a400 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:3.0:1784044205.808695:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166a400/0x89871fc3aba18f76 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044205.808703:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166a400/0x89871fc3aba18f76 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044205.808713:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9b3842777a00) 00010000:00010000:3.0:1784044205.808716:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784044205.808720:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166a400/0x89871fc3aba18f76 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044205.808727:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166a400/0x89871fc3aba18f76 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044205.808741:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166bc00/0x89871fc3aba18f7d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x7429cffc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044205.808746:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166bc00/0x89871fc3aba18f7d lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x7429cffc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044205.808752:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166bc00/0x89871fc3aba18f7d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x7429cffc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044205.808757:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b394166bc00 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:3.0:1784044205.808760:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166bc00/0x89871fc3aba18f7d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x7429cffc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044205.808766:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166bc00/0x89871fc3aba18f7d lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x7429cffc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044205.808783:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x7429cffc (ffff9b397aa61400) 00010000:00010000:3.0:1784044205.808786:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784044205.808789:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166bc00/0x89871fc3aba18f7d lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x7429cffc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044205.808795:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166bc00/0x89871fc3aba18f7d lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x7429cffc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044205.809130:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843e39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+67:12490:x1870705565211520:12345-192.168.202.40@tcp:36:lhsmtool_posix.0 Request processed in 1274us (1558us total) trans 0 rc -2/-2 00000100:00100000:3.0:1784044205.809141:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 237 00000100:00100000:2.0:1784044205.812734:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044205.816088:0:9501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565211648 00000100:00100000:0.0:1784044205.816105:0:9501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565211648 00000100:00100000:1.0:1784044205.817782:0:9501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 238 00000100:00100000:1.0:1784044205.817799:0:9501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a93fdf3c-d42f-420a-95ea-b0cbfe954363+67:12490:x1870705565211648:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1784044205.817829:0:9501:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784044205.817869:0:9501:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fce00/0x89871fc3aba18f84 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcd3dffad52ca69d4 expref: -99 pid: 9501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044205.817929:0:9501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd800/0x89871fc3aba18f8b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044205.817945:0:9501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd800/0x89871fc3aba18f8b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044205.817958:0:9501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd800/0x89871fc3aba18f8b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044205.823368:0:9501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fce00/0x89871fc3aba18f84 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca69d4 expref: 69 pid: 9501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044205.823446:0:9501:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd800/0x89871fc3aba18f8b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca69d4 expref: 68 pid: 9501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044205.823458:0:9501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9b384361b700) 00010000:00010000:1.0:1784044205.823462:0:9501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1784044205.823467:0:9501:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b38426fd800, rc 0) 00000100:00100000:1.0:1784044205.823581:0:9501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a93fdf3c-d42f-420a-95ea-b0cbfe954363+68:12490:x1870705565211648:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 Request processed in 5783us (10856us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044205.823615:0:9501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 238 00000100:00100000:2.0:1784044205.833725:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044205.833870:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565211904 00000100:00100000:0.0:1784044205.833892:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565211904 00000100:00100000:0.0:1784044205.833974:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 239 00000100:00100000:0.0:1784044205.833986:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+68:12490:x1870705565211904:12345-192.168.202.40@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1784044205.835795:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7600/0x89871fc3aba18f92 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044205.835832:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7600/0x89871fc3aba18f92 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044205.835864:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7600/0x89871fc3aba18f92 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1784044205.836678:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].8, 88 off8800 00000004:00010000:0.0:1784044205.836768:0:6512:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000afcf65f8 reply state 0000000079ae22c5 transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7600/0x89871fc3aba18f92 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044205.836807:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7600/0x89871fc3aba18f92 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044205.836817:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9b384361b700) 00010000:00010000:0.0:1784044205.836821:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1784044205.836825:0:6512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1784044205.837104:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+70:12490:x1870705565211904:12345-192.168.202.40@tcp:36:lhsmtool_posix.0 Request processed in 3113us (3393us total) trans 4294967507 rc 0/0 00000100:00100000:0.0:1784044205.837116:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 239 00000100:00100000:0.0:1784044205.839704:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044205.839811:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565212032 00000100:00100000:3.0:1784044205.839825:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565212032 00000100:00100000:3.0:1784044205.839913:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 240 00000100:00100000:3.0:1784044205.839925:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843e3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+70:12490:x1870705565212032:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1784044205.839959:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784044205.839991:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166bc00/0x89871fc3aba18f99 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcd3dffad52ca69db expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044205.840086:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166bc00/0x89871fc3aba18f99 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca69db expref: 71 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044205.840105:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166bc00/0x89871fc3aba18f99 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca69db expref: 71 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044205.840128:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9b384361b700) 00010000:00010000:3.0:1784044205.840132:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1784044205.840155:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b394166bc00, rc 0) 00000100:00100000:3.0:1784044205.840639:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843e3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+71:12490:x1870705565212032:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 Request processed in 713us (948us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044205.840648:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 240 00000100:00100000:2.0:1784044205.858583:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1784044205.858701:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565212160 00000100:00100000:1.0:1784044205.858712:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565212160 00000100:00100000:1.0:1784044205.858793:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 72 00000100:00100000:1.0:1784044205.858803:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d4f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+9:2410:x1870705565212160:12345-192.168.202.40@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1784044205.859524:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d4f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+10:2410:x1870705565212160:12345-192.168.202.40@tcp:2:lhsmtool_posix.0 Request processed in 716us (955us total) trans 4294967320 rc 0/0 00000100:00100000:1.0:1784044205.859535:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 72 00000100:00080000:0.0:1784044205.863350:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784044205.875378:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1784044205.875587:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565212416 00000100:00100000:1.0:1784044205.875760:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565212416 00000100:00100000:1.0:1784044205.875991:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 60 00000100:00100000:1.0:1784044205.876004:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+71:12490:x1870705565212416:12345-192.168.202.40@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1784044205.876463:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+72:12490:x1870705565212416:12345-192.168.202.40@tcp:35:lhsmtool_posix.0 Request processed in 457us (1107us total) trans 4294967508 rc 0/0 00000100:00100000:1.0:1784044205.876474:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 60 00000100:00100000:1.0:1784044205.882779:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044205.883168:0:9501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565212672 00000100:00100000:2.0:1784044205.883368:0:9501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565212672 00000100:00100000:2.0:1784044205.883509:0:9501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 241 00000100:00100000:2.0:1784044205.883523:0:9501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a93fdf3c-d42f-420a-95ea-b0cbfe954363+72:12490:x1870705565212672:12345-192.168.202.40@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1784044205.883714:0:9501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a93fdf3c-d42f-420a-95ea-b0cbfe954363+72:12490:x1870705565212672:12345-192.168.202.40@tcp:57:lhsmtool_posix.0 Request processed in 194us (950us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044205.883721:0:9501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 241 00000100:00100000:2.0:1784044205.886819:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044205.887165:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565212800 00000100:00100000:0.0:1784044205.887231:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565212800 00000100:00100000:0.0:1784044205.887325:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 242 00000100:00100000:0.0:1784044205.887340:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+72:12490:x1870705565212800:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1784044205.887385:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784044205.887420:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6600/0x89871fc3aba18fa0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcd3dffad52ca69e2 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044205.887544:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6800/0x89871fc3aba18fa7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044205.887567:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6800/0x89871fc3aba18fa7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044205.887585:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6800/0x89871fc3aba18fa7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784044205.887679:0:6512:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1784044205.887734:0:6512:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6800/0x89871fc3aba18fa7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044205.887769:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6600/0x89871fc3aba18fa0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca69e2 expref: 74 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044205.887793:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6800/0x89871fc3aba18fa7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca69e2 expref: 73 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044205.887814:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9b384361b700) 00010000:00010000:0.0:1784044205.887818:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1784044205.887823:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b38410b6800, rc 0) 00000100:00100000:0.0:1784044205.888139:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+73:12490:x1870705565212800:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 Request processed in 800us (1348us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044205.888149:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 242 00000100:00100000:0.0:1784044205.892692:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044205.893072:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565212928 00000100:00100000:2.0:1784044205.893084:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565212928 00000100:00100000:2.0:1784044205.893165:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 73 00000100:00100000:2.0:1784044205.893198:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843e3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+10:2410:x1870705565212928:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1784044205.893223:0:8428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784044205.893251:0:8428:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000083da212d/0x89871fc3aba18fae lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcd3dffad52ca69e9 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784044205.893287:0:8428:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a565aad, blocks: 0x0 00010000:00010000:2.0:1784044205.893313:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=399s v=(0 0) 00010000:00010000:2.0:1784044205.893318:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784044205.893331:0:8428:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000083da212d/0x89871fc3aba18fae lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca69e9 expref: 11 pid: 8428 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044205.893353:0:8428:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000083da212d/0x89871fc3aba18fae lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca69e9 expref: 11 pid: 8428 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044205.893369:0:8428:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3843799e00, rc 0) 00000100:00100000:2.0:1784044205.893459:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843e3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+11:2410:x1870705565212928:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 Request processed in 283us (793us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044205.893468:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 73 00000100:00100000:3.0:1784044205.897312:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044205.897960:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565213184 00000100:00100000:0.0:1784044205.897973:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565213184 00000100:00100000:0.0:1784044205.898097:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 243 00000100:00100000:0.0:1784044205.898120:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+73:12490:x1870705565213184:12345-192.168.202.40@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1784044205.898308:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+73:12490:x1870705565213184:12345-192.168.202.40@tcp:57:lhsmtool_posix.0 Request processed in 202us (1011us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044205.898315:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 243 00000100:00100000:3.0:1784044205.902436:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044205.902615:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565213312 00000100:00100000:2.0:1784044205.902629:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565213312 00000100:00100000:2.0:1784044205.902729:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 74 00000100:00100000:2.0:1784044205.902742:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d83480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+11:12490:x1870705565213312:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1784044205.902770:0:8427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784044205.902805:0:8427:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b50d9c4e/0x89871fc3aba18fb5 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcd3dffad52ca69f0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044205.902857:0:8427:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000083da212d/0x89871fc3aba18fae lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca69e9 expref: 12 pid: 8428 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044205.902869:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784044205.902874:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784044205.903107:0:8427:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b50d9c4e/0x89871fc3aba18fb5 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca69f0 expref: 12 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044205.903161:0:8427:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000083da212d/0x89871fc3aba18fae lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca69e9 expref: 12 pid: 8428 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044205.903209:0:8427:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000083da212d/0x89871fc3aba18fae lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca69e9 expref: 12 pid: 8428 timeout: 499 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044205.903230:0:8427:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d4ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8427:1870705580999168:192.168.202.40@tcp:104: 00000100:00100000:2.0:1784044205.903367:0:8427:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b397b8d3600 going to sleep for 11 seconds 00000100:00100000:2.0:1784044205.906722:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044205.906879:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565213440 00000100:00100000:3.0:1784044205.906898:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565213440 00010000:00010000:3.0:1784044205.906957:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000083da212d/0x89871fc3aba18fae lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca69e9 expref: 13 pid: 8428 timeout: 499 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044205.907013:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 107 00000100:00100000:3.0:1784044205.907024:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b394986cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+13:2409:x1870705565213440:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784044205.907046:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784044205.907076:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000083da212d/0x89871fc3aba18fae lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca69e9 expref: 13 pid: 8428 timeout: 499 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044205.907093:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000083da212d/0x89871fc3aba18fae lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca69e9 expref: 13 pid: 8428 timeout: 499 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044205.907127:0:6497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784044205.907132:0:6497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784044205.907143:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b50d9c4e/0x89871fc3aba18fb5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca69f0 expref: 13 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044205.907157:0:6497:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b50d9c4e/0x89871fc3aba18fb5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca69f0 expref: 13 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044205.907270:0:6497:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000b50d9c4e/0x89871fc3aba18fb5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca69f0 expref: 13 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044205.907291:0:6497:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d81880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6497:1870705580999296:192.168.202.40@tcp:105: 00000100:00100000:3.0:1784044205.907389:0:6497:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3942f27900 going to sleep for 11 seconds 00010000:00010000:0.0:1784044205.907508:0:8427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000083da212d/0x89871fc3aba18fae lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca69e9 expref: 13 pid: 8428 timeout: 499 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044205.907527:0:8427:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d4ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8427:1870705580999168:192.168.202.40@tcp:104: 00010000:00010000:0.0:1784044205.907570:0:8427:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b50d9c4e/0x89871fc3aba18fb5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca69f0 expref: 12 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044205.907583:0:8427:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3843799400, rc 0) 00000100:00100000:0.0:1784044205.907618:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d83480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+12:12490:x1870705565213312:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 Request processed in 4879us (5198us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044205.907634:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 74 00000100:00100000:3.0:1784044205.912984:0:6497:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d81880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6497:1870705580999296:192.168.202.40@tcp:105: 00010000:00010000:3.0:1784044205.913020:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784044205.913452:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b394986cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+11:2409:x1870705565213440:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 6426us (6739us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044205.913467:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 107 00000100:00100000:0.0:1784044205.914064:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1784044205.914335:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565213568 00000100:00100000:1.0:1784044205.914348:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565213568 00002000:00100000:1.0:1784044205.914435:0:8433:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x6:0x0] (0->12) req@ffff9b3843e38700 x1870705565213568/t0(0) o4->a93fdf3c-d42f-420a-95ea-b0cbfe954363@192.168.202.40@tcp:356/0 lens 504/0 e 0 to 0 dl 1784044216 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1784044205.914448:0:8433:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b3843e38700 with x1870705565213568 ext(0->12) 00002000:00010000:1.0:1784044205.914456:0:8433:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b3843e38700 00000100:00100000:1.0:1784044205.914493:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 6 00000100:00100000:1.0:1784044205.914506:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843e38700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+11:2410:x1870705565213568:12345-192.168.202.40@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1784044205.916052:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843e38700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+13:2410:x1870705565213568:12345-192.168.202.40@tcp:4:lhsmtool_posix.0 Request processed in 1534us (1978us total) trans 4294967321 rc 0/0 00000100:00100000:1.0:1784044205.916070:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 6 00002000:00100000:1.0:1784044205.916083:0:8433:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x6:0x0] (0->12) req@ffff9b3843e38700 x1870705565213568/t4294967321(0) o4->a93fdf3c-d42f-420a-95ea-b0cbfe954363@192.168.202.40@tcp:356/0 lens 504/448 e 0 to 0 dl 1784044216 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1784044205.916095:0:8433:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b3843e38700 with x1870705565213568 ext(0->12) 00002000:00010000:1.0:1784044205.916103:0:8433:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b3843e38700 00000100:00100000:0.0:1784044205.921244:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044205.921746:0:9501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565213696 00000100:00100000:2.0:1784044205.921779:0:9501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565213696 00000100:00100000:2.0:1784044205.922120:0:9501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 244 00000100:00100000:2.0:1784044205.922135:0:9501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843e3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a93fdf3c-d42f-420a-95ea-b0cbfe954363+73:12490:x1870705565213696:12345-192.168.202.40@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1784044205.925223:0:6490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967508 is committed 00000004:00080000:1.0:1784044205.925269:0:6490:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 9 committed 00000004:00080000:1.0:1784044205.925320:0:6490:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000020:00080000:1.0:1784044205.925341:0:6490:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9b3975b85480 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:1.0:1784044205.925348:0:6490:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9b397b61f200 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9b3975b85a80 00000020:00080000:1.0:1784044205.925352:0:6490:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9b397b61f900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9b3844768400 00000004:00080000:1.0:1784044205.925394:0:6490:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 8 committed 00000020:00080000:1.0:1784044205.925430:0:6490:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9b397b8d3cc0 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:1.0:1784044205.925432:0:6490:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9b39742d1a00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9b397b8d3b40 00000020:00080000:1.0:1784044205.925435:0:6490:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9b39742d1700 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9b3951349800 00000020:00080000:1.0:1784044205.925461:0:6544:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:1.0:1784044205.925537:0:6544:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:3.0:1784044205.925670:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d81880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1870705580999424:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1784044205.925793:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1784044205.926036:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7a00/0x89871fc3aba18cba lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044205.926134:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7a00/0x89871fc3aba18cba lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044205.926143:0:3625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7a00/0x89871fc3aba18cba lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044205.926149:0:3625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38410b7a00 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:2.0:1784044205.926155:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7a00/0x89871fc3aba18cba lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044205.926165:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7a00/0x89871fc3aba18cba lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044205.926207:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9b384361bc00) 00010000:00010000:2.0:1784044205.926210:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784044205.926217:0:3625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7a00/0x89871fc3aba18cba lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044205.926223:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7a00/0x89871fc3aba18cba lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044205.926255:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798000/0x89871fc3aba18d62 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044205.926261:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798000/0x89871fc3aba18d62 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044205.926289:0:3625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798000/0x89871fc3aba18d62 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044205.926294:0:3625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3843798000 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:2.0:1784044205.926298:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798000/0x89871fc3aba18d62 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044205.926304:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798000/0x89871fc3aba18d62 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044205.926311:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9b397aa61700) 00010000:00010000:2.0:1784044205.926314:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784044205.926318:0:3625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798000/0x89871fc3aba18d62 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044205.926324:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798000/0x89871fc3aba18d62 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044205.926334:0:9501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843e3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a93fdf3c-d42f-420a-95ea-b0cbfe954363+26:12490:x1870705565213696:12345-192.168.202.40@tcp:44:lhsmtool_posix.0 Request processed in 4200us (5104us total) trans 0 rc 0/0 00010000:00010000:2.0:1784044205.926345:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799c00/0x89871fc3aba18de0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044205.926346:0:9501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 244 00010000:00010000:2.0:1784044205.926351:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799c00/0x89871fc3aba18de0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044205.926356:0:3625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799c00/0x89871fc3aba18de0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044205.926360:0:3625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3843799c00 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:2.0:1784044205.926363:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799c00/0x89871fc3aba18de0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044205.926392:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799c00/0x89871fc3aba18de0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044205.926401:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9b397b61ba00) 00010000:00010000:2.0:1784044205.926403:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784044205.926406:0:3625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799c00/0x89871fc3aba18de0 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044205.926412:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799c00/0x89871fc3aba18de0 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044205.926425:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166ac00/0x89871fc3aba18e03 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044205.926432:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166ac00/0x89871fc3aba18e03 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044205.926437:0:3625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166ac00/0x89871fc3aba18e03 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044205.926442:0:3625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b394166ac00 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:2.0:1784044205.926445:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166ac00/0x89871fc3aba18e03 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044205.926451:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166ac00/0x89871fc3aba18e03 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044205.926458:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9b397b61ba00) 00010000:00010000:2.0:1784044205.926461:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784044205.926463:0:3625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166ac00/0x89871fc3aba18e03 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044205.926475:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166ac00/0x89871fc3aba18e03 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044205.926496:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fca00/0x89871fc3aba18ed5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044205.926503:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fca00/0x89871fc3aba18ed5 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044205.926509:0:3625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fca00/0x89871fc3aba18ed5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044205.926515:0:3625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38426fca00 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:2.0:1784044205.926518:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fca00/0x89871fc3aba18ed5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044205.926524:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fca00/0x89871fc3aba18ed5 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044205.926532:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9b397b61b500) 00010000:00010000:2.0:1784044205.926535:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784044205.926537:0:3625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fca00/0x89871fc3aba18ed5 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044205.926543:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fca00/0x89871fc3aba18ed5 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044205.926555:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7600/0x89871fc3aba18f92 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044205.926563:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7600/0x89871fc3aba18f92 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044205.926574:0:3625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7600/0x89871fc3aba18f92 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044205.926579:0:3625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38410b7600 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:2.0:1784044205.926583:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7600/0x89871fc3aba18f92 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044205.926590:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7600/0x89871fc3aba18f92 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044205.926598:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9b384361b700) 00010000:00010000:2.0:1784044205.926601:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1784044205.926604:0:3625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7600/0x89871fc3aba18f92 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044205.926609:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7600/0x89871fc3aba18f92 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044205.926635:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580999424 00000100:00100000:2.0:1784044205.926645:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580999424 00000100:00100000:0.0:1784044205.927099:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843e3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1870705580999552:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1784044205.927159:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044205.927731:0:9822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705580999552 00000100:00100000:0.0:1784044205.927737:0:9822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705580999552 00000100:00100000:0.0:1784044205.927785:0:9822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1784044205.927796:0:9822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843e38380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3638:x1870705580999552:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1784044205.927843:0:9822:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:5 count 1 00000100:00100000:2.0:1784044205.929223:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1784044205.929241:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397ba9fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3641:x1870705580999424:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1784044205.929277:0:8428:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:5 count 1 00010000:00010000:2.0:1784044205.929314:0:8428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003dcd3296/0x89871fc3aba18fc3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044205.929343:0:8428:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d3f761c5/0x89871fc3aba18d70 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6948 expref: 12 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044205.929391:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x5:0x0].0x0 since=3s v=(0 0) 00010000:00010000:2.0:1784044205.929399:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1784044205.929404:0:8428:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003dcd3296/0x89871fc3aba18fc3 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044205.929999:0:8428:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d3f761c5/0x89871fc3aba18d70 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6948 expref: 12 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044205.930144:0:8428:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d3f761c5/0x89871fc3aba18d70 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6948 expref: 12 pid: 8428 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044205.930164:0:8428:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d4df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8428:1870705580999680:192.168.202.40@tcp:104: 00000100:00100000:2.0:1784044205.930423:0:8428:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b397b8d3900 going to sleep for 11 seconds 00002000:00010000:0.0:1784044205.930447:0:9822:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 9, mtime: 0x6a565aab, atime: 0x6a565aac, ctime: 0x6a565aab, blocks: 0x8 00010000:00010000:0.0:1784044205.930459:0:9822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f5a0ba8d/0x89871fc3aba18fbc lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044205.930472:0:9822:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=399s v=(0 0) 00010000:00010000:0.0:1784044205.930476:0:9822:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784044205.930484:0:9822:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f5a0ba8d/0x89871fc3aba18fbc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044205.930504:0:9822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f5a0ba8d/0x89871fc3aba18fbc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044205.930528:0:9822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f5a0ba8d/0x89871fc3aba18fbc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044205.930535:0:9822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f5a0ba8d/0x89871fc3aba18fbc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044205.930562:0:9822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784044205.930593:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784044205.930602:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f5a0ba8d/0x89871fc3aba18fbc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044205.930610:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38410b6a00 already unused, calling callback (ffffffffc0b56230) 00010000:00010000:2.0:1784044205.930615:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f5a0ba8d/0x89871fc3aba18fbc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044205.930625:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f5a0ba8d/0x89871fc3aba18fbc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044205.930660:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f5a0ba8d/0x89871fc3aba18fbc lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044205.930668:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f5a0ba8d/0x89871fc3aba18fbc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044205.930696:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784044205.930697:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784044205.930699:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784044205.930829:0:9822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843e38380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3638:x1870705580999552:12345-0@lo:6:osp-syn-1-0.0 Request processed in 3032us (3667us total) trans 4294967311 rc 0/0 00000100:00100000:0.0:1784044205.930840:0:9822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000004:00080000:2.0:1784044205.930863:0:3638:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b3843e3b100/2, rc 0, transno 4294967311 00000100:00100000:2.0:1784044205.930880:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843e3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1870705580999552:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1784044205.936785:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044205.938385:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044205.938429:0:8428:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d4df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8428:1870705580999680:192.168.202.40@tcp:104: 00010000:00010000:2.0:1784044205.938480:0:8428:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003dcd3296/0x89871fc3aba18fc3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044205.938566:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565213824 00000100:00100000:3.0:1784044205.938577:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565213824 00000100:00100000:3.0:1784044205.938650:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 77 00000100:00100000:3.0:1784044205.938661:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843e39c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+13:2410:x1870705565213824:12345-192.168.202.40@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1784044205.939214:0:13182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565213952 00000100:00100000:1.0:1784044205.939219:0:13182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565213952 00010000:00010000:1.0:1784044205.939256:0:13182:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d3f761c5/0x89871fc3aba18d70 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6948 expref: 14 pid: 8428 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044205.939306:0:13182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 108 00000100:00100000:1.0:1784044205.939328:0:13182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843caad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a93fdf3c-d42f-420a-95ea-b0cbfe954363+14:2409:x1870705565213952:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784044205.939354:0:13182:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784044205.939362:0:13182:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d3f761c5/0x89871fc3aba18d70 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6948 expref: 14 pid: 8428 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044205.939390:0:13182:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d3f761c5/0x89871fc3aba18d70 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6948 expref: 14 pid: 8428 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044205.939419:0:13182:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d3f761c5/0x89871fc3aba18d70 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6948 expref: 14 pid: 8428 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044205.939440:0:13182:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1784044205.939445:0:13182:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1784044205.939451:0:13182:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003dcd3296/0x89871fc3aba18fc3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044205.939462:0:13182:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003dcd3296/0x89871fc3aba18fc3 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044205.940405:0:13182:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784044205.940538:0:13182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843caad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a93fdf3c-d42f-420a-95ea-b0cbfe954363+13:2409:x1870705565213952:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 1205us (2166us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044205.940550:0:13182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 108 00010000:00010000:2.0:1784044205.942003:0:8428:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003dcd3296/0x89871fc3aba18fc3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044205.942132:0:8428:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003dcd3296/0x89871fc3aba18fc3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044205.942147:0:8428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003dcd3296/0x89871fc3aba18fc3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044205.942156:0:8428:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003dcd3296/0x89871fc3aba18fc3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044205.942324:0:8428:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1784044205.942697:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397ba9fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3641:x1870705580999424:12345-0@lo:6:osp-syn-0-0.0 Request processed in 13456us (16897us total) trans 4294967322 rc 0/0 00000100:00100000:2.0:1784044205.942711:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000004:00080000:2.0:1784044205.943253:0:3641:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b3843d81880/2, rc 0, transno 4294967322 00000100:00100000:2.0:1784044205.943274:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d81880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1870705580999424:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1784044205.943618:0:10330:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784044205.943630:0:10330:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003dcd3296/0x89871fc3aba18fc3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044205.943663:0:10330:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3843799000 already unused, calling callback (ffffffffc0b56230) 00010000:00010000:1.0:1784044205.943668:0:10330:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003dcd3296/0x89871fc3aba18fc3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044205.943681:0:10330:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003dcd3296/0x89871fc3aba18fc3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044205.943708:0:10330:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003dcd3296/0x89871fc3aba18fc3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044205.943717:0:10330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003dcd3296/0x89871fc3aba18fc3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044205.943747:0:10330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784044205.943749:0:10330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784044205.943751:0:10330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1784044205.945595:0:8421:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967321 is committed 00000001:00080000:3.0:1784044205.945629:0:8421:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967318 is committed 00000100:00100000:0.0:1784044205.946037:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843e39c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+7:2410:x1870705565213824:12345-192.168.202.40@tcp:16:lhsmtool_posix.0 Request processed in 7366us (9253us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044205.946051:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 77 00000100:00100000:0.0:1784044205.954322:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1784044205.955431:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565214208 00000100:00100000:1.0:1784044205.955450:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565214208 00000100:00100000:1.0:1784044205.955545:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 245 00000100:00100000:1.0:1784044205.955557:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843cab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+21:12490:x1870705565214208:12345-192.168.202.40@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1784044205.955641:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784044205.955681:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6800/0x89871fc3aba18fa7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca69e2 expref: 21 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044205.955709:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9b384361b700) 00010000:00010000:1.0:1784044205.955738:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784044205.955776:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd000/0x89871fc3aba18fca lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044205.955792:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd000/0x89871fc3aba18fca lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044205.955802:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd000/0x89871fc3aba18fca lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784044205.955984:0:6511:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000001f0ed33b reply state 000000004523b506 transno 4294967509 ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd000/0x89871fc3aba18fca lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044205.955997:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd000/0x89871fc3aba18fca lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044205.956001:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9b384361b700) 00010000:00010000:1.0:1784044205.956003:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784044205.956006:0:6511:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1784044205.956145:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843cab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+22:12490:x1870705565214208:12345-192.168.202.40@tcp:36:lhsmtool_posix.0 Request processed in 589us (1837us total) trans 4294967509 rc 0/0 00000100:00100000:1.0:1784044205.956154:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 245 00000100:00100000:2.0:1784044205.960522:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044205.960648:0:9822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565214336 00000100:00100000:0.0:1784044205.960662:0:9822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565214336 00000100:00100000:0.0:1784044205.960762:0:9822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 78 00000100:00100000:0.0:1784044205.960775:0:9822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a93fdf3c-d42f-420a-95ea-b0cbfe954363+7:2409:x1870705565214336:12345-192.168.202.40@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1784044205.961038:0:9822:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1784044205.961043:0:9822:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb mtime from disk: 0 -> 1784044204 00002000:00010000:0.0:1784044205.961046:0:9822:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb atime from disk: 0 -> 1784044204 00002000:00010000:0.0:1784044205.961048:0:9822:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb ctime from disk: 1784044205 -> 1784044204 00002000:00010000:0.0:1784044205.961051:0:9822:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:0.0:1784044205.961220:0:9822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a93fdf3c-d42f-420a-95ea-b0cbfe954363+8:2409:x1870705565214336:12345-192.168.202.40@tcp:2:lhsmtool_posix.0 Request processed in 447us (711us total) trans 4294967323 rc 0/0 00000100:00100000:0.0:1784044205.961230:0:9822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 78 00000100:00100000:0.0:1784044205.964642:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044205.964870:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565214592 00000100:00100000:3.0:1784044205.964893:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565214592 00000100:00100000:3.0:1784044205.964975:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 246 00000100:00100000:3.0:1784044205.965004:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843ca8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+22:12490:x1870705565214592:12345-192.168.202.40@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1784044205.965104:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166a400/0x89871fc3aba18fd1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044205.965139:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd800/0x89871fc3aba18f8b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca69d4 expref: 22 pid: 9501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044205.965153:0:6513:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166a400/0x89871fc3aba18fd1 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044205.965258:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd800/0x89871fc3aba18f8b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca69d4 expref: 22 pid: 9501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044205.965276:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd800/0x89871fc3aba18f8b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca69d4 expref: 22 pid: 9501 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044205.965295:0:6513:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d81500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6513:1870705580999808:192.168.202.40@tcp:104: 00000100:00100000:3.0:1784044205.965425:0:6513:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3942f27900 going to sleep for 11 seconds 00000100:00100000:3.0:1784044205.976858:0:6513:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d81500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6513:1870705580999808:192.168.202.40@tcp:104: 00010000:00010000:3.0:1784044205.976914:0:6513:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166a400/0x89871fc3aba18fd1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044205.977207:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1784044205.977263:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565214720 00000100:00100000:1.0:1784044205.977273:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565214720 00010000:00010000:1.0:1784044205.977682:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd800/0x89871fc3aba18f8b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca69d4 expref: 23 pid: 9501 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044205.977737:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 109 00000100:00100000:1.0:1784044205.977749:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+23:2409:x1870705565214720:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784044205.977771:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784044205.977990:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd800/0x89871fc3aba18f8b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca69d4 expref: 23 pid: 9501 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044205.978006:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd800/0x89871fc3aba18f8b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca69d4 expref: 23 pid: 9501 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044205.978218:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd800/0x89871fc3aba18f8b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca69d4 expref: 23 pid: 9501 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044205.978240:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9b384361b700) 00010000:00010000:1.0:1784044205.978246:0:6498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166a400/0x89871fc3aba18fd1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044205.978262:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166a400/0x89871fc3aba18fd1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044205.978273:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166a400/0x89871fc3aba18fd1 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044205.978427:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784044205.978516:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+22:2409:x1870705565214720:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 767us (1307us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044205.978527:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 109 00010000:00010000:3.0:1784044205.979277:0:6513:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166a400/0x89871fc3aba18fd1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044205.979287:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166a400/0x89871fc3aba18fd1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044205.979335:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166a400/0x89871fc3aba18fd1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044205.979367:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166a400/0x89871fc3aba18fd1 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044205.979384:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166a400/0x89871fc3aba18fd1 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044205.979392:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b394166a400 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:3.0:1784044205.979398:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166a400/0x89871fc3aba18fd1 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044205.979406:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166a400/0x89871fc3aba18fd1 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044205.979423:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9b384361b700) 00010000:00010000:3.0:1784044205.979425:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1784044205.979430:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166a400/0x89871fc3aba18fd1 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044205.979435:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166a400/0x89871fc3aba18fd1 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044205.979534:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843ca8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+21:12490:x1870705565214592:12345-192.168.202.40@tcp:55:lhsmtool_posix.0 Request processed in 14528us (14903us total) trans 0 rc -22/-22 00000100:00100000:3.0:1784044205.979543:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 246 00000100:00100000:2.0:1784044205.984385:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044205.984517:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565214848 00000100:00100000:0.0:1784044205.984532:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565214848 00000100:00100000:0.0:1784044205.984618:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 79 00000100:00100000:0.0:1784044205.984630:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d4f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+8:2410:x1870705565214848:12345-192.168.202.40@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1784044205.984700:0:8428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a21e3764/0x89871fc3aba18fd8 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044205.984726:0:8428:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b50d9c4e/0x89871fc3aba18fb5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca69f0 expref: 8 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044205.984734:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784044205.984738:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1784044205.984741:0:8428:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a21e3764/0x89871fc3aba18fd8 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044205.984779:0:8428:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b50d9c4e/0x89871fc3aba18fb5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca69f0 expref: 8 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044205.984794:0:8428:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b50d9c4e/0x89871fc3aba18fb5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca69f0 expref: 8 pid: 8427 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044205.985017:0:8428:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843cab480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8428:1870705580999936:192.168.202.40@tcp:104: 00000100:00100000:0.0:1784044205.985144:0:8428:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3975b85780 going to sleep for 11 seconds 00000100:00100000:0.0:1784044205.988921:0:8428:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843cab480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8428:1870705580999936:192.168.202.40@tcp:104: 00010000:00010000:0.0:1784044205.988966:0:8428:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a21e3764/0x89871fc3aba18fd8 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044205.992419:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044205.992942:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565214976 00000100:00100000:0.0:1784044205.992955:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565214976 00010000:00010000:0.0:1784044205.993020:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b50d9c4e/0x89871fc3aba18fb5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca69f0 expref: 9 pid: 8427 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044205.993081:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 110 00000100:00100000:0.0:1784044205.993096:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d4df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+9:2409:x1870705565214976:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784044205.993129:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784044205.993163:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b50d9c4e/0x89871fc3aba18fb5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca69f0 expref: 9 pid: 8427 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044205.993236:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b50d9c4e/0x89871fc3aba18fb5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca69f0 expref: 9 pid: 8427 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044205.993279:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b50d9c4e/0x89871fc3aba18fb5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca69f0 expref: 9 pid: 8427 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044205.993802:0:6496:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1784044205.993841:0:6496:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1784044205.993849:0:6496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a21e3764/0x89871fc3aba18fd8 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044205.993863:0:6496:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a21e3764/0x89871fc3aba18fd8 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044205.994611:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784044205.994724:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d4df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+8:2409:x1870705565214976:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 1621us (2313us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044205.994740:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 110 00010000:00010000:2.0:1784044205.996580:0:8428:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a21e3764/0x89871fc3aba18fd8 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044205.996606:0:8428:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a21e3764/0x89871fc3aba18fd8 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044205.996655:0:8428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a21e3764/0x89871fc3aba18fd8 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044205.996677:0:8428:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a21e3764/0x89871fc3aba18fd8 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044205.996688:0:8428:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a21e3764/0x89871fc3aba18fd8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044205.996728:0:8428:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38410b7c00 already unused, calling callback (ffffffffc0b56230) 00010000:00010000:2.0:1784044205.996734:0:8428:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a21e3764/0x89871fc3aba18fd8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044205.996746:0:8428:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a21e3764/0x89871fc3aba18fd8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044205.996773:0:8428:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a21e3764/0x89871fc3aba18fd8 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044205.996782:0:8428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a21e3764/0x89871fc3aba18fd8 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044205.996934:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d4f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+7:2410:x1870705565214848:12345-192.168.202.40@tcp:1:lhsmtool_posix.0 Request processed in 12300us (12568us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044205.996945:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 79 00000100:00100000:2.0:1784044206.002640:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044206.003015:0:9501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565215232 00000100:00100000:3.0:1784044206.003031:0:9501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565215232 00000100:00100000:3.0:1784044206.003221:0:9501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 247 00000100:00100000:3.0:1784044206.003234:0:9501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a93fdf3c-d42f-420a-95ea-b0cbfe954363+21:12490:x1870705565215232:12345-192.168.202.40@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1784044206.003353:0:9501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166a400/0x89871fc3aba18fdf lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044206.003403:0:9501:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7000/0x89871fc3aba18ece lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca699c expref: 21 pid: 9501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044206.003416:0:9501:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166a400/0x89871fc3aba18fdf lrc: 4/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044206.003467:0:9501:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7000/0x89871fc3aba18ece lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca699c expref: 21 pid: 9501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044206.003484:0:9501:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7000/0x89871fc3aba18ece lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca699c expref: 21 pid: 9501 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044206.003503:0:9501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d81500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9501:1870705581000064:192.168.202.40@tcp:104: 00000100:00100000:3.0:1784044206.003611:0:9501:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3942f27900 going to sleep for 11 seconds 00000100:00100000:3.0:1784044206.008045:0:9501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d81500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9501:1870705581000064:192.168.202.40@tcp:104: 00010000:00010000:3.0:1784044206.008088:0:9501:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166a400/0x89871fc3aba18fdf lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044206.008529:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044206.009103:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565215360 00000100:00100000:0.0:1784044206.009169:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565215360 00010000:00010000:0.0:1784044206.009258:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7000/0x89871fc3aba18ece lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca699c expref: 22 pid: 9501 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044206.009350:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 111 00000100:00100000:0.0:1784044206.009363:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+22:2410:x1870705565215360:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784044206.009398:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784044206.009408:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7000/0x89871fc3aba18ece lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca699c expref: 22 pid: 9501 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044206.009422:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7000/0x89871fc3aba18ece lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca699c expref: 22 pid: 9501 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044206.009455:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7000/0x89871fc3aba18ece lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca699c expref: 22 pid: 9501 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044206.009508:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9b397b61b500) 00010000:00010000:0.0:1784044206.009515:0:6497:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6c00/0x89871fc3aba18f30 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca69bf expref: 21 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044206.009528:0:6497:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166a400/0x89871fc3aba18fdf lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044206.009537:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166a400/0x89871fc3aba18fdf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044206.009548:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166a400/0x89871fc3aba18fdf lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044206.009593:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784044206.009703:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+21:2410:x1870705565215360:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 341us (1175us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044206.009712:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 111 00010000:00010000:2.0:1784044206.009788:0:9501:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166a400/0x89871fc3aba18fdf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044206.009798:0:9501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166a400/0x89871fc3aba18fdf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044206.010058:0:9501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799a00/0x89871fc3aba18fe6 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044206.010071:0:9501:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166bc00/0x89871fc3aba18f99 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca69db expref: 21 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044206.010090:0:9501:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799a00/0x89871fc3aba18fe6 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044206.010143:0:9501:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166bc00/0x89871fc3aba18f99 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca69db expref: 21 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044206.010156:0:9501:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166bc00/0x89871fc3aba18f99 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca69db expref: 21 pid: 6513 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044206.010169:0:9501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d4c380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9501:1870705581000192:192.168.202.40@tcp:104: 00000100:00100000:2.0:1784044206.010258:0:9501:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b397b8d3900 going to sleep for 11 seconds 00000100:00100000:1.0:1784044206.014723:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044206.014870:0:13182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565215488 00000100:00100000:3.0:1784044206.014883:0:13182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565215488 00010000:00010000:3.0:1784044206.014940:0:13182:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166bc00/0x89871fc3aba18f99 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca69db expref: 22 pid: 6513 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044206.014995:0:13182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 112 00000100:00100000:3.0:1784044206.015006:0:13182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d2c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a93fdf3c-d42f-420a-95ea-b0cbfe954363+22:2410:x1870705565215488:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784044206.015027:0:13182:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784044206.015057:0:13182:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166bc00/0x89871fc3aba18f99 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca69db expref: 22 pid: 6513 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044206.015073:0:13182:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166bc00/0x89871fc3aba18f99 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca69db expref: 22 pid: 6513 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044206.015105:0:13182:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9b384361b700) 00010000:00010000:3.0:1784044206.015111:0:13182:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799a00/0x89871fc3aba18fe6 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044206.015123:0:13182:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799a00/0x89871fc3aba18fe6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044206.015132:0:13182:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799a00/0x89871fc3aba18fe6 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044206.015351:0:13182:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784044206.015427:0:13182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d2c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a93fdf3c-d42f-420a-95ea-b0cbfe954363+22:2410:x1870705565215488:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 422us (769us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044206.015439:0:13182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 112 00010000:00010000:2.0:1784044206.015584:0:9501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166bc00/0x89871fc3aba18f99 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca69db expref: 21 pid: 6513 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044206.015603:0:9501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d4c380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9501:1870705581000192:192.168.202.40@tcp:104: 00010000:00010000:2.0:1784044206.015626:0:9501:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799a00/0x89871fc3aba18fe6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044206.015634:0:9501:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799a00/0x89871fc3aba18fe6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044206.015639:0:9501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799a00/0x89871fc3aba18fe6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1784044206.015788:0:9501:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000001:00080000:2.0:1784044206.015932:0:9501:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000001:00080000:2.0:1784044206.015979:0:9501:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967512 00000100:00100000:2.0:1784044206.016085:0:9501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d4c380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9501:1870705581000320:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1784044206.016152:0:9501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044206.016224:0:9501:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b397b8d3c00 going to sleep for 11 seconds 00000100:00100000:2.0:1784044206.019027:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581000320 00000100:00100000:2.0:1784044206.019050:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581000320 00000100:00100000:2.0:1784044206.019396:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:2.0:1784044206.019413:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:9501:x1870705581000320:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1784044206.019615:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:9501:x1870705581000320:12345-0@lo:1000:mdt00_003.0 Request processed in 206us (3460us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044206.019624:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:1.0:1784044206.019866:0:9501:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967318 gen 2 00000004:00080000:1.0:1784044206.019875:0:9501:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967318 committed transno 4294967318 00000100:00100000:1.0:1784044206.019937:0:9501:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff9b3843d81880 x1870705580999424/t4294967322(4294967322) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1784044221 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784044206.019955:0:9501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d4c380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9501:1870705581000320:0@lo:1000:mdt00_003.0 00000001:00080000:1.0:1784044206.020762:0:9501:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00000100:00100000:1.0:1784044206.020897:0:9501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d2dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9501:1870705581000448:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1784044206.020975:0:9501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044206.021027:0:9501:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b397b8d3600 going to sleep for 11 seconds 00000100:00100000:2.0:1784044206.021085:0:7768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581000448 00000100:00100000:2.0:1784044206.021091:0:7768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581000448 00000100:00100000:2.0:1784044206.021559:0:7768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:2.0:1784044206.021573:0:7768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:9501:x1870705581000448:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1784044206.021782:0:7768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:9501:x1870705581000448:12345-0@lo:1000:mdt00_003.0 Request processed in 212us (804us total) trans 4294967324 rc 0/0 00000100:00100000:2.0:1784044206.021794:0:7768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:1.0:1784044206.021843:0:9501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d2dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9501:1870705581000448:0@lo:1000:mdt00_003.0 00010000:00010000:1.0:1784044206.021908:0:9501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799a00/0x89871fc3aba18fe6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044206.021922:0:9501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799a00/0x89871fc3aba18fe6 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044206.021931:0:9501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799a00/0x89871fc3aba18fe6 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044206.021939:0:9501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3843799a00 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:1.0:1784044206.021945:0:9501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799a00/0x89871fc3aba18fe6 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044206.021954:0:9501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799a00/0x89871fc3aba18fe6 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044206.021974:0:9501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9b384361b700) 00010000:00010000:1.0:1784044206.021977:0:9501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1784044206.021983:0:9501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799a00/0x89871fc3aba18fe6 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044206.021990:0:9501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843799a00/0x89871fc3aba18fe6 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044206.022023:0:9501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6000/0x89871fc3aba18f29 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044206.022030:0:9501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6000/0x89871fc3aba18f29 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044206.022035:0:9501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6000/0x89871fc3aba18f29 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044206.022052:0:9501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38410b6000 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:1.0:1784044206.022055:0:9501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6000/0x89871fc3aba18f29 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044206.022061:0:9501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6000/0x89871fc3aba18f29 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044206.022071:0:9501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9b397b61b500) 00010000:00010000:1.0:1784044206.022074:0:9501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1784044206.022082:0:9501:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6c00/0x89871fc3aba18f30 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca69bf expref: 24 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044206.022096:0:9501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6c00/0x89871fc3aba18f30 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca69bf expref: 24 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044206.022105:0:9501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6c00/0x89871fc3aba18f30 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca69bf expref: 24 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044206.022550:0:9501:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6c00/0x89871fc3aba18f30 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca69bf expref: 24 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044206.022567:0:9501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d2ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9501:1870705581000576:192.168.202.40@tcp:105: 00000100:00100000:1.0:1784044206.024031:0:9501:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b397b8d3600 going to sleep for 11 seconds 00000100:00100000:3.0:1784044206.026617:0:9501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d2ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9501:1870705581000576:192.168.202.40@tcp:105: 00010000:00010000:3.0:1784044206.026650:0:9501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6000/0x89871fc3aba18f29 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044206.026660:0:9501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6000/0x89871fc3aba18f29 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044206.026695:0:9501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166bc00/0x89871fc3aba18fed lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044206.026709:0:9501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166bc00/0x89871fc3aba18fed lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044206.026732:0:9501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166bc00/0x89871fc3aba18fed lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044206.026751:0:9501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166bc00/0x89871fc3aba18fed lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044206.026757:0:9501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166bc00/0x89871fc3aba18fed lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044206.026763:0:9501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166bc00/0x89871fc3aba18fed lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044206.026768:0:9501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b394166bc00 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:3.0:1784044206.026771:0:9501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166bc00/0x89871fc3aba18fed lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044206.026920:0:9501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166bc00/0x89871fc3aba18fed lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044206.026935:0:9501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9b397b61b500) 00010000:00010000:3.0:1784044206.026938:0:9501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784044206.026942:0:9501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166bc00/0x89871fc3aba18fed lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044206.026947:0:9501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166bc00/0x89871fc3aba18fed lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044206.026958:0:9501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166a400/0x89871fc3aba18fdf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044206.026964:0:9501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166a400/0x89871fc3aba18fdf lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044206.026974:0:9501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166a400/0x89871fc3aba18fdf lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044206.026979:0:9501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b394166a400 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:3.0:1784044206.026982:0:9501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166a400/0x89871fc3aba18fdf lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044206.026988:0:9501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166a400/0x89871fc3aba18fdf lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044206.026995:0:9501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9b397b61b500) 00010000:00010000:3.0:1784044206.026998:0:9501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1784044206.027001:0:9501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166a400/0x89871fc3aba18fdf lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044206.027006:0:9501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166a400/0x89871fc3aba18fdf lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9501 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044206.027228:0:9501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a93fdf3c-d42f-420a-95ea-b0cbfe954363+24:12490:x1870705565215232:12345-192.168.202.40@tcp:57:lhsmtool_posix.0 Request processed in 23995us (24602us total) trans 4294967514 rc 0/0 00000100:00100000:3.0:1784044206.027240:0:9501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 247 00000020:00080000:3.0:1784044206.027248:0:9501:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1784044206.027519:0:13763:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1784044206.027525:0:13763:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1784044206.028217:0:13763:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:1.0:1784044206.028228:0:13763:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1784044206.030084:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044206.030335:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565215616 00000100:00100000:0.0:1784044206.030354:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565215616 00000100:00100000:0.0:1784044206.030521:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 61 00000100:00100000:0.0:1784044206.030535:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+24:12489:x1870705565215616:12345-192.168.202.40@tcp:49:lfs.0 00000100:00100000:0.0:1784044206.030751:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+24:12489:x1870705565215616:12345-192.168.202.40@tcp:49:lfs.0 Request processed in 218us (674us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044206.030761:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 61 00000100:00100000:2.0:1784044206.034471:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1784044206.035468:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565215872 00000100:00100000:1.0:1784044206.035484:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565215872 00000100:00100000:1.0:1784044206.035616:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 62 00000100:00100000:1.0:1784044206.035630:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3974225850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+24:12490:x1870705565215872:12345-192.168.202.40@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1784044206.036007:0:6515:0:(mdd_object.c:4016:mdd_close()) Object [0x200000402:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1784044206.036052:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967515 00010000:00010000:1.0:1784044206.036096:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fda00/0x89871fc3aba18ff4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044206.036116:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fda00/0x89871fc3aba18ff4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044206.036130:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fda00/0x89871fc3aba18ff4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044206.036141:0:6515:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fda00/0x89871fc3aba18ff4 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044206.036148:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fda00/0x89871fc3aba18ff4 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044206.036154:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fda00/0x89871fc3aba18ff4 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044206.036212:0:6515:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1784044206.036335:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3974225850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+26:12490:x1870705565215872:12345-192.168.202.40@tcp:35:lhsmtool_posix.0 Request processed in 707us (1878us total) trans 4294967516 rc 0/0 00000100:00100000:1.0:1784044206.036344:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 62 00000020:00080000:1.0:1784044206.036350:0:6515:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1784044206.037243:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784044206.037254:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fda00/0x89871fc3aba18ff4 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044206.037265:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38426fda00 already unused, calling callback (ffffffffc0b56230) 00010000:00010000:3.0:1784044206.037270:0:6500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fda00/0x89871fc3aba18ff4 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044206.037313:0:6500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fda00/0x89871fc3aba18ff4 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044206.037332:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9b384361b700) 00010000:00010000:3.0:1784044206.037335:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1784044206.037341:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fda00/0x89871fc3aba18ff4 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044206.037347:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fda00/0x89871fc3aba18ff4 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044206.037365:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784044206.037367:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784044206.037380:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784044206.037780:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044206.037929:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565216128 00000100:00100000:3.0:1784044206.037938:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565216128 00000100:00100000:3.0:1784044206.038020:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 248 00000100:00100000:3.0:1784044206.038031:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+26:12489:x1870705565216128:12345-192.168.202.40@tcp:58:lfs.0 00000040:00080000:3.0:1784044206.038332:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:3.0:1784044206.038436:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+26:12489:x1870705565216128:12345-192.168.202.40@tcp:58:lfs.0 Request processed in 404us (659us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044206.038444:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 248 00000100:00100000:2.0:1784044206.081416:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044206.081567:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565216256 00000100:00100000:3.0:1784044206.081580:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565216256 00000100:00100000:3.0:1784044206.081721:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 249 00000100:00100000:3.0:1784044206.081735:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+26:12492:x1870705565216256:12345-192.168.202.40@tcp:101:lfs.0 00010000:00010000:3.0:1784044206.081769:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784044206.081798:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166a400/0x89871fc3aba18ffb lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcd3dffad52ca69f7 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044206.081905:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166bc00/0x89871fc3aba19002 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044206.081925:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166bc00/0x89871fc3aba19002 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044206.081939:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166bc00/0x89871fc3aba19002 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044206.081955:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166b600/0x89871fc3aba19009 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044206.081962:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166b600/0x89871fc3aba19009 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044206.081968:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166b600/0x89871fc3aba19009 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044206.082077:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166ac00/0x89871fc3aba19010 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044206.082090:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798400/0x89871fc3aba18f1b lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca69b8 expref: 27 pid: 13808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044206.082100:0:6513:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166ac00/0x89871fc3aba19010 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044206.083102:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798400/0x89871fc3aba18f1b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca69b8 expref: 27 pid: 13808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044206.083334:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798400/0x89871fc3aba18f1b lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca69b8 expref: 27 pid: 13808 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044206.083354:0:6513:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d4c380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6513:1870705581000704:192.168.202.40@tcp:104: 00000100:00100000:2.0:1784044206.083671:0:6513:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b38431503c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784044206.087346:0:6513:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d4c380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6513:1870705581000704:192.168.202.40@tcp:104: 00010000:00010000:0.0:1784044206.087405:0:6513:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166ac00/0x89871fc3aba19010 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044206.096647:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044206.097410:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565216512 00000100:00100000:0.0:1784044206.097427:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565216512 00000100:00100000:0.0:1784044206.097578:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 63 00000100:00100000:0.0:1784044206.097591:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+28:6177:x1870705565216512:12345-192.168.202.40@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1784044206.097961:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+29:6177:x1870705565216512:12345-192.168.202.40@tcp:35:ldlm_bl.0 Request processed in 372us (1328us total) trans 4294967517 rc 0/0 00000100:00100000:0.0:1784044206.097972:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 63 00000100:00100000:2.0:1784044206.101404:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044206.101594:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565216640 00000100:00100000:3.0:1784044206.101607:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565216640 00010000:00010000:3.0:1784044206.101667:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798400/0x89871fc3aba18f1b lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca69b8 expref: 29 pid: 13808 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044206.101757:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 113 00000100:00100000:3.0:1784044206.101769:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d4c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+29:2409:x1870705565216640:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784044206.101796:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784044206.101805:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798400/0x89871fc3aba18f1b lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca69b8 expref: 29 pid: 13808 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044206.101821:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798400/0x89871fc3aba18f1b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca69b8 expref: 29 pid: 13808 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044206.101866:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798400/0x89871fc3aba18f1b lrc: 0/0,0 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca69b8 expref: 29 pid: 13808 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044206.101892:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9b397b61b500) 00010000:00010000:3.0:1784044206.101901:0:6498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166ac00/0x89871fc3aba19010 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044206.101913:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166ac00/0x89871fc3aba19010 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044206.101923:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166ac00/0x89871fc3aba19010 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044206.101966:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784044206.102044:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d4c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+28:2409:x1870705565216640:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 276us (658us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044206.102053:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 113 00010000:00010000:3.0:1784044206.102087:0:6513:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166ac00/0x89871fc3aba19010 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044206.102103:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166ac00/0x89871fc3aba19010 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784044206.102252:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:3.0:1784044206.102258:0:6513:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1784044206.102285:0:6513:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166ac00/0x89871fc3aba19010 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044206.102301:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166ac00/0x89871fc3aba19010 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044206.102312:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166bc00/0x89871fc3aba19002 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044206.102319:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166bc00/0x89871fc3aba19002 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044206.102327:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166bc00/0x89871fc3aba19002 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044206.102334:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b394166bc00 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:3.0:1784044206.102339:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166bc00/0x89871fc3aba19002 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044206.102348:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166bc00/0x89871fc3aba19002 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044206.102358:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9b3842777a00) 00010000:00010000:3.0:1784044206.102361:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784044206.102366:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166bc00/0x89871fc3aba19002 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044206.102395:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166bc00/0x89871fc3aba19002 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044206.102412:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166b600/0x89871fc3aba19009 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044206.102418:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166b600/0x89871fc3aba19009 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044206.102424:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166b600/0x89871fc3aba19009 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044206.102430:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b394166b600 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:3.0:1784044206.102433:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166b600/0x89871fc3aba19009 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044206.102440:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166b600/0x89871fc3aba19009 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044206.102448:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9b397aa61600) 00010000:00010000:3.0:1784044206.102451:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784044206.102454:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166b600/0x89871fc3aba19009 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044206.102460:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166b600/0x89871fc3aba19009 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044206.102506:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166a400/0x89871fc3aba18ffb lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca69f7 expref: 28 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044206.102524:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166ac00/0x89871fc3aba19010 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca69f7 expref: 27 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044206.102538:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9b397b61b500) 00010000:00010000:3.0:1784044206.102541:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784044206.102544:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b394166ac00, rc 0) 00000100:00100000:3.0:1784044206.102575:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+27:12492:x1870705565216256:12345-192.168.202.40@tcp:101:lfs.0 Request processed in 20844us (21175us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044206.102582:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 249 00000100:00100000:2.0:1784044206.157498:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784044206.157534:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843e39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1870705581000832:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784044206.157632:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044206.157732:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581000832 00000100:00100000:2.0:1784044206.157742:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581000832 00000100:00100000:2.0:1784044206.157825:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1784044206.157837:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843e3b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3638:x1870705581000832:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1784044206.157876:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42380992 pending 28672 free 3923525632 avail 3692003328 00000100:00100000:2.0:1784044206.157932:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843e3b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3638:x1870705581000832:12345-0@lo:13:osp-pre-1-0.0 Request processed in 97us (300us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044206.157940:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00080000:2.0:1784044206.157966:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784044206.158011:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843e39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1870705581000832:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784044206.159490:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1870705581001344:0@lo:400:kworker.0 00000100:00100000:0.0:1784044206.159570:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044206.159621:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39759b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3639:1870705581001856:0@lo:400:kworker.0 00000100:00100000:0.0:1784044206.159652:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044206.159683:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39759b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1870705581002368:0@lo:400:kworker.0 00000100:00100000:0.0:1784044206.159712:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044206.159747:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1784044206.159755:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3639:1870705581001216:0@lo:400:kworker.0 00000100:00100000:0.0:1784044206.159794:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044206.159813:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1870705581001728:0@lo:400:kworker.0 00000100:00100000:0.0:1784044206.159833:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044206.159850:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39759b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3639:1870705581002240:0@lo:400:kworker.0 00000100:00100000:0.0:1784044206.159871:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044206.159902:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581002368 00000100:00100000:0.0:1784044206.159910:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581002368 00000100:00100000:0.0:1784044206.159968:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581001728 00000100:00100000:0.0:1784044206.159972:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581001728 00000100:00100000:0.0:1784044206.160016:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1784044206.160025:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843ca8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1870705581002368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784044206.160084:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843ca8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1870705581002368:12345-0@lo:400:kworker.0 Request processed in 60us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044206.160092:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1784044206.160446:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1784044206.160459:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843cabb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1870705581001728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044206.160504:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843cabb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1870705581001728:12345-0@lo:400:kworker.0 Request processed in 50us (669us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044206.160511:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1784044206.160545:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581001856 00000100:00100000:3.0:1784044206.160550:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581001856 00000100:00100000:3.0:1784044206.160587:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581001216 00000100:00100000:3.0:1784044206.160590:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581001216 00000100:00100000:3.0:1784044206.160606:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581002240 00000100:00100000:3.0:1784044206.160608:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581002240 00000100:00100000:3.0:1784044206.160623:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363 00000100:00100000:3.0:1784044206.160629:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843ca8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1870705581001856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044206.160660:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843ca8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1870705581001856:12345-0@lo:400:kworker.0 Request processed in 31us (1007us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044206.160667:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363 00000100:00100000:3.0:1784044206.160681:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 364 00000100:00100000:3.0:1784044206.160687:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843ca9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1870705581001216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044206.160715:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843ca9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1870705581001216:12345-0@lo:400:kworker.0 Request processed in 29us (920us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044206.160733:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 364 00000100:00100000:3.0:1784044206.160745:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 365 00000100:00100000:3.0:1784044206.160751:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843ca9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1870705581002240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044206.160781:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843ca9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1870705581002240:12345-0@lo:400:kworker.0 Request processed in 30us (908us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044206.160786:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 365 00000100:00100000:0.0:1784044206.160952:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3639:1870705581001216:0@lo:400:kworker.0 00000100:00100000:0.0:1784044206.160965:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1870705581001728:0@lo:400:kworker.0 00010000:00080000:0.0:1784044206.161870:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b39759b6300 x1870705581002240/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044222 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784044206.161886:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39759b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3639:1870705581002240:0@lo:400:kworker.0 00000100:00100000:0.0:1784044206.161904:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39759b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3639:1870705581001856:0@lo:400:kworker.0 00000100:00100000:0.0:1784044206.161918:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39759b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1870705581002368:0@lo:400:kworker.0 00000100:00100000:1.0:1784044206.162051:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581001344 00000100:00100000:1.0:1784044206.162059:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581001344 00000100:00100000:1.0:1784044206.162148:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:1.0:1784044206.162157:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843caa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1870705581001344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044206.162266:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843caa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1870705581001344:12345-0@lo:400:kworker.0 Request processed in 110us (2695us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044206.162273:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:2.0:1784044206.162924:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843cab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1870705581000960:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1784044206.162993:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044206.163168:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1870705581001344:0@lo:400:kworker.0 00000100:00100000:3.0:1784044206.163270:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:3641:1870705581001088:0@lo:400:kworker.0 00000100:00100000:3.0:1784044206.163326:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1784044206.163390:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1784044206.163397:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1784044206.163401:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784044206.163588:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581001088 00000100:00100000:0.0:1784044206.163595:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581001088 00000100:00100000:0.0:1784044206.163652:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 421 00000100:00100000:0.0:1784044206.163662:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3950372850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+24:3641:x1870705581001088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784044206.163723:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3950372850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+24:3641:x1870705581001088:12345-0@lo:400:kworker.0 Request processed in 62us (395us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044206.163731:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 421 00000100:00100000:1.0:1784044206.164214:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581000960 00000100:00100000:1.0:1784044206.164222:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581000960 00000100:00100000:1.0:1784044206.164269:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1784044206.164277:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843e39500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1870705581000960:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1784044206.164403:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1870705581001472:0@lo:400:kworker.0 00000100:00100000:2.0:1784044206.164447:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044206.164587:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581001472 00000100:00100000:3.0:1784044206.164592:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581001472 00000100:00100000:3.0:1784044206.164633:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 366 00000100:00100000:3.0:1784044206.164640:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843e39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1870705581001472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044206.164692:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843e39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1870705581001472:12345-0@lo:400:kworker.0 Request processed in 52us (243us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044206.164699:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 366 00000100:00100000:0.0:1784044206.164961:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:3641:1870705581001088:0@lo:400:kworker.0 00000100:00100000:0.0:1784044206.164971:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1870705581001600:0@lo:400:kworker.0 00000100:00100000:0.0:1784044206.165003:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044206.165033:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39759b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3641:1870705581002112:0@lo:400:kworker.0 00002000:00000024:1.0:1784044206.165280:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42380992 pending 28672 free 3923525632 avail 3692003328 00000100:00100000:1.0:1784044206.166465:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843e39500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1870705581000960:12345-0@lo:13:osp-pre-1-1.0 Request processed in 2181us (3464us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044206.166487:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1784044206.166711:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1870705581001472:0@lo:400:kworker.0 00000100:00100000:2.0:1784044206.166726:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39759b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1870705581001984:0@lo:400:kworker.0 00000100:00100000:2.0:1784044206.166774:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044206.166859:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843cab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1870705581000960:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1784044206.166893:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581001984 00000100:00100000:2.0:1784044206.166919:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581001984 00000100:00100000:2.0:1784044206.166987:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 367 00000100:00100000:2.0:1784044206.166996:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843e3bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1870705581001984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784044206.167047:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843e3bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1870705581001984:12345-0@lo:400:kworker.0 Request processed in 51us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044206.167054:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 367 00000100:00080000:2.0:1784044206.167074:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:2.0:1784044206.167097:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b39759b5180 x1870705581001984/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044222 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784044206.168241:0:7768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581001600 00000100:00100000:3.0:1784044206.168253:0:7768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581001600 00000100:00100000:3.0:1784044206.168327:0:7768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:3.0:1784044206.168337:0:7768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843caa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1870705581001600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044206.168432:0:7768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843caa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1870705581001600:12345-0@lo:400:kworker.0 Request processed in 97us (3427us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044206.168460:0:7768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:0.0:1784044206.168806:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044206.168884:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1870705581001600:0@lo:400:kworker.0 00000100:00100000:1.0:1784044206.169271:0:13808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581002112 00000100:00100000:1.0:1784044206.169278:0:13808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581002112 00000100:00100000:1.0:1784044206.169380:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 368 00000100:00100000:1.0:1784044206.169391:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843ca8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1870705581002112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044206.169455:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843ca8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1870705581002112:12345-0@lo:400:kworker.0 Request processed in 66us (650us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044206.169462:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 368 00000100:00100000:2.0:1784044206.170360:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39759b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1870705581001984:0@lo:400:kworker.0 00000100:00080000:0.0:1784044206.171320:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784044206.171412:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39759b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3641:1870705581002112:0@lo:400:kworker.0 00010000:00010000:0.0:1784044206.733530:0:10331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1784044207.022723:0:14763:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1784044207.022736:0:14763:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1784044207.022778:0:14763:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1784044207.022789:0:14763:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:0.0:1784044207.071958:0:13763:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1784044207.071974:0:13763:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1784044207.072008:0:13763:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1784044207.072023:0:13763:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1784044207.072444:0:13763:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843ca9f80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13763:1870705581002496:192.168.202.40@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1784044207.072612:0:13763:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3975ba9180 going to sleep for 11 seconds 00000100:00100000:2.0:1784044207.085074:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044207.085459:0:13763:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843ca9f80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13763:1870705581002496:192.168.202.40@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1784044207.085573:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565216768 00000100:00100000:2.0:1784044207.085582:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565216768 00000100:00080000:3.0:1784044207.085915:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784044207.086250:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 250 00000100:00100000:2.0:1784044207.086267:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38420ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+27:12504:x1870705565216768:12345-192.168.202.40@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1784044207.086599:0:6513:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1784044207.086768:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38420ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+27:12504:x1870705565216768:12345-192.168.202.40@tcp:53:lhsmtool_posix.0 Request processed in 505us (1706us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044207.086779:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 250 00000100:00100000:1.0:1784044207.090029:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044207.090644:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565217024 00000100:00100000:0.0:1784044207.090660:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565217024 00000100:00100000:0.0:1784044207.090779:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 251 00000100:00100000:0.0:1784044207.090793:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39759b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+27:12504:x1870705565217024:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1784044207.090886:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784044207.090918:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7000/0x89871fc3aba19017 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcd3dffad52ca69fe expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044207.091065:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6200/0x89871fc3aba1901e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044207.091083:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6200/0x89871fc3aba1901e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044207.091212:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6200/0x89871fc3aba1901e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784044207.091229:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:0.0:1784044207.091460:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7000/0x89871fc3aba19017 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca69fe expref: 30 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044207.091483:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6200/0x89871fc3aba1901e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca69fe expref: 29 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044207.091494:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9b397b61b500) 00010000:00010000:0.0:1784044207.091498:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784044207.091503:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b38410b6200, rc 0) 00000100:00100000:0.0:1784044207.091586:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39759b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+29:12504:x1870705565217024:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 Request processed in 796us (1567us total) trans 4294967518 rc 0/0 00000100:00100000:0.0:1784044207.091596:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 251 00000100:00100000:2.0:1784044207.111411:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044207.111532:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044207.112287:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565217280 00000100:00100000:3.0:1784044207.112302:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565217280 00000100:00100000:3.0:1784044207.112387:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 252 00000100:00100000:3.0:1784044207.112400:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38420a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+29:12504:x1870705565217280:12345-192.168.202.40@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1784044207.112512:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166a400/0x89871fc3aba1902c lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044207.112535:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166a400/0x89871fc3aba1902c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044207.112550:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166a400/0x89871fc3aba1902c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044207.113109:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166a400/0x89871fc3aba1902c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044207.113122:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166a400/0x89871fc3aba1902c lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044207.113131:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166a400/0x89871fc3aba1902c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044207.113139:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b394166a400 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:3.0:1784044207.113145:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166a400/0x89871fc3aba1902c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044207.113153:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166a400/0x89871fc3aba1902c lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044207.113212:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9b397b61b500) 00010000:00010000:3.0:1784044207.113216:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1784044207.113222:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166a400/0x89871fc3aba1902c lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044207.113229:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166a400/0x89871fc3aba1902c lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044207.113403:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38420a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+30:12504:x1870705565217280:12345-192.168.202.40@tcp:57:lhsmtool_posix.0 Request processed in 1002us (2001us total) trans 4294967519 rc 0/0 00000100:00100000:3.0:1784044207.113415:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 252 00000100:00100000:3.0:1784044207.113464:0:13182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565217408 00000100:00100000:3.0:1784044207.113471:0:13182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565217408 00000100:00100000:3.0:1784044207.113524:0:13182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 18 00000100:00100000:3.0:1784044207.113534:0:13182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b394986d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a93fdf3c-d42f-420a-95ea-b0cbfe954363+30:2408:x1870705565217408:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784044207.113551:0:13182:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784044207.113568:0:13182:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6200/0x89871fc3aba1901e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca69fe expref: 30 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044207.113582:0:13182:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9b397b61b500) 00010000:00010000:3.0:1784044207.113586:0:13182:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784044207.113607:0:13182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b394986d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a93fdf3c-d42f-420a-95ea-b0cbfe954363+29:2408:x1870705565217408:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 76us (2076us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044207.113614:0:13182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 18 00000040:00080000:3.0:1784044207.114314:0:13763:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1784044207.114324:0:13763:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1784044207.117123:0:13763:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1784044207.117164:0:13763:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1784044207.120950:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044207.121005:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565217664 00000100:00100000:0.0:1784044207.121016:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565217664 00000100:00100000:0.0:1784044207.121086:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 64 00000100:00100000:0.0:1784044207.121266:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843ca9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+29:12504:x1870705565217664:12345-192.168.202.40@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1784044207.121987:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843ca9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+30:12504:x1870705565217664:12345-192.168.202.40@tcp:35:lhsmtool_posix.0 Request processed in 885us (1048us total) trans 4294967520 rc 0/0 00000100:00100000:0.0:1784044207.121998:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 64 00000040:00080000:3.0:1784044207.568849:0:13804:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1784044207.761480:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784044208.781399:0:10330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784044208.870787:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044208.870833:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044208.870897:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044208.870927:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044208.870952:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044208.870974:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044208.871001:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044208.871056:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565217792 00000100:00100000:0.0:1784044208.871070:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565217792 00000100:00100000:0.0:1784044208.871162:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 422 00000100:00100000:0.0:1784044208.871212:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3950370450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4a09ad9-a185-4679-99bb-b6a07b865440+13:2409:x1870705565217792:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:1.0:1784044208.871399:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565218176 00000100:00100000:1.0:1784044208.871405:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565218176 00000100:00100000:1.0:1784044208.871457:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565218304 00000100:00100000:1.0:1784044208.871460:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565218304 00000100:00100000:1.0:1784044208.871492:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 140 00000100:00100000:1.0:1784044208.871500:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843ca8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+7:2409:x1870705565218176:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:1.0:1784044208.871599:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843ca8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+7:2409:x1870705565218176:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 99us (764us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044208.871609:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 140 00000100:00100000:1.0:1784044208.871632:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 141 00000100:00100000:1.0:1784044208.871639:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843caad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+7:2409:x1870705565218304:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:1.0:1784044208.871667:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843caad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+7:2409:x1870705565218304:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 29us (692us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044208.871674:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 141 00000100:00100000:1.0:1784044208.871697:0:13808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565217920 00000100:00100000:1.0:1784044208.871701:0:13808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565217920 00000100:00100000:1.0:1784044208.871732:0:13808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565218432 00000100:00100000:1.0:1784044208.871735:0:13808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565218432 00000100:00100000:1.0:1784044208.871749:0:13808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565218048 00000100:00100000:1.0:1784044208.871751:0:13808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565218048 00000100:00100000:1.0:1784044208.871765:0:13808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565218560 00000100:00100000:1.0:1784044208.871768:0:13808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565218560 00000100:00100000:1.0:1784044208.871785:0:13808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 369 00000100:00100000:1.0:1784044208.871792:0:13808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843ca9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a93fdf3c-d42f-420a-95ea-b0cbfe954363+30:2409:x1870705565217920:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:1.0:1784044208.871836:0:13808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843ca9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a93fdf3c-d42f-420a-95ea-b0cbfe954363+30:2409:x1870705565217920:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 44us (1076us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044208.871843:0:13808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 369 00000100:00100000:1.0:1784044208.871858:0:13808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 370 00000100:00100000:1.0:1784044208.871865:0:13808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843caaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:68dfcea6-5d83-4dbb-8fa3-e35542d621e5+5:2409:x1870705565218432:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:1.0:1784044208.871889:0:13808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843caaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:68dfcea6-5d83-4dbb-8fa3-e35542d621e5+5:2409:x1870705565218432:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 24us (992us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044208.871905:0:13808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 370 00000100:00100000:1.0:1784044208.871917:0:13808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 371 00000100:00100000:1.0:1784044208.871924:0:13808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843cab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a93fdf3c-d42f-420a-95ea-b0cbfe954363+5:2409:x1870705565218048:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:1.0:1784044208.871951:0:13808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843cab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a93fdf3c-d42f-420a-95ea-b0cbfe954363+5:2409:x1870705565218048:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 28us (999us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044208.871958:0:13808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 371 00000100:00100000:1.0:1784044208.871970:0:13808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 372 00000100:00100000:1.0:1784044208.871976:0:13808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843ca9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:68dfcea6-5d83-4dbb-8fa3-e35542d621e5+5:2409:x1870705565218560:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:1.0:1784044208.871999:0:13808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843ca9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:68dfcea6-5d83-4dbb-8fa3-e35542d621e5+5:2409:x1870705565218560:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 23us (997us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044208.872005:0:13808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 372 00000100:00080000:1.0:1784044208.872022:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1784044208.872026:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1784044208.872029:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784044208.872031:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784044208.872718:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3950370450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4a09ad9-a185-4679-99bb-b6a07b865440+13:2409:x1870705565217792:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 1540us (1784us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044208.872728:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 422 00000040:00080000:1.0:1784044209.161509:0:14814:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1784044209.161525:0:14814:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1784044209.161570:0:14814:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1784044209.161578:0:14814:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1784044209.231196:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1784044209.231227:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843cab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1870705581002624:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1784044209.231308:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044209.231391:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581002624 00000100:00100000:3.0:1784044209.231399:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581002624 00000100:00100000:3.0:1784044209.231447:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:3.0:1784044209.231456:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1870705581002624:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1784044209.231491:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:3.0:1784044209.231537:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1870705581002624:12345-0@lo:41:osp-pre-0-1.0 Request processed in 82us (229us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044209.231545:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:3.0:1784044209.231600:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843cab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1870705581002624:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1784044209.372583:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1784044209.372716:0:13808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565218816 00000100:00100000:1.0:1784044209.372727:0:13808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565218816 00000100:00100000:1.0:1784044209.372813:0:13808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 253 00000100:00100000:1.0:1784044209.372825:0:13808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843cab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a93fdf3c-d42f-420a-95ea-b0cbfe954363+30:12524:x1870705565218816:12345-192.168.202.40@tcp:101:lfs.0 00010000:00010000:1.0:1784044209.372845:0:13808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784044209.372867:0:13808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd600/0x89871fc3aba19033 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcd3dffad52ca6a05 expref: -99 pid: 13808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044209.373000:0:13808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fda00/0x89871fc3aba1903a lrc: 3/1,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044209.373014:0:13808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fda00/0x89871fc3aba1903a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044209.373026:0:13808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fda00/0x89871fc3aba1903a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13808 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784044209.373038:0:13808:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:1.0:1784044209.373822:0:13808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd600/0x89871fc3aba19033 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6a05 expref: 33 pid: 13808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044209.373840:0:13808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fda00/0x89871fc3aba1903a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6a05 expref: 32 pid: 13808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044209.373850:0:13808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9b397b61b500) 00010000:00010000:1.0:1784044209.373852:0:13808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1784044209.373855:0:13808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b38426fda00, rc 0) 00000100:00100000:1.0:1784044209.373914:0:13808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843cab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a93fdf3c-d42f-420a-95ea-b0cbfe954363+32:12524:x1870705565218816:12345-192.168.202.40@tcp:101:lfs.0 Request processed in 1092us (1340us total) trans 4294967521 rc 0/0 00000100:00100000:1.0:1784044209.373923:0:13808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 253 00000100:00080000:3.0:1784044209.374293:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784044209.381433:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044209.381694:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565218944 00000100:00100000:0.0:1784044209.381706:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565218944 00000100:00100000:0.0:1784044209.381776:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 254 00000100:00100000:0.0:1784044209.381787:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39759b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+32:12524:x1870705565218944:12345-192.168.202.40@tcp:54:lfs.0 00010000:00010000:0.0:1784044209.381857:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7000/0x89871fc3aba19048 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044209.381876:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7000/0x89871fc3aba19048 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044209.381889:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7000/0x89871fc3aba19048 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044209.381928:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7000/0x89871fc3aba19048 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044209.381952:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7000/0x89871fc3aba19048 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044209.381959:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7000/0x89871fc3aba19048 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044209.381965:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38410b7000 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:0.0:1784044209.381969:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7000/0x89871fc3aba19048 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044209.381977:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7000/0x89871fc3aba19048 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044209.382269:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9b397b61b500) 00010000:00010000:0.0:1784044209.382274:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1784044209.382559:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7000/0x89871fc3aba19048 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044209.382566:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7000/0x89871fc3aba19048 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044209.382664:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39759b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+32:12524:x1870705565218944:12345-192.168.202.40@tcp:54:lfs.0 Request processed in 878us (1239us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044209.382673:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 254 00000100:00100000:1.0:1784044209.511576:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044209.516071:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565219072 00000100:00100000:3.0:1784044209.516087:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565219072 00000100:00100000:2.0:1784044209.516526:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 80 00000100:00100000:2.0:1784044209.516539:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39759b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+7:2409:x1870705565219072:12345-192.168.202.40@tcp:101:cat.0 00010000:00010000:2.0:1784044209.516558:0:8426:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784044209.516579:0:8426:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002e0bf137/0x89871fc3aba1904f lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcd3dffad52ca6a0c expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784044209.516630:0:8426:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6:0x0] initial LVB size: 13, mtime: 0x6a565aac, atime: 0x6a565aac, ctime: 0x6a565aac, blocks: 0x8 00010000:00010000:2.0:1784044209.516652:0:8426:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=402s v=(0 0) 00010000:00010000:2.0:1784044209.516657:0:8426:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784044209.516667:0:8426:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002e0bf137/0x89871fc3aba1904f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6a0c expref: 8 pid: 8426 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044209.516687:0:8426:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002e0bf137/0x89871fc3aba1904f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6a0c expref: 8 pid: 8426 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044209.516703:0:8426:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3843799a00, rc 0) 00000100:00100000:2.0:1784044209.516788:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39759b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+8:2409:x1870705565219072:12345-192.168.202.40@tcp:101:cat.0 Request processed in 251us (5222us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044209.516795:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 80 00000100:00100000:1.0:1784044209.523489:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044209.523837:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565219200 00000100:00100000:0.0:1784044209.523848:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565219200 00002000:00100000:0.0:1784044209.523904:0:8431:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x6:0x0] (0->4095) req@ffff9b39759b4e00 x1870705565219200/t0(0) o3->a93fdf3c-d42f-420a-95ea-b0cbfe954363@192.168.202.40@tcp:360/0 lens 488/0 e 0 to 0 dl 1784044220 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784044209.523914:0:8431:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b39759b4e00 with x1870705565219200 ext(0->4095) 00002000:00010000:0.0:1784044209.523933:0:8431:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b39759b4e00 00000100:00100000:0.0:1784044209.523967:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 7 00000100:00100000:0.0:1784044209.523977:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39759b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+8:2410:x1870705565219200:12345-192.168.202.40@tcp:3:cat.0 00000100:00100000:0.0:1784044209.524155:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39759b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+8:2410:x1870705565219200:12345-192.168.202.40@tcp:3:cat.0 Request processed in 179us (676us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1784044209.524163:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 7 00002000:00100000:0.0:1784044209.524170:0:8431:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x6:0x0] (0->4095) req@ffff9b39759b4e00 x1870705565219200/t0(0) o3->a93fdf3c-d42f-420a-95ea-b0cbfe954363@192.168.202.40@tcp:360/0 lens 488/4536 e 0 to 0 dl 1784044220 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784044209.524215:0:8431:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b39759b4e00 with x1870705565219200 ext(0->4095) 00002000:00010000:0.0:1784044209.524219:0:8431:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b39759b4e00 00000001:00080000:2.0:1784044209.748310:0:9505:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967311 is committed 00000001:00080000:2.0:1784044209.748329:0:9505:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00010000:00010000:3.0:1784044209.805858:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784044210.253797:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000004:00080000:3.0:1784044210.253967:0:8450:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 403424790679ns, next at 404424787792ns, rc = 0 00000100:00100000:3.0:1784044210.253994:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d80380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1870705581002880:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784044210.254067:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044210.254221:0:10713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581002880 00000100:00100000:2.0:1784044210.254228:0:10713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581002880 00000100:00100000:2.0:1784044210.254290:0:10713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1784044210.254301:0:10713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d80a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3638:x1870705581002880:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1784044210.254364:0:10713:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1784044210.254414:0:10713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d80a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3638:x1870705581002880:12345-0@lo:13:osp-pre-0-0.0 Request processed in 115us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044210.254422:0:10713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00080000:3.0:1784044210.254503:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784044210.254551:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d80380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1870705581002880:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784044210.254837:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39759b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1870705581003008:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1784044210.254867:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044210.254989:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581003008 00000100:00100000:1.0:1784044210.254994:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581003008 00000100:00100000:1.0:1784044210.255030:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1784044210.255052:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d80380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1870705581003008:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1784044210.255064:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1784044210.255103:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d80380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1870705581003008:12345-0@lo:13:osp-pre-0-1.0 Request processed in 53us (236us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044210.255109:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1784044210.255434:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1870705581002752:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1784044210.255472:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1784044210.255615:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784044210.255647:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39759b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1870705581003008:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1784044210.256852:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581002752 00000100:00100000:1.0:1784044210.256863:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581002752 00000100:00100000:1.0:1784044210.256920:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:1.0:1784044210.256930:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1870705581002752:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1784044210.256963:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1784044210.257037:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1870705581002752:12345-0@lo:41:osp-pre-1-0.0 Request processed in 108us (1563us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044210.257044:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:0.0:1784044210.257832:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1870705581002752:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1784044210.829485:0:10331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784044211.279287:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39759b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1870705581003136:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784044211.279397:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044211.279505:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581003136 00000100:00100000:1.0:1784044211.279516:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581003136 00000100:00100000:1.0:1784044211.279593:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1784044211.279619:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39759b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1870705581003136:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1784044211.279666:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784044211.279688:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b38420a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:3641:1870705581003264:0@lo:400:kworker.0 00000100:00100000:1.0:1784044211.279716:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39759b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1870705581003136:12345-0@lo:13:osp-pre-1-0.0 Request processed in 114us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044211.279724:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1784044211.279748:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1784044211.279751:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784044211.279774:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b38420aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1870705581003776:0@lo:400:kworker.0 00000100:00100000:2.0:1784044211.279800:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044211.279834:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b38420a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3641:1870705581004288:0@lo:400:kworker.0 00000100:00100000:2.0:1784044211.279862:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044211.282363:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b38420a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1870705581003520:0@lo:400:kworker.0 00000100:00100000:0.0:1784044211.282456:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044211.282492:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b38420a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1870705581004032:0@lo:400:kworker.0 00000100:00100000:0.0:1784044211.282524:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044211.282550:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b38420aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3639:1870705581004544:0@lo:400:kworker.0 00000100:00100000:0.0:1784044211.282587:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b38420a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1870705581003392:0@lo:400:kworker.0 00000100:00100000:0.0:1784044211.282621:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b38420abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1870705581003648:0@lo:400:kworker.0 00000100:00100000:1.0:1784044211.283118:0:7768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581003776 00000100:00100000:1.0:1784044211.283134:0:7768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581003776 00000100:00100000:1.0:1784044211.283224:0:7768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581003520 00000100:00100000:1.0:1784044211.283240:0:7768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581003520 00000100:00100000:1.0:1784044211.283265:0:7768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:1.0:1784044211.283275:0:7768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38420a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1870705581003776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044211.283394:0:7768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38420a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1870705581003776:12345-0@lo:400:kworker.0 Request processed in 120us (3591us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044211.283404:0:7768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:1.0:1784044211.283429:0:7768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:1.0:1784044211.283435:0:7768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1870705581003520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044211.283479:0:7768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1870705581003520:12345-0@lo:400:kworker.0 Request processed in 44us (1023us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044211.283486:0:7768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:1.0:1784044211.283512:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581004032 00000100:00100000:1.0:1784044211.283516:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581004032 00000100:00100000:1.0:1784044211.283548:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1784044211.283555:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d2df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3639:x1870705581004032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044211.283590:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d2df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3639:x1870705581004032:12345-0@lo:400:kworker.0 Request processed in 36us (1066us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044211.283597:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1784044211.284243:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1870705581004800:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1784044211.284376:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044211.284417:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b38420a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3640:1870705581004160:0@lo:400:kworker.0 00000100:00100000:0.0:1784044211.284456:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044211.284476:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b38420a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1870705581004672:0@lo:400:kworker.0 00000100:00100000:0.0:1784044211.284513:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044211.284553:0:3640:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 2 00000004:00080000:0.0:1784044211.284560:0:3640:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967310 committed transno 4294967311 00000004:00080000:0.0:1784044211.284585:0:3640:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b3843e3b100, transno 4294967311 00000100:00100000:0.0:1784044211.284609:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39759b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1870705581003136:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784044211.284644:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581004288 00000100:00100000:0.0:1784044211.284649:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581004288 00000100:00100000:0.0:1784044211.284696:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581003648 00000100:00100000:0.0:1784044211.284700:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581003648 00000100:00100000:0.0:1784044211.284721:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581004160 00000100:00100000:0.0:1784044211.284724:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581004160 00000100:00100000:0.0:1784044211.284743:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 373 00000100:00100000:0.0:1784044211.284762:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38420aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1870705581004288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784044211.284806:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38420aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1870705581004288:12345-0@lo:400:kworker.0 Request processed in 56us (4942us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044211.284812:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 373 00000100:00100000:0.0:1784044211.284827:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 374 00000100:00100000:0.0:1784044211.284833:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1870705581003648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784044211.284865:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1870705581003648:12345-0@lo:400:kworker.0 Request processed in 32us (490us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044211.284871:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 374 00000100:00100000:0.0:1784044211.284882:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 375 00000100:00100000:0.0:1784044211.284888:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1870705581004160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784044211.284924:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1870705581004160:12345-0@lo:400:kworker.0 Request processed in 36us (467us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044211.284930:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 375 00000100:00080000:1.0:1784044211.285109:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1784044211.285114:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1784044211.285126:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044211.285201:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b38420a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1870705581003520:0@lo:400:kworker.0 00000100:00100000:1.0:1784044211.285217:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b38420a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1870705581004032:0@lo:400:kworker.0 00000100:00100000:0.0:1784044211.285230:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581004544 00000100:00100000:0.0:1784044211.285233:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581004544 00000100:00100000:0.0:1784044211.285399:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 376 00000100:00100000:0.0:1784044211.285407:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39759b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1870705581004544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784044211.285449:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39759b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1870705581004544:12345-0@lo:400:kworker.0 Request processed in 43us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044211.285456:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 376 00000100:00100000:0.0:1784044211.285499:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b38420abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1870705581003648:0@lo:400:kworker.0 00000100:00100000:0.0:1784044211.285512:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b38420a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3640:1870705581004160:0@lo:400:kworker.0 00000100:00080000:1.0:1784044211.285539:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1784044211.285564:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b38420aad80 x1870705581004544/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044227 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784044211.285590:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b38420aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3639:1870705581004544:0@lo:400:kworker.0 00000100:00100000:2.0:1784044211.285710:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044211.285772:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b38420aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1870705581003776:0@lo:400:kworker.0 00010000:00080000:2.0:1784044211.285786:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b38420a9c00 x1870705581004288/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044227 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784044211.285794:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b38420a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3641:1870705581004288:0@lo:400:kworker.0 00000100:00100000:2.0:1784044211.285844:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581003264 00000100:00100000:2.0:1784044211.285850:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581003264 00000100:00100000:2.0:1784044211.285893:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 423 00000100:00100000:2.0:1784044211.285900:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3950370850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+24:3641:x1870705581003264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784044211.285939:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3950370850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+24:3641:x1870705581003264:12345-0@lo:400:kworker.0 Request processed in 40us (6191us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044211.285945:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 423 00000100:00100000:2.0:1784044211.286602:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581004672 00000100:00100000:2.0:1784044211.286610:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581004672 00000100:00100000:2.0:1784044211.286660:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1784044211.286667:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1870705581004672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784044211.286724:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1870705581004672:12345-0@lo:400:kworker.0 Request processed in 58us (2210us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044211.290381:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b38420a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:3641:1870705581003264:0@lo:400:kworker.0 00000100:00100000:1.0:1784044211.290440:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044211.290508:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b38420a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1870705581003904:0@lo:400:kworker.0 00000100:00100000:1.0:1784044211.290585:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044211.291061:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b38420aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3638:1870705581004416:0@lo:400:kworker.0 00000100:00100000:1.0:1784044211.291102:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044211.291160:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581003392 00000100:00100000:1.0:1784044211.291168:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581003392 00000100:00100000:1.0:1784044211.291274:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581004416 00000100:00100000:1.0:1784044211.291278:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581004416 00000100:00100000:1.0:1784044211.291339:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 377 00000100:00100000:1.0:1784044211.291353:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39759b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1870705581003392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044211.291432:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39759b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1870705581003392:12345-0@lo:400:kworker.0 Request processed in 82us (990us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044211.291440:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 377 00000100:00100000:1.0:1784044211.291465:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 378 00000100:00100000:1.0:1784044211.291473:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39759b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1870705581004416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044211.291504:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39759b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1870705581004416:12345-0@lo:400:kworker.0 Request processed in 32us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044211.291510:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 378 00000100:00080000:1.0:1784044211.291536:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1784044211.291543:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784044211.291559:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581003904 00000100:00100000:1.0:1784044211.291563:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581003904 00000100:00100000:0.0:1784044211.291724:0:10713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581004800 00000100:00100000:0.0:1784044211.291731:0:10713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581004800 00000100:00100000:0.0:1784044211.291768:0:10713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1784044211.291776:0:10713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38420ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3641:x1870705581004800:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1784044211.291801:0:10713:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784044211.291853:0:10713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38420ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3641:x1870705581004800:12345-0@lo:13:osp-pre-1-1.0 Request processed in 79us (6143us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044211.291860:0:10713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1784044211.291909:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1870705581004800:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1784044211.292205:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1784044211.292250:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b38420a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1870705581004672:0@lo:400:kworker.0 00000100:00100000:0.0:1784044211.298384:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1784044211.298414:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39759b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1870705581003904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784044211.298564:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39759b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1870705581003904:12345-0@lo:400:kworker.0 Request processed in 166us (7977us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044211.298586:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1784044211.298828:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b38420a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1870705581003392:0@lo:400:kworker.0 00000100:00100000:3.0:1784044211.298845:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b38420a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1870705581003904:0@lo:400:kworker.0 00000100:00100000:3.0:1784044211.298858:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b38420aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3638:1870705581004416:0@lo:400:kworker.0 00000004:00080000:1.0:1784044211.303269:0:6490:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 10 committed 00000001:00080000:1.0:1784044211.303334:0:6490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967521 is committed 00000020:00080000:1.0:1784044211.303370:0:6490:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9b39741e1180 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:1.0:1784044211.303377:0:6490:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9b397b949800 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9b39741e19c0 00000020:00080000:1.0:1784044211.303381:0:6490:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9b397b949e00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9b397b606c00 00000020:00080000:1.0:1784044211.303427:0:6490:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00010000:00010000:1.0:1784044211.303453:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd000/0x89871fc3aba18fca lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044211.303466:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd000/0x89871fc3aba18fca lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044211.303474:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd000/0x89871fc3aba18fca lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044211.303482:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38426fd000 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:1.0:1784044211.303488:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd000/0x89871fc3aba18fca lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044211.303499:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd000/0x89871fc3aba18fca lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044211.303517:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1870705581004928:0@lo:2:osp-syn-0-0.0 00010000:00010000:1.0:1784044211.303521:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9b384361b700) 00010000:00010000:1.0:1784044211.303525:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784044211.303531:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd000/0x89871fc3aba18fca lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044211.303537:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd000/0x89871fc3aba18fca lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044211.303614:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:1.0:1784044211.304099:0:6544:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:1.0:1784044211.304274:0:6544:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000100:00100000:1.0:1784044211.304299:0:9822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581004928 00000100:00100000:1.0:1784044211.304311:0:9822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581004928 00000100:00100000:1.0:1784044211.304391:0:9822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1784044211.304403:0:9822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d82a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3638:x1870705581004928:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1784044211.304583:0:9822:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:1.0:1784044211.304587:0:9822:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb mtime from disk: 1784044204 -> 1784044204 00002000:00010000:1.0:1784044211.304590:0:9822:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb atime from disk: 1784044204 -> 1784044204 00002000:00010000:1.0:1784044211.304592:0:9822:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb ctime from disk: 1784044204 -> 1784044204 00002000:00010000:1.0:1784044211.304594:0:9822:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:1.0:1784044211.306449:0:9822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d82a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3638:x1870705581004928:12345-0@lo:2:osp-syn-0-0.0 Request processed in 2033us (2821us total) trans 4294967325 rc 0/0 00000100:00100000:1.0:1784044211.306468:0:9822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000004:00080000:2.0:1784044211.311779:0:3638:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b3843d82300/2, rc 0, transno 4294967325 00000100:00100000:2.0:1784044211.311803:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1870705581004928:0@lo:2:osp-syn-0-0.0 00000001:00080000:1.0:1784044211.315882:0:8421:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967325 is committed 00000001:00080000:1.0:1784044211.315910:0:8421:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967323 is committed 00010000:00010000:2.0:1784044211.858918:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784044212.877554:0:10330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784044213.901343:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784044214.000024:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1784044214.002098:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1784044214.002150:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1784044214.002188:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1784044214.002216:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1784044214.002233:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1784044214.002260:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1784044214.002325:0:13808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565219584 00000100:00100000:1.0:1784044214.002337:0:13808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565219584 00000100:00100000:1.0:1784044214.002433:0:13808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565220096 00000100:00100000:1.0:1784044214.002436:0:13808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565220096 00000100:00100000:1.0:1784044214.002455:0:13808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565219456 00000100:00100000:1.0:1784044214.002458:0:13808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565219456 00000100:00100000:1.0:1784044214.002504:0:13808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565219968 00000100:00100000:1.0:1784044214.002507:0:13808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565219968 00000100:00100000:1.0:1784044214.002528:0:13808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 379 00000100:00100000:1.0:1784044214.002542:0:13808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39759b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a93fdf3c-d42f-420a-95ea-b0cbfe954363+5:2408:x1870705565219584:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:0.0:1784044214.002925:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565219328 00000100:00100000:0.0:1784044214.002932:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565219328 00000100:00100000:0.0:1784044214.002976:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 424 00000100:00100000:0.0:1784044214.002985:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3950373850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4a09ad9-a185-4679-99bb-b6a07b865440+13:2408:x1870705565219328:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:2.0:1784044214.003105:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 380 00000100:00100000:2.0:1784044214.003118:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39759b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68dfcea6-5d83-4dbb-8fa3-e35542d621e5+5:2408:x1870705565220096:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:1.0:1784044214.003155:0:13808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39759b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a93fdf3c-d42f-420a-95ea-b0cbfe954363+5:2408:x1870705565219584:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 614us (1068us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044214.006681:0:13808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 379 00000100:00100000:1.0:1784044214.006743:0:13808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 381 00000100:00100000:1.0:1784044214.006763:0:13808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39759b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a93fdf3c-d42f-420a-95ea-b0cbfe954363+18:2408:x1870705565219456:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:0.0:1784044214.012366:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3950373850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4a09ad9-a185-4679-99bb-b6a07b865440+13:2408:x1870705565219328:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 9350us (12326us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044214.012393:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 424 00000100:00100000:0.0:1784044214.012517:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565219840 00000100:00100000:0.0:1784044214.012530:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565219840 00000100:00100000:0.0:1784044214.016194:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565219712 00000100:00100000:0.0:1784044214.016213:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565219712 00000100:00100000:0.0:1784044214.016293:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 145 00000100:00100000:0.0:1784044214.016318:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39759b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+5:2408:x1870705565219840:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:0.0:1784044214.016529:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39759b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+5:2408:x1870705565219840:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 214us (14377us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044214.016539:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 145 00000100:00100000:0.0:1784044214.016561:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 146 00000100:00100000:0.0:1784044214.016569:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39759b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+7:2408:x1870705565219712:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:0.0:1784044214.016617:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39759b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+7:2408:x1870705565219712:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 48us (14381us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044214.016624:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 146 00000100:00100000:0.0:1784044214.016798:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 382 00000100:00100000:0.0:1784044214.016810:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39759b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68dfcea6-5d83-4dbb-8fa3-e35542d621e5+5:2408:x1870705565219968:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:0.0:1784044214.016868:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39759b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68dfcea6-5d83-4dbb-8fa3-e35542d621e5+5:2408:x1870705565219968:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 61us (14607us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044214.016875:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 382 00000100:00080000:0.0:1784044214.016955:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1784044214.016960:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784044214.016963:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1784044214.016966:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1784044214.018032:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39759b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68dfcea6-5d83-4dbb-8fa3-e35542d621e5+5:2408:x1870705565220096:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 14907us (15848us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044214.018049:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 380 00000100:00100000:1.0:1784044214.030264:0:13808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39759b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a93fdf3c-d42f-420a-95ea-b0cbfe954363+18:2408:x1870705565219456:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 23489us (28024us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044214.030286:0:13808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 381 00000100:00100000:1.0:1784044214.350614:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1870705581005056:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1784044214.350721:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044214.350907:0:7768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581005056 00000100:00100000:2.0:1784044214.350920:0:7768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581005056 00000100:00100000:2.0:1784044214.351000:0:7768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:2.0:1784044214.351012:0:7768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39759b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1870705581005056:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1784044214.351062:0:7768:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:2.0:1784044214.351125:0:7768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39759b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1870705581005056:12345-0@lo:41:osp-pre-0-1.0 Request processed in 115us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044214.351133:0:7768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:0.0:1784044214.351682:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1870705581005056:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1784044214.925657:0:10331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1784044215.310712:0:13763:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1784044215.310728:0:13763:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1784044215.310859:0:13763:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 3 00000040:00080000:0.0:1784044215.310869:0:13763:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1784044215.373478:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1870705581005184:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1784044215.373588:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044215.373693:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581005184 00000100:00100000:3.0:1784044215.373704:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581005184 00000100:00100000:3.0:1784044215.373782:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1784044215.373796:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d81f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1870705581005184:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1784044215.373846:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1784044215.373907:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d81f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1870705581005184:12345-0@lo:13:osp-pre-0-1.0 Request processed in 113us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044215.373915:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1784044215.373996:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1870705581005184:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1784044215.374363:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784044215.374394:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1870705581005312:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784044215.374436:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044215.374478:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581005312 00000100:00100000:0.0:1784044215.374483:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581005312 00000100:00100000:0.0:1784044215.374522:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1784044215.374529:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d2c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1870705581005312:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1784044215.374543:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1784044215.374579:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d2c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1870705581005312:12345-0@lo:13:osp-pre-0-0.0 Request processed in 50us (143us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044215.374586:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00080000:0.0:1784044215.374600:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784044215.374618:0:3641:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 2 00000004:00080000:0.0:1784044215.374624:0:3641:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b3843d81880, transno 4294967322 00000004:00080000:0.0:1784044215.374658:0:3641:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967324 committed transno 4294967325 00000004:00080000:0.0:1784044215.374680:0:3641:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b3843d82300, transno 4294967325 00000100:00100000:0.0:1784044215.374691:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1870705581005312:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784044215.380085:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1870705581005440:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1784044215.380223:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044215.380432:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581005440 00000100:00100000:3.0:1784044215.380442:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581005440 00000100:00100000:3.0:1784044215.380507:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:3.0:1784044215.380517:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1870705581005440:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1784044215.380561:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1784044215.380642:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1870705581005440:12345-0@lo:41:osp-pre-1-0.0 Request processed in 126us (419us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044215.380651:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:3.0:1784044215.380716:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1870705581005440:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1784044215.949358:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784044216.044579:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044216.044664:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565220224 00000100:00100000:0.0:1784044216.044672:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565220224 00000100:00100000:0.0:1784044216.044739:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 255 00000100:00100000:0.0:1784044216.044748:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b384316d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+18:12169:x1870705565220224:12345-192.168.202.40@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1784044216.044858:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b384316d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+18:12169:x1870705565220224:12345-192.168.202.40@tcp:60:lhsmtool_posix.0 Request processed in 111us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044216.044866:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 255 00000100:00080000:2.0:1784044216.045012:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784044216.063435:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044216.063534:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565220352 00000100:00100000:0.0:1784044216.063543:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565220352 00000100:00100000:0.0:1784044216.063602:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 256 00000100:00100000:0.0:1784044216.063610:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38420a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+5:12169:x1870705565220352:12345-192.168.202.40@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1784044216.063709:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38420a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+5:12169:x1870705565220352:12345-192.168.202.40@tcp:60:lhsmtool_posix.0 Request processed in 101us (283us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044216.063715:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 256 00000100:00080000:2.0:1784044216.064191:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1784044216.066341:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044216.066468:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565220608 00000100:00100000:0.0:1784044216.066476:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565220608 00000100:00100000:0.0:1784044216.066525:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 65 00000100:00100000:0.0:1784044216.066533:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+18:12169:x1870705565220608:12345-192.168.202.40@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1784044216.066723:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+19:12169:x1870705565220608:12345-192.168.202.40@tcp:35:lhsmtool_posix.0 Request processed in 190us (388us total) trans 4294967522 rc 0/0 00000100:00100000:0.0:1784044216.066728:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 65 00000100:00100000:0.0:1784044216.397730:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b384316c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:3640:1870705581005696:0@lo:400:kworker.0 00000100:00100000:0.0:1784044216.397826:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044216.397893:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b384316f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1870705581006208:0@lo:400:kworker.0 00000100:00100000:0.0:1784044216.397921:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044216.397939:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b384316ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1870705581006720:0@lo:400:kworker.0 00000100:00100000:0.0:1784044216.397964:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044216.397980:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b384316fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1870705581007232:0@lo:400:kworker.0 00000100:00100000:0.0:1784044216.398003:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044216.398045:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1784044216.398052:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b384316df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1870705581005824:0@lo:400:kworker.0 00000100:00100000:0.0:1784044216.398074:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044216.398090:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b384316f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1870705581006336:0@lo:400:kworker.0 00000100:00100000:0.0:1784044216.398110:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044216.398125:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b384316d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3640:1870705581006848:0@lo:400:kworker.0 00000100:00100000:0.0:1784044216.398142:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044216.398191:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581007232 00000100:00100000:0.0:1784044216.398199:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581007232 00000100:00100000:0.0:1784044216.398251:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581006336 00000100:00100000:0.0:1784044216.398254:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581006336 00000100:00100000:0.0:1784044216.398287:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1784044216.398295:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843e38e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1870705581007232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784044216.398345:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843e38e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1870705581007232:12345-0@lo:400:kworker.0 Request processed in 51us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044216.398352:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1784044216.398369:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1784044216.398375:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3945933800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1870705581006336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784044216.398416:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3945933800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1870705581006336:12345-0@lo:400:kworker.0 Request processed in 41us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044216.398422:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00080000:0.0:1784044216.398449:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784044216.398460:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581006720 00000100:00100000:0.0:1784044216.398463:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581006720 00000100:00100000:0.0:1784044216.398494:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581005824 00000100:00100000:0.0:1784044216.398497:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581005824 00000100:00100000:0.0:1784044216.398509:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581006848 00000100:00100000:0.0:1784044216.398510:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581006848 00000100:00100000:0.0:1784044216.398524:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 383 00000100:00100000:0.0:1784044216.398528:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843e3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1870705581006720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784044216.398559:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843e3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1870705581006720:12345-0@lo:400:kworker.0 Request processed in 30us (593us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044216.398564:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 383 00000100:00100000:0.0:1784044216.398576:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 384 00000100:00100000:0.0:1784044216.398581:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3945931180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1870705581005824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784044216.398606:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3945931180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1870705581005824:12345-0@lo:400:kworker.0 Request processed in 25us (532us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044216.398611:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 384 00000100:00100000:0.0:1784044216.398623:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 385 00000100:00100000:0.0:1784044216.398628:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3945931880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1870705581006848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784044216.398652:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3945931880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1870705581006848:12345-0@lo:400:kworker.0 Request processed in 24us (509us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044216.398657:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 385 00000100:00080000:0.0:1784044216.398671:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1784044216.398673:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1784044216.398707:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b384316df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1870705581005824:0@lo:400:kworker.0 00000100:00100000:0.0:1784044216.398718:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b384316f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1870705581006336:0@lo:400:kworker.0 00000100:00100000:0.0:1784044216.398726:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b384316d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3640:1870705581006848:0@lo:400:kworker.0 00010000:00080000:0.0:1784044216.398738:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b384316ed80 x1870705581006720/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044232 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784044216.398748:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b384316ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1870705581006720:0@lo:400:kworker.0 00000100:00100000:0.0:1784044216.398756:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b384316fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1870705581007232:0@lo:400:kworker.0 00000100:00100000:1.0:1784044216.398926:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581005696 00000100:00100000:1.0:1784044216.398931:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581005696 00000100:00100000:1.0:1784044216.398967:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 425 00000100:00100000:1.0:1784044216.398974:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3950371050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+24:3640:x1870705581005696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044216.399027:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3950371050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+24:3640:x1870705581005696:12345-0@lo:400:kworker.0 Request processed in 54us (1201us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044216.399033:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 425 00000100:00100000:1.0:1784044216.399064:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581006208 00000100:00100000:1.0:1784044216.399068:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581006208 00000100:00100000:1.0:1784044216.399092:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:1.0:1784044216.399098:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1870705581006208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044216.399139:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1870705581006208:12345-0@lo:400:kworker.0 Request processed in 41us (1217us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044216.399145:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:1.0:1784044216.399219:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b384316c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:3640:1870705581005696:0@lo:400:kworker.0 00000100:00100000:1.0:1784044216.399229:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b384316f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1870705581006208:0@lo:400:kworker.0 00000100:00100000:3.0:1784044216.399367:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1870705581005568:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1784044216.399401:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044216.399432:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b384316e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3639:1870705581006080:0@lo:400:kworker.0 00000100:00100000:3.0:1784044216.399455:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044216.399474:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b384316ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3639:1870705581006592:0@lo:400:kworker.0 00000100:00100000:3.0:1784044216.399494:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044216.399511:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b384316f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1870705581007104:0@lo:400:kworker.0 00000100:00100000:3.0:1784044216.399529:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044216.399551:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1784044216.399558:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b384316ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1870705581005952:0@lo:400:kworker.0 00000100:00100000:3.0:1784044216.399577:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044216.399593:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b384316e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1870705581006464:0@lo:400:kworker.0 00000100:00100000:3.0:1784044216.399612:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044216.399629:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b384316dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3639:1870705581006976:0@lo:400:kworker.0 00000100:00100000:3.0:1784044216.399648:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044216.399677:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581005952 00000100:00100000:3.0:1784044216.399681:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581005952 00000100:00100000:3.0:1784044216.399705:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:3.0:1784044216.399711:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1870705581005952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044216.399747:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1870705581005952:12345-0@lo:400:kworker.0 Request processed in 35us (168us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044216.399760:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:3.0:1784044216.399781:0:9822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581007104 00000100:00100000:3.0:1784044216.399785:0:9822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581007104 00000100:00100000:3.0:1784044216.399813:0:9822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581006464 00000100:00100000:3.0:1784044216.399816:0:9822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581006464 00000100:00100000:3.0:1784044216.399831:0:9822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1784044216.399837:0:9822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d83800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3639:x1870705581007104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044216.399869:0:9822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d83800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3639:x1870705581007104:12345-0@lo:400:kworker.0 Request processed in 33us (339us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044216.399875:0:9822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1784044216.399886:0:9822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1784044216.399892:0:9822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d83100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3639:x1870705581006464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044216.399917:0:9822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d83100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3639:x1870705581006464:12345-0@lo:400:kworker.0 Request processed in 25us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044216.399922:0:9822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00080000:3.0:1784044216.399935:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784044216.399944:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581006080 00000100:00100000:3.0:1784044216.399947:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581006080 00000100:00100000:3.0:1784044216.399965:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581006592 00000100:00100000:3.0:1784044216.399968:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581006592 00000100:00100000:3.0:1784044216.399985:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581006976 00000100:00100000:3.0:1784044216.399988:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581006976 00000100:00100000:3.0:1784044216.400003:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 386 00000100:00100000:3.0:1784044216.400008:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1870705581006080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044216.400114:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1870705581006080:12345-0@lo:400:kworker.0 Request processed in 105us (657us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044216.400121:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 386 00000100:00100000:3.0:1784044216.400141:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 387 00000100:00100000:3.0:1784044216.400146:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1870705581006592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044216.400206:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1870705581006592:12345-0@lo:400:kworker.0 Request processed in 59us (710us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044216.400212:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 387 00000100:00100000:3.0:1784044216.400224:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 388 00000100:00100000:3.0:1784044216.400230:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1870705581006976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044216.400257:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1870705581006976:12345-0@lo:400:kworker.0 Request processed in 27us (608us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044216.400263:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 388 00000100:00080000:3.0:1784044216.400287:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1784044216.400290:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784044216.400315:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b384316ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1870705581005952:0@lo:400:kworker.0 00000100:00100000:3.0:1784044216.400325:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b384316e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1870705581006464:0@lo:400:kworker.0 00010000:00080000:3.0:1784044216.400336:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b384316dc00 x1870705581006976/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044232 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784044216.400344:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b384316dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3639:1870705581006976:0@lo:400:kworker.0 00000100:00100000:3.0:1784044216.400353:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b384316e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3639:1870705581006080:0@lo:400:kworker.0 00000100:00100000:3.0:1784044216.400361:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b384316ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3639:1870705581006592:0@lo:400:kworker.0 00000100:00100000:3.0:1784044216.400369:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b384316f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1870705581007104:0@lo:400:kworker.0 00000100:00100000:0.0:1784044216.400971:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b38420a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1870705581007360:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784044216.401090:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044216.401209:0:10713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581005568 00000100:00100000:1.0:1784044216.401215:0:10713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581005568 00000100:00100000:1.0:1784044216.401254:0:10713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581007360 00000100:00100000:1.0:1784044216.401257:0:10713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581007360 00000100:00100000:1.0:1784044216.401272:0:10713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1784044216.401288:0:10713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d82300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1870705581005568:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1784044216.401314:0:10713:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784044216.401363:0:10713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d82300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1870705581005568:12345-0@lo:13:osp-pre-1-1.0 Request processed in 76us (1961us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044216.401370:0:10713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1784044216.401385:0:10713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1784044216.401391:0:10713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3945933100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1870705581007360:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1784044216.401399:0:10713:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784044216.401423:0:10713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3945933100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1870705581007360:12345-0@lo:13:osp-pre-1-0.0 Request processed in 32us (407us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044216.401428:0:10713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1784044216.401478:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1870705581005568:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1784044216.401674:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b38420a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1870705581007360:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784044216.523638:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044216.524212:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565220736 00000100:00100000:0.0:1784044216.524224:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565220736 00000100:00100000:0.0:1784044216.524461:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 257 00000100:00100000:0.0:1784044216.524483:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68dfcea6-5d83-4dbb-8fa3-e35542d621e5+5:12981:x1870705565220736:12345-192.168.202.40@tcp:101:lsof.0 00010000:00010000:0.0:1784044216.524504:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784044216.524525:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6000/0x89871fc3aba19056 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcd3dffad52ca6a13 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044216.524590:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6200/0x89871fc3aba1905d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044216.524604:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6200/0x89871fc3aba1905d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044216.524616:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6200/0x89871fc3aba1905d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784044216.524682:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1784044216.524686:0:6512:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1784044216.524707:0:6512:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6200/0x89871fc3aba1905d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044216.524731:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6000/0x89871fc3aba19056 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6a13 expref: 7 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044216.524750:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6200/0x89871fc3aba1905d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6a13 expref: 6 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044216.524760:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b397b61bc00) 00010000:00010000:0.0:1784044216.524763:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1784044216.524767:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b38410b6200, rc 0) 00000100:00100000:0.0:1784044216.524834:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68dfcea6-5d83-4dbb-8fa3-e35542d621e5+6:12981:x1870705565220736:12345-192.168.202.40@tcp:101:lsof.0 Request processed in 354us (1205us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044216.524842:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 257 00000100:00080000:3.0:1784044216.525655:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:2.0:1784044216.913680:0:6490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967522 is committed 00000020:00080000:2.0:1784044216.913709:0:6490:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:1.0:1784044216.913808:0:6544:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:1.0:1784044216.913826:0:6544:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:1.0:1784044216.978680:0:10330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1784044217.806161:0:13804:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1784044217.997450:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784044219.023585:0:10331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784044219.112971:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044219.113066:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044219.113103:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044219.113136:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044219.113162:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1784044219.113165:0:13808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565221120 00000100:00100000:2.0:1784044219.113231:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044219.113298:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565221632 00000100:00100000:2.0:1784044219.113308:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565221632 00000100:00100000:1.0:1784044219.113377:0:13808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565221120 00000100:00100000:2.0:1784044219.113383:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565220992 00000100:00100000:2.0:1784044219.113386:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565220992 00000100:00100000:1.0:1784044219.113414:0:13808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 389 00000100:00100000:1.0:1784044219.113426:0:13808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38420a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:68dfcea6-5d83-4dbb-8fa3-e35542d621e5+5:2409:x1870705565221632:12345-192.168.202.40@tcp:400:kworker.0 00000100:00080000:3.0:1784044219.113451:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1784044219.113462:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1784044219.113474:0:9822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565221376 00000100:00100000:3.0:1784044219.113477:0:9822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565221376 00000100:00100000:3.0:1784044219.113511:0:9822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565221248 00000100:00100000:3.0:1784044219.113514:0:9822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565221248 00000100:00100000:1.0:1784044219.113525:0:13808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38420a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:68dfcea6-5d83-4dbb-8fa3-e35542d621e5+5:2409:x1870705565221632:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 101us (387us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044219.113533:0:13808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 389 00000100:00100000:3.0:1784044219.113535:0:9822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 151 00000100:00100000:3.0:1784044219.113541:0:9822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38420ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a93fdf3c-d42f-420a-95ea-b0cbfe954363+5:2409:x1870705565221376:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:1.0:1784044219.113552:0:13808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 390 00000100:00100000:1.0:1784044219.113558:0:13808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38420aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a93fdf3c-d42f-420a-95ea-b0cbfe954363+5:2409:x1870705565221120:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:3.0:1784044219.113571:0:9822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38420ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a93fdf3c-d42f-420a-95ea-b0cbfe954363+5:2409:x1870705565221376:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 31us (467us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044219.113578:0:9822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 151 00000100:00100000:1.0:1784044219.113578:0:13808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38420aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a93fdf3c-d42f-420a-95ea-b0cbfe954363+5:2409:x1870705565221120:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 20us (522us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044219.113584:0:13808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 390 00000100:00100000:3.0:1784044219.113590:0:9822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 152 00000100:00100000:1.0:1784044219.113595:0:13808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 391 00000100:00100000:3.0:1784044219.113596:0:9822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38420a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a93fdf3c-d42f-420a-95ea-b0cbfe954363+7:2409:x1870705565221248:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:1.0:1784044219.113600:0:13808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38420aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a93fdf3c-d42f-420a-95ea-b0cbfe954363+18:2409:x1870705565220992:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:3.0:1784044219.113619:0:9822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38420a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a93fdf3c-d42f-420a-95ea-b0cbfe954363+7:2409:x1870705565221248:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 24us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044219.113623:0:13808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38420aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a93fdf3c-d42f-420a-95ea-b0cbfe954363+18:2409:x1870705565220992:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 23us (461us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044219.113625:0:9822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 152 00000100:00100000:1.0:1784044219.113629:0:13808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 391 00000100:00100000:0.0:1784044219.113712:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565220864 00000100:00100000:0.0:1784044219.113717:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565220864 00000100:00080000:3.0:1784044219.113747:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784044219.113778:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 426 00000100:00100000:0.0:1784044219.113785:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3950373050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4a09ad9-a185-4679-99bb-b6a07b865440+13:2409:x1870705565220864:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:0.0:1784044219.113810:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3950373050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4a09ad9-a185-4679-99bb-b6a07b865440+13:2409:x1870705565220864:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 27us (858us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044219.113817:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 426 00000100:00080000:3.0:1784044219.114021:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784044219.114058:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044219.124864:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565221504 00000100:00100000:0.0:1784044219.124907:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565221504 00000100:00100000:0.0:1784044219.125013:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 392 00000100:00100000:0.0:1784044219.125027:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68dfcea6-5d83-4dbb-8fa3-e35542d621e5+6:2409:x1870705565221504:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:0.0:1784044219.129831:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68dfcea6-5d83-4dbb-8fa3-e35542d621e5+6:2409:x1870705565221504:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 4774us (15738us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044219.129852:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 392 00000100:00080000:0.0:1784044219.129937:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784044219.469490:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3945930380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1870705581007488:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1784044219.469592:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044219.470499:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581007488 00000100:00100000:0.0:1784044219.470511:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581007488 00000100:00100000:0.0:1784044219.470587:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:0.0:1784044219.470598:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38420a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1870705581007488:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1784044219.470650:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:0.0:1784044219.470733:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38420a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1870705581007488:12345-0@lo:41:osp-pre-0-1.0 Request processed in 137us (1142us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044219.470742:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:0.0:1784044219.470799:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3945930380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1870705581007488:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1784044220.049235:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784044220.493447:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784044220.493479:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3945930380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1870705581007616:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784044220.493480:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1870705581007744:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1784044220.493621:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784044220.493634:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b38420a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1870705581007872:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1784044220.493824:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044220.493948:0:10713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581007616 00000100:00100000:3.0:1784044220.493958:0:10713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581007616 00000100:00100000:3.0:1784044220.494060:0:10713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1784044220.494076:0:10713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3945933b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1870705581007616:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1784044220.494123:0:10713:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1784044220.494223:0:10713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3945933b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1870705581007616:12345-0@lo:13:osp-pre-0-0.0 Request processed in 151us (399us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044220.494233:0:10713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1784044220.494324:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3945930380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1870705581007616:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1784044220.494691:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784044220.494858:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044220.494959:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581007744 00000100:00100000:0.0:1784044220.494965:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581007744 00000100:00100000:0.0:1784044220.495015:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:0.0:1784044220.495023:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b384316f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1870705581007744:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1784044220.495069:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1784044220.495549:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b384316f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1870705581007744:12345-0@lo:41:osp-pre-1-0.0 Request processed in 525us (690us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044220.495569:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:2.0:1784044220.495692:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044220.495781:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581007872 00000100:00100000:0.0:1784044220.495786:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581007872 00000100:00100000:0.0:1784044220.495840:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1784044220.495848:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38420aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1870705581007872:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1784044220.495865:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1784044220.495903:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38420aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1870705581007872:12345-0@lo:13:osp-pre-0-1.0 Request processed in 57us (212us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044220.495910:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00080000:3.0:1784044220.495970:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784044220.496053:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b38420a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1870705581007872:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1784044220.496603:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1870705581007744:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1784044221.069432:0:10330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784044221.519458:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1784044221.519490:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b384316c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:3639:1870705581008000:0@lo:400:kworker.0 00000100:00100000:1.0:1784044221.519632:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044221.519758:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b384316c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3639:1870705581008128:0@lo:400:kworker.0 00000100:00100000:1.0:1784044221.519815:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044221.519886:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b384316ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1870705581008256:0@lo:400:kworker.0 00000100:00100000:1.0:1784044221.519920:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044221.519965:0:7768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581008256 00000100:00100000:1.0:1784044221.519975:0:7768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581008256 00000100:00100000:1.0:1784044221.520044:0:7768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:1.0:1784044221.520056:0:7768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b384316d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1870705581008256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044221.520130:0:7768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b384316d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1870705581008256:12345-0@lo:400:kworker.0 Request processed in 76us (208us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044221.520140:0:7768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:1.0:1784044221.520222:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b384316ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1870705581008256:0@lo:400:kworker.0 00000100:00100000:1.0:1784044221.520271:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784044221.520277:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b384316ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1870705581008384:0@lo:400:kworker.0 00000100:00100000:1.0:1784044221.520302:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044221.520343:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1784044221.520350:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b384316ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1870705581008512:0@lo:400:kworker.0 00000100:00100000:1.0:1784044221.520371:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044221.520412:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b384316dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1870705581008640:0@lo:400:kworker.0 00000100:00100000:1.0:1784044221.520438:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044221.520477:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b384316ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1870705581008768:0@lo:400:kworker.0 00000100:00100000:1.0:1784044221.520501:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044221.520538:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784044221.520543:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b384316ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3640:1870705581008896:0@lo:400:kworker.0 00000100:00100000:1.0:1784044221.520585:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044221.520619:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1784044221.520625:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b384316f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3639:1870705581009024:0@lo:400:kworker.0 00000100:00100000:1.0:1784044221.520651:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044221.520681:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581008128 00000100:00100000:1.0:1784044221.520686:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581008128 00000100:00100000:1.0:1784044221.520720:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581008384 00000100:00100000:1.0:1784044221.520724:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581008384 00000100:00100000:1.0:1784044221.520737:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581008896 00000100:00100000:1.0:1784044221.520739:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581008896 00000100:00100000:1.0:1784044221.520761:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581009024 00000100:00100000:1.0:1784044221.520764:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581009024 00000100:00100000:1.0:1784044221.520780:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 393 00000100:00100000:1.0:1784044221.520787:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b384316c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1870705581008128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044221.520824:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b384316c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1870705581008128:12345-0@lo:400:kworker.0 Request processed in 37us (1008us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044221.520830:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 393 00000100:00100000:1.0:1784044221.520863:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 394 00000100:00100000:1.0:1784044221.520869:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b384316f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1870705581008384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044221.520896:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b384316f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1870705581008384:12345-0@lo:400:kworker.0 Request processed in 27us (593us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044221.520902:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 394 00000100:00100000:1.0:1784044221.520914:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 395 00000100:00100000:1.0:1784044221.520919:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b384316d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1870705581008896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044221.520944:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b384316d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1870705581008896:12345-0@lo:400:kworker.0 Request processed in 25us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044221.520949:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 395 00000100:00100000:1.0:1784044221.520970:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 396 00000100:00100000:1.0:1784044221.520975:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b384316df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1870705581009024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044221.521004:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b384316df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1870705581009024:12345-0@lo:400:kworker.0 Request processed in 29us (353us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044221.521010:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 396 00000100:00100000:1.0:1784044221.521044:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b384316ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3640:1870705581008896:0@lo:400:kworker.0 00000100:00100000:1.0:1784044221.521055:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b384316ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1870705581008384:0@lo:400:kworker.0 00010000:00080000:1.0:1784044221.521084:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b384316f800 x1870705581009024/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044237 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784044221.521095:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b384316f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3639:1870705581009024:0@lo:400:kworker.0 00000100:00100000:1.0:1784044221.521105:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b384316c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3639:1870705581008128:0@lo:400:kworker.0 00000100:00100000:1.0:1784044221.521136:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b384316c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3639:1870705581009152:0@lo:400:kworker.0 00000100:00100000:1.0:1784044221.521158:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044221.521216:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581009152 00000100:00100000:1.0:1784044221.521220:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581009152 00000100:00100000:1.0:1784044221.521261:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 397 00000100:00100000:1.0:1784044221.521268:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b384316f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1870705581009152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044221.521300:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b384316f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1870705581009152:12345-0@lo:400:kworker.0 Request processed in 34us (140us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044221.521306:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 397 00000100:00100000:1.0:1784044221.521331:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b384316c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3639:1870705581009152:0@lo:400:kworker.0 00000100:00100000:1.0:1784044221.521361:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b384316c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3640:1870705581009280:0@lo:400:kworker.0 00000100:00100000:1.0:1784044221.521382:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044221.521412:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581009280 00000100:00100000:1.0:1784044221.521416:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581009280 00000100:00100000:1.0:1784044221.521439:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 398 00000100:00100000:1.0:1784044221.521444:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b384316ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1870705581009280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044221.521475:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b384316ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1870705581009280:12345-0@lo:400:kworker.0 Request processed in 31us (91us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044221.521481:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 398 00010000:00080000:1.0:1784044221.521507:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b384316c380 x1870705581009280/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044237 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784044221.521516:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b384316c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3640:1870705581009280:0@lo:400:kworker.0 00000100:00100000:1.0:1784044221.521544:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784044221.521550:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b384316c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1870705581009408:0@lo:400:kworker.0 00000100:00100000:1.0:1784044221.521574:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044221.521614:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1784044221.521621:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1870705581009536:0@lo:400:kworker.0 00000100:00100000:1.0:1784044221.521643:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044221.521710:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581008000 00000100:00100000:1.0:1784044221.521715:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581008000 00000100:00100000:1.0:1784044221.521748:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 427 00000100:00100000:1.0:1784044221.521754:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3950372050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+24:3639:x1870705581008000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044221.521791:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3950372050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+24:3639:x1870705581008000:12345-0@lo:400:kworker.0 Request processed in 38us (2160us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044221.521798:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 427 00000100:00100000:1.0:1784044221.521833:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b384316c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:3639:1870705581008000:0@lo:400:kworker.0 00000100:00100000:1.0:1784044221.521864:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581008512 00000100:00100000:1.0:1784044221.521868:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581008512 00000100:00100000:1.0:1784044221.521904:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:1.0:1784044221.521911:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b384316e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1870705581008512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044221.521949:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b384316e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1870705581008512:12345-0@lo:400:kworker.0 Request processed in 38us (1575us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044221.521955:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:1.0:1784044221.521991:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b384316ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1870705581008512:0@lo:400:kworker.0 00000100:00100000:3.0:1784044221.522335:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784044221.522348:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1870705581009664:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1784044221.522387:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044221.522435:0:9822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581008640 00000100:00100000:3.0:1784044221.522440:0:9822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581008640 00000100:00100000:3.0:1784044221.522465:0:9822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581008768 00000100:00100000:3.0:1784044221.522468:0:9822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581008768 00000100:00100000:3.0:1784044221.522479:0:9822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581009408 00000100:00100000:3.0:1784044221.522482:0:9822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581009408 00000100:00100000:3.0:1784044221.522496:0:9822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581009536 00000100:00100000:3.0:1784044221.522499:0:9822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581009536 00000100:00100000:3.0:1784044221.522515:0:9822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1784044221.522521:0:9822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b384316e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3639:x1870705581008640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044221.522555:0:9822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b384316e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3639:x1870705581008640:12345-0@lo:400:kworker.0 Request processed in 34us (2116us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044221.522561:0:9822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1784044221.522575:0:9822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1784044221.522581:0:9822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b384316fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3640:x1870705581008768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044221.522621:0:9822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b384316fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3640:x1870705581008768:12345-0@lo:400:kworker.0 Request processed in 40us (2118us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044221.522627:0:9822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1784044221.522637:0:9822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1784044221.522644:0:9822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b384316ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3640:x1870705581009408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044221.522670:0:9822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b384316ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3640:x1870705581009408:12345-0@lo:400:kworker.0 Request processed in 27us (1095us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044221.522675:0:9822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1784044221.522697:0:9822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1784044221.522703:0:9822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397a8a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3639:x1870705581009536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044221.522733:0:9822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397a8a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3639:x1870705581009536:12345-0@lo:400:kworker.0 Request processed in 30us (1089us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044221.522738:0:9822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00080000:3.0:1784044221.522764:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1784044221.522769:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1784044221.522772:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784044221.522808:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581009664 00000100:00100000:3.0:1784044221.522813:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581009664 00000100:00100000:3.0:1784044221.522840:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1784044221.522846:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843e0c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1870705581009664:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1784044221.522872:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784044221.522910:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843e0c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1870705581009664:12345-0@lo:13:osp-pre-1-1.0 Request processed in 64us (522us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044221.522917:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1784044221.522952:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1870705581009664:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1784044221.522977:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b384316c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1870705581009408:0@lo:400:kworker.0 00000100:00100000:3.0:1784044221.522989:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b384316ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1870705581008768:0@lo:400:kworker.0 00000100:00100000:3.0:1784044221.523017:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1870705581009536:0@lo:400:kworker.0 00000100:00100000:3.0:1784044221.523029:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b384316dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1870705581008640:0@lo:400:kworker.0 00000100:00100000:0.0:1784044221.539377:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784044221.539409:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3945930700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1870705581009792:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784044221.539507:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044221.539588:0:10713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581009792 00000100:00100000:0.0:1784044221.539598:0:10713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581009792 00000100:00100000:0.0:1784044221.539665:0:10713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1784044221.539676:0:10713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3945930e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1870705581009792:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1784044221.539705:0:10713:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784044221.539757:0:10713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3945930e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1870705581009792:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044221.539765:0:10713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1784044221.539834:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3945930700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1870705581009792:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1784044222.100787:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1784044222.104516:0:15012:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 11:50:19 (1784044219) 00010000:00010000:0.0:1784044223.117487:0:10331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784044224.141511:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784044224.230296:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044224.230341:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044224.230457:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044224.230480:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044224.230535:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565221760 00000100:00100000:0.0:1784044224.230546:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565221760 00000100:00100000:0.0:1784044224.230616:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 428 00000100:00100000:0.0:1784044224.230634:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3950373450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4a09ad9-a185-4679-99bb-b6a07b865440+13:2407:x1870705565221760:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:0.0:1784044224.230743:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3950373450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4a09ad9-a185-4679-99bb-b6a07b865440+13:2407:x1870705565221760:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 111us (459us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044224.230751:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 428 00000100:00100000:3.0:1784044224.240715:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1784044224.249159:0:9822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565222272 00000100:00100000:1.0:1784044224.249194:0:9822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565222272 00000100:00100000:1.0:1784044224.249311:0:9822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 157 00000100:00100000:1.0:1784044224.249324:0:9822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843e0f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a93fdf3c-d42f-420a-95ea-b0cbfe954363+5:2407:x1870705565222272:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:1.0:1784044224.249411:0:9822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843e0f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a93fdf3c-d42f-420a-95ea-b0cbfe954363+5:2407:x1870705565222272:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 91us (18953us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044224.249420:0:9822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 157 00000100:00100000:2.0:1784044224.251012:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565222016 00000100:00100000:2.0:1784044224.251024:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565222016 00000100:00100000:2.0:1784044224.251095:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565222528 00000100:00100000:2.0:1784044224.251099:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565222528 00000100:00100000:2.0:1784044224.251131:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 399 00000100:00100000:2.0:1784044224.251140:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843e0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+5:2407:x1870705565222016:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:2.0:1784044224.251230:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843e0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+5:2407:x1870705565222016:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 91us (20887us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044224.251238:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 399 00000100:00100000:2.0:1784044224.251255:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 400 00000100:00100000:2.0:1784044224.251262:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843e0fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68dfcea6-5d83-4dbb-8fa3-e35542d621e5+5:2407:x1870705565222528:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:2.0:1784044224.251317:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843e0fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68dfcea6-5d83-4dbb-8fa3-e35542d621e5+5:2407:x1870705565222528:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 56us (20836us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044224.251324:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 400 00000100:00080000:2.0:1784044224.252242:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1784044224.252248:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784044224.253991:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044224.254022:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565222144 00000100:00100000:3.0:1784044224.254030:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565222144 00000100:00100000:3.0:1784044224.254080:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 158 00000100:00100000:3.0:1784044224.254089:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843e0f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+7:2408:x1870705565222144:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:3.0:1784044224.254168:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843e0f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+7:2408:x1870705565222144:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 80us (185us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044224.254216:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 158 00000100:00080000:3.0:1784044224.254239:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784044224.254276:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044224.254371:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565221888 00000100:00100000:3.0:1784044224.254375:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565221888 00000100:00100000:3.0:1784044224.254404:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565222400 00000100:00100000:3.0:1784044224.254407:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565222400 00000100:00100000:3.0:1784044224.254428:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 401 00000100:00100000:3.0:1784044224.254434:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843e0ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+18:2408:x1870705565221888:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:3.0:1784044224.254465:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843e0ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+18:2408:x1870705565221888:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 30us (13761us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044224.254471:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 401 00000100:00100000:3.0:1784044224.254484:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 402 00000100:00100000:3.0:1784044224.254490:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68dfcea6-5d83-4dbb-8fa3-e35542d621e5+6:2408:x1870705565222400:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:3.0:1784044224.254513:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68dfcea6-5d83-4dbb-8fa3-e35542d621e5+6:2408:x1870705565222400:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 23us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044224.254534:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 402 00000100:00080000:3.0:1784044224.254550:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784044224.589651:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784044224.589700:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3945930700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1870705581009920:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1784044224.589820:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044224.590254:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581009920 00000100:00100000:1.0:1784044224.590267:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581009920 00000100:00100000:1.0:1784044224.590345:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:1.0:1784044224.590358:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1870705581009920:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1784044224.590408:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:1.0:1784044224.590480:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1870705581009920:12345-0@lo:41:osp-pre-0-1.0 Request processed in 123us (659us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044224.590488:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:3.0:1784044224.590737:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3945930700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1870705581009920:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1784044225.167112:0:10330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1784044225.550230:0:13763:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1784044225.550247:0:13763:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1784044225.551776:0:13763:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:1.0:1784044225.551800:0:13763:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1784044225.614050:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3945932d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1870705581010048:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784044225.614211:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044225.616113:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581010048 00000100:00100000:0.0:1784044225.616138:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581010048 00000100:00100000:0.0:1784044225.616309:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1784044225.616329:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3975b7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1870705581010048:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1784044225.616380:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1784044225.616513:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3975b7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1870705581010048:12345-0@lo:13:osp-pre-0-0.0 Request processed in 192us (2337us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044225.616522:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00080000:3.0:1784044225.617949:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784044225.618045:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3945932d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1870705581010048:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784044225.618385:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397a8a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1870705581010176:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1784044225.618471:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044225.618637:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581010176 00000100:00100000:1.0:1784044225.618663:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581010176 00000100:00100000:1.0:1784044225.618748:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1784044225.618758:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3975b7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1870705581010176:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1784044225.618786:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1784044225.618854:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3975b7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1870705581010176:12345-0@lo:13:osp-pre-0-1.0 Request processed in 96us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044225.618862:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00080000:3.0:1784044225.619023:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784044225.619055:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397a8a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1870705581010176:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1784044225.621654:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1784044225.621686:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3945930a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1870705581010304:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1784044225.621780:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044225.622033:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581010304 00000100:00100000:0.0:1784044225.622045:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581010304 00000100:00100000:0.0:1784044225.622126:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:0.0:1784044225.622139:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38420a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1870705581010304:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1784044225.622247:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1784044225.622335:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38420a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1870705581010304:12345-0@lo:41:osp-pre-1-0.0 Request processed in 199us (554us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044225.622344:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:2.0:1784044225.622514:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3945930a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1870705581010304:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1784044226.189485:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784044226.638198:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784044226.638235:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3945932a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1870705581010432:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784044226.638389:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044226.638856:0:10713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581010432 00000100:00100000:1.0:1784044226.638867:0:10713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581010432 00000100:00100000:1.0:1784044226.638948:0:10713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1784044226.638961:0:10713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3975b7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1870705581010432:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1784044226.639006:0:10713:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784044226.639069:0:10713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3975b7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1870705581010432:12345-0@lo:13:osp-pre-1-0.0 Request processed in 112us (680us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044226.639077:0:10713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00080000:2.0:1784044226.639516:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784044226.639885:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b38420a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3641:1870705581010944:0@lo:400:kworker.0 00000100:00100000:2.0:1784044226.639939:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044226.639976:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843735180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3641:1870705581011456:0@lo:400:kworker.0 00000100:00100000:1.0:1784044226.640250:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581010944 00000100:00100000:1.0:1784044226.640257:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581010944 00000100:00100000:0.0:1784044226.640512:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b38420abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3639:1870705581010688:0@lo:400:kworker.0 00000100:00100000:0.0:1784044226.640561:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b38420a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1870705581010816:0@lo:400:kworker.0 00000100:00100000:0.0:1784044226.641653:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044226.641778:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b38420a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:3638:1870705581010560:0@lo:400:kworker.0 00000100:00100000:3.0:1784044226.641830:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044226.641877:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843737480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1870705581011072:0@lo:400:kworker.0 00000100:00100000:1.0:1784044226.641937:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 403 00000100:00100000:1.0:1784044226.641952:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843737100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1870705581010944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044226.642023:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843737100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1870705581010944:12345-0@lo:400:kworker.0 Request processed in 75us (2083us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044226.642032:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 403 00000100:00100000:1.0:1784044226.642086:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581010560 00000100:00100000:1.0:1784044226.642093:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581010560 00000100:00100000:1.0:1784044226.642133:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 429 00000100:00100000:1.0:1784044226.642141:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3950371450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+24:3638:x1870705581010560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044226.642214:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3950371450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+24:3638:x1870705581010560:12345-0@lo:400:kworker.0 Request processed in 73us (383us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044226.642241:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 429 00000100:00100000:0.0:1784044226.646371:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843734700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1870705581011328:0@lo:400:kworker.0 00000100:00100000:0.0:1784044226.646511:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044226.646552:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843737800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3640:1870705581011840:0@lo:400:kworker.0 00000100:00100000:2.0:1784044226.646816:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044226.646946:0:9822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581011328 00000100:00100000:1.0:1784044226.646958:0:9822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581011328 00000100:00100000:1.0:1784044226.647035:0:9822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1784044226.647048:0:9822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3945933480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3640:x1870705581011328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044226.650756:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044226.650867:0:7768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581010816 00000100:00100000:2.0:1784044226.650881:0:7768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581010816 00000100:00100000:2.0:1784044226.650955:0:7768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581011072 00000100:00100000:2.0:1784044226.650959:0:7768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581011072 00000100:00100000:2.0:1784044226.650979:0:7768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:2.0:1784044226.650990:0:7768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3945931f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1870705581010816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784044226.651100:0:7768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3945931f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1870705581010816:12345-0@lo:400:kworker.0 Request processed in 111us (9450us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044226.651109:0:7768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:2.0:1784044226.651129:0:7768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:2.0:1784044226.651136:0:7768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3975b7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1870705581011072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784044226.651221:0:7768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3975b7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1870705581011072:12345-0@lo:400:kworker.0 Request processed in 85us (483us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044226.651228:0:7768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:2.0:1784044226.651303:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843735500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1870705581011968:0@lo:400:kworker.0 00000100:00100000:2.0:1784044226.651351:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044226.651380:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581011968 00000100:00100000:2.0:1784044226.651385:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581011968 00000100:00100000:2.0:1784044226.652828:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1784044226.652848:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843736680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1870705581011968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784044226.652931:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843736680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1870705581011968:12345-0@lo:400:kworker.0 Request processed in 92us (1579us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044226.652940:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00080000:2.0:1784044226.652972:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784044226.653016:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843735500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1870705581011968:0@lo:400:kworker.0 00000100:00100000:2.0:1784044226.653054:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b38420a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3641:1870705581010944:0@lo:400:kworker.0 00000100:00100000:0.0:1784044226.653479:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044226.653524:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581011456 00000100:00100000:0.0:1784044226.653530:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581011456 00000100:00100000:0.0:1784044226.653590:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581011840 00000100:00100000:0.0:1784044226.653593:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581011840 00000100:00100000:0.0:1784044226.653625:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 404 00000100:00100000:0.0:1784044226.653633:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843734380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1870705581011456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784044226.653681:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843734380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1870705581011456:12345-0@lo:400:kworker.0 Request processed in 49us (13673us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044226.653688:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 404 00000100:00100000:0.0:1784044226.653702:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 405 00000100:00100000:0.0:1784044226.653708:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3945930000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1870705581011840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784044226.653740:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3945930000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1870705581011840:12345-0@lo:400:kworker.0 Request processed in 33us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044226.653746:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 405 00000100:00080000:0.0:1784044226.653762:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1784044226.653765:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784044226.653793:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843735180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3641:1870705581011456:0@lo:400:kworker.0 00010000:00080000:0.0:1784044226.653821:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b3843737800 x1870705581011840/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044242 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784044226.653833:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843737800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3640:1870705581011840:0@lo:400:kworker.0 00000100:00100000:0.0:1784044226.653862:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3945932a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1870705581010432:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784044226.653890:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b38420a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1870705581010816:0@lo:400:kworker.0 00000100:00100000:0.0:1784044226.654075:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044226.654109:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843734e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1870705581011200:0@lo:400:kworker.0 00000100:00100000:0.0:1784044226.654148:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044226.654169:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843734000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3639:1870705581011712:0@lo:400:kworker.0 00000100:00100000:0.0:1784044226.654233:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044226.654262:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581010688 00000100:00100000:0.0:1784044226.654266:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581010688 00000100:00100000:0.0:1784044226.654299:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581011712 00000100:00100000:0.0:1784044226.654302:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581011712 00000100:00100000:0.0:1784044226.654325:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 406 00000100:00100000:0.0:1784044226.654331:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3945932a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1870705581010688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784044226.654367:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3945932a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1870705581010688:12345-0@lo:400:kworker.0 Request processed in 35us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044226.654373:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 406 00000100:00100000:0.0:1784044226.654386:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 407 00000100:00100000:0.0:1784044226.654392:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3945932d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1870705581011712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784044226.654419:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3945932d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1870705581011712:12345-0@lo:400:kworker.0 Request processed in 27us (186us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044226.654425:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 407 00000100:00080000:0.0:1784044226.654440:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784044226.654458:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b38420abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3639:1870705581010688:0@lo:400:kworker.0 00000100:00100000:0.0:1784044226.654469:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843734000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3639:1870705581011712:0@lo:400:kworker.0 00000100:00100000:1.0:1784044226.655499:0:9822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3945933480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3640:x1870705581011328:12345-0@lo:400:kworker.0 Request processed in 8444us (8978us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044226.655514:0:9822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1784044226.655544:0:9822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581011200 00000100:00100000:1.0:1784044226.655549:0:9822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581011200 00000100:00100000:1.0:1784044226.655599:0:9822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1784044226.655607:0:9822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3945930a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3639:x1870705581011200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044226.655659:0:9822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3945930a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3639:x1870705581011200:12345-0@lo:400:kworker.0 Request processed in 53us (1510us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044226.655666:0:9822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1784044226.655709:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843734e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1870705581011200:0@lo:400:kworker.0 00000100:00100000:1.0:1784044226.655745:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843734700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1870705581011328:0@lo:400:kworker.0 00000100:00100000:3.0:1784044226.658091:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843737480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1870705581011072:0@lo:400:kworker.0 00000100:00100000:3.0:1784044226.658115:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843734a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1870705581011584:0@lo:400:kworker.0 00000100:00100000:3.0:1784044226.658555:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044226.658663:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3945931500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1870705581012096:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1784044226.658695:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044226.658803:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581011584 00000100:00100000:3.0:1784044226.658808:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b38420a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:3638:1870705581010560:0@lo:400:kworker.0 00000100:00100000:0.0:1784044226.658812:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581011584 00000100:00100000:0.0:1784044226.658933:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 408 00000100:00100000:0.0:1784044226.658945:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3975b7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1870705581011584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784044226.659035:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3975b7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1870705581011584:12345-0@lo:400:kworker.0 Request processed in 92us (628us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044226.659044:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 408 00000100:00080000:1.0:1784044226.659382:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1784044226.659650:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b3843734a80 x1870705581011584/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044242 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784044226.659665:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843734a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1870705581011584:0@lo:400:kworker.0 00000100:00100000:2.0:1784044226.662956:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581012096 00000100:00100000:2.0:1784044226.662979:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581012096 00000100:00100000:2.0:1784044226.663166:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1784044226.663220:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3975b7c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1870705581012096:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1784044226.663275:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784044226.663424:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3975b7c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1870705581012096:12345-0@lo:13:osp-pre-1-1.0 Request processed in 194us (4711us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044226.663434:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1784044226.664535:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3945931500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1870705581012096:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1784044226.890819:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1784044226.891172:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565222784 00000100:00100000:1.0:1784044226.891248:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565222784 00000100:00100000:1.0:1784044226.891351:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 66 00000100:00100000:1.0:1784044226.891361:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3975b7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+18:13205:x1870705565222784:12345-192.168.202.40@tcp:35:umount.0 00000100:00100000:1.0:1784044226.891681:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3975b7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+19:13205:x1870705565222784:12345-192.168.202.40@tcp:35:umount.0 Request processed in 321us (874us total) trans 4294967523 rc 0/0 00000100:00100000:1.0:1784044226.891690:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 66 00000100:00080000:0.0:1784044226.892028:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784044226.896323:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1784044226.896965:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565223040 00000100:00100000:1.0:1784044226.896978:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565223040 00000100:00100000:1.0:1784044226.897060:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 67 00000100:00100000:1.0:1784044226.897071:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3945930700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+19:13205:x1870705565223040:12345-192.168.202.40@tcp:35:umount.0 00000100:00100000:1.0:1784044226.897547:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3945930700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+20:13205:x1870705565223040:12345-192.168.202.40@tcp:35:umount.0 Request processed in 476us (1237us total) trans 4294967524 rc 0/0 00000100:00100000:1.0:1784044226.897557:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 67 00000100:00100000:3.0:1784044226.901007:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1784044226.901253:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565223296 00000100:00100000:1.0:1784044226.901266:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565223296 00000100:00100000:1.0:1784044226.901352:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 68 00000100:00100000:1.0:1784044226.901365:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3974223450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+20:13205:x1870705565223296:12345-192.168.202.40@tcp:35:umount.0 00000100:00100000:1.0:1784044226.901677:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3974223450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+21:13205:x1870705565223296:12345-192.168.202.40@tcp:35:umount.0 Request processed in 314us (684us total) trans 4294967525 rc 0/0 00000100:00100000:1.0:1784044226.901685:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 68 00000100:00100000:3.0:1784044226.905633:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044226.905771:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565223552 00000100:00100000:2.0:1784044226.905783:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565223552 00000100:00100000:2.0:1784044226.905851:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 69 00000100:00100000:2.0:1784044226.905877:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3975b7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+21:13205:x1870705565223552:12345-192.168.202.40@tcp:35:umount.0 00000100:00100000:2.0:1784044226.906327:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3975b7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+22:13205:x1870705565223552:12345-192.168.202.40@tcp:35:umount.0 Request processed in 449us (704us total) trans 4294967526 rc 0/0 00000100:00100000:2.0:1784044226.906336:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 69 00000100:00100000:0.0:1784044226.911636:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044226.911693:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044226.911739:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1784044226.911911:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565223936 00000100:00100000:1.0:1784044226.911934:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565223936 00000100:00100000:1.0:1784044226.912017:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 82 00000100:00100000:1.0:1784044226.912028:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3945931500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+5:2406:x1870705565223936:12345-192.168.202.40@tcp:9:umount.0 00000020:00000080:1.0:1784044226.912070:0:8426:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x89871fc3aba18352 00000100:00080000:1.0:1784044226.912081:0:8426:0:(import.c:65:import_set_state_nolock()) ffff9b3843c33000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1784044226.912142:0:8426:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:1.0:1784044226.912426:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3945931500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a93fdf3c-d42f-420a-95ea-b0cbfe954363+2:2406:x1870705565223936:12345-192.168.202.40@tcp:9:umount.0 Request processed in 398us (684us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044226.912435:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 82 00000100:00100000:3.0:1784044226.912612:0:13182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565223680 00000100:00100000:3.0:1784044226.912617:0:13182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565223680 00000100:00100000:3.0:1784044226.912668:0:13182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565223808 00000100:00100000:3.0:1784044226.912672:0:13182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565223808 00000100:00100000:3.0:1784044226.912698:0:13182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 19 00000100:00100000:3.0:1784044226.912706:0:13182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3945930380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c4a09ad9-a185-4679-99bb-b6a07b865440+14:2408:x1870705565223680:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784044226.912726:0:13182:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784044226.912751:0:13182:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b39759f9000/0x89871fc3aba17ffc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6566 expref: 14 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044226.912771:0:13182:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784044226.912795:0:13182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3945930380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c4a09ad9-a185-4679-99bb-b6a07b865440+13:2408:x1870705565223680:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 90us (1175us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044226.912803:0:13182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 19 00000100:00100000:3.0:1784044226.912839:0:13182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 20 00000100:00100000:3.0:1784044226.912847:0:13182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3945930700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c4a09ad9-a185-4679-99bb-b6a07b865440+12:2408:x1870705565223808:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784044226.912856:0:13182:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784044226.912866:0:13182:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b3982055c00/0x89871fc3aba17f3f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6527 expref: 12 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044226.912878:0:13182:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784044226.912899:0:13182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3945930700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c4a09ad9-a185-4679-99bb-b6a07b865440+11:2408:x1870705565223808:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 53us (1206us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044226.912906:0:13182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 20 00000100:00080000:0.0:1784044226.913956:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1784044226.913979:0:10331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784044226.917589:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044226.918084:0:13182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565224064 00000100:00100000:0.0:1784044226.918098:0:13182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565224064 00000100:00100000:0.0:1784044226.918250:0:13182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 21 00000100:00100000:0.0:1784044226.918264:0:13182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3975b7c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c4a09ad9-a185-4679-99bb-b6a07b865440+11:2407:x1870705565224064:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784044226.918296:0:13182:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784044226.918323:0:13182:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b38410b6e00/0x89871fc3aba1824f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca663f expref: 11 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044226.918345:0:13182:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784044226.918426:0:13182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3975b7c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c4a09ad9-a185-4679-99bb-b6a07b865440+10:2407:x1870705565224064:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 165us (854us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044226.918435:0:13182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 21 00000100:00100000:3.0:1784044226.922580:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044226.922878:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565224448 00000100:00100000:2.0:1784044226.922891:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565224448 00000100:00100000:2.0:1784044226.922997:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 83 00000100:00100000:2.0:1784044226.923008:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3975b7f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+7:2406:x1870705565224448:12345-192.168.202.40@tcp:9:umount.0 00000020:00000080:2.0:1784044226.923048:0:8428:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x89871fc3aba185c8 00000020:00010000:2.0:1784044226.923057:0:8428:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9b3944e99000: total 0 00000100:00080000:2.0:1784044226.923063:0:8428:0:(import.c:65:import_set_state_nolock()) ffff9b3944e99800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1784044226.923134:0:8428:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:2.0:1784044226.923385:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3975b7f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a93fdf3c-d42f-420a-95ea-b0cbfe954363+5:2406:x1870705565224448:12345-192.168.202.40@tcp:9:umount.0 Request processed in 377us (819us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044226.923393:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 83 00000100:00080000:0.0:1784044226.923852:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00010000:1.0:1784044226.924035:0:6499:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9b3944e99000: total 0 00010000:00010000:1.0:1784044226.924097:0:6499:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9b3944e99000, canceled 0 locks, left on hash table 2. 00010000:00010000:1.0:1784044226.924233:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002e0bf137/0x89871fc3aba1904f lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6a0c expref: 4 pid: 8426 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044226.924276:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009efb7f3c/0x89871fc3aba18980 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6829 expref: 3 pid: 8427 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044226.924294:0:6499:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9b3944e99000, canceled 2 locks, left on hash table 0. 00010000:00010000:1.0:1784044226.924309:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784044226.924311:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784044226.924313:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784044226.941811:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044226.941928:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565225472 00000100:00100000:0.0:1784044226.941941:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565225472 00000100:00100000:0.0:1784044226.942026:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 258 00000100:00100000:0.0:1784044226.942038:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397a8a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+22:2406:x1870705565225472:12345-192.168.202.40@tcp:39:umount.0 00000020:00000080:0.0:1784044226.942102:0:6512:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x89871fc3aba17f4d 00000020:00010000:0.0:1784044226.942122:0:6512:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9b3843443000: total 0 00000100:00080000:0.0:1784044226.942128:0:6512:0:(import.c:65:import_set_state_nolock()) ffff9b3843442000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1784044226.942165:0:6512:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00100000:0.0:1784044226.942423:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397a8a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a93fdf3c-d42f-420a-95ea-b0cbfe954363+21:2406:x1870705565225472:12345-192.168.202.40@tcp:39:umount.0 Request processed in 386us (625us total) trans 4294967527 rc 0/0 00000100:00100000:0.0:1784044226.942433:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 258 00000020:00010000:2.0:1784044226.942560:0:10330:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9b3843443000: total 0 00010000:00010000:2.0:1784044226.942628:0:10330:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9b3843443000, canceled 0 locks, left on hash table 13. 00010000:00010000:2.0:1784044226.942675:0:10330:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9b3842777a00) 00010000:00010000:2.0:1784044226.942678:0:10330:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1784044226.942687:0:10330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc400/0x89871fc3aba18cf2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6925 expref: 20 pid: 9501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044226.942707:0:10330:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b397b61bc00) 00010000:00010000:2.0:1784044226.942709:0:10330:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1784044226.942713:0:10330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3843798200/0x89871fc3aba189e9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6845 expref: 19 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044226.942743:0:10330:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9b397b61b500) 00010000:00010000:2.0:1784044226.942746:0:10330:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1784044226.942750:0:10330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fda00/0x89871fc3aba1903a lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6a05 expref: 18 pid: 13808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044226.942763:0:10330:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9b397aa61900) 00010000:00010000:2.0:1784044226.942766:0:10330:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1784044226.942769:0:10330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6400/0x89871fc3aba18328 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6669 expref: 17 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044226.942782:0:10330:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9b39758c1600) 00010000:00010000:2.0:1784044226.942785:0:10330:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784044226.942788:0:10330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc800/0x89871fc3aba18941 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6814 expref: 16 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044226.942800:0:10330:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9b397b61b500) 00010000:00010000:2.0:1784044226.942802:0:10330:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1784044226.942805:0:10330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6c00/0x89871fc3aba18f30 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca69bf expref: 15 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044226.942818:0:10330:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9b39758c1600) 00010000:00010000:2.0:1784044226.942820:0:10330:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1784044226.942824:0:10330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fcc00/0x89871fc3aba1896b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6822 expref: 14 pid: 9501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044226.942835:0:10330:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9b397aa61900) 00010000:00010000:2.0:1784044226.942838:0:10330:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1784044226.942848:0:10330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166be00/0x89871fc3aba18623 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6742 expref: 13 pid: 9501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044226.942874:0:10330:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9b396f2a8900) 00010000:00010000:2.0:1784044226.942877:0:10330:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784044226.942881:0:10330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b39759f8800/0x89871fc3aba182cd lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6654 expref: 12 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044226.942897:0:10330:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9b396f2a8100) 00010000:00010000:2.0:1784044226.942899:0:10330:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1784044226.942902:0:10330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b39759f8000/0x89871fc3aba182b1 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca664d expref: 11 pid: 9501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044226.942916:0:10330:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9b3842777a00) 00010000:00010000:2.0:1784044226.942919:0:10330:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1784044226.942923:0:10330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7e00/0x89871fc3aba18a05 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca684c expref: 10 pid: 13808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044226.942937:0:10330:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9b397b61b500) 00010000:00010000:2.0:1784044226.942939:0:10330:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784044226.942943:0:10330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b394166ac00/0x89871fc3aba19010 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca69f7 expref: 9 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044226.942959:0:10330:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9b39758c1600) 00010000:00010000:2.0:1784044226.942962:0:10330:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1784044226.942965:0:10330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc600/0x89871fc3aba18861 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca67dc expref: 8 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044226.942976:0:10330:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9b3843443000, canceled 13 locks, left on hash table 0. 00010000:00010000:2.0:1784044226.942996:0:10330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784044226.942998:0:10330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784044226.943000:0:10330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784044226.956005:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044226.956270:0:9501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565225600 00000100:00100000:3.0:1784044226.956291:0:9501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565225600 00000100:00100000:3.0:1784044226.956394:0:9501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 259 00000100:00100000:3.0:1784044226.956407:0:9501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843735500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a93fdf3c-d42f-420a-95ea-b0cbfe954363+5:2406:x1870705565225600:12345-192.168.202.40@tcp:39:umount.0 00000020:00000080:3.0:1784044226.956452:0:9501:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x89871fc3aba17f54 00000100:00080000:3.0:1784044226.956474:0:9501:0:(import.c:65:import_set_state_nolock()) ffff9b384345a000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1784044226.956511:0:9501:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967298 00010000:00010000:2.0:1784044226.956966:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1784044226.957208:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1784044226.957479:0:9501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843735500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a93fdf3c-d42f-420a-95ea-b0cbfe954363+3:2406:x1870705565225600:12345-192.168.202.40@tcp:39:umount.0 Request processed in 1068us (1483us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1784044226.957493:0:9501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 259 00000040:00080000:3.0:1784044227.022072:0:13804:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1784044227.213492:0:10331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784044228.245101:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784044229.261533:0:10330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784044229.349680:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044229.349849:0:13808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565225856 00000100:00100000:3.0:1784044229.349862:0:13808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565225856 00000100:00100000:3.0:1784044229.349974:0:13808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 409 00000100:00100000:3.0:1784044229.349985:0:13808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38436a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:68dfcea6-5d83-4dbb-8fa3-e35542d621e5+6:2409:x1870705565225856:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:3.0:1784044229.350094:0:13808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38436a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:68dfcea6-5d83-4dbb-8fa3-e35542d621e5+6:2409:x1870705565225856:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 111us (439us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044229.350113:0:13808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 409 00000100:00080000:0.0:1784044229.350287:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784044229.354598:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044229.354908:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565225728 00000100:00100000:0.0:1784044229.354921:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565225728 00000100:00100000:0.0:1784044229.354993:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 430 00000100:00100000:0.0:1784044229.355004:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3950370050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4a09ad9-a185-4679-99bb-b6a07b865440+10:2410:x1870705565225728:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:0.0:1784044229.355083:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3950370050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4a09ad9-a185-4679-99bb-b6a07b865440+10:2410:x1870705565225728:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 80us (496us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044229.355091:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 430 00000100:00100000:0.0:1784044229.366131:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1784044229.366297:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565225984 00000100:00100000:1.0:1784044229.366308:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565225984 00000100:00100000:1.0:1784044229.366396:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 410 00000100:00100000:1.0:1784044229.366407:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38436a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68dfcea6-5d83-4dbb-8fa3-e35542d621e5+5:2409:x1870705565225984:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:1.0:1784044229.366493:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38436a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68dfcea6-5d83-4dbb-8fa3-e35542d621e5+5:2409:x1870705565225984:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 87us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044229.366500:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 410 00000100:00080000:0.0:1784044229.367012:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1784044229.606633:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044229.606684:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044229.606725:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1784044229.606756:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565226112 00000100:00100000:1.0:1784044229.606769:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565226112 00000100:00100000:1.0:1784044229.606853:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565226240 00000100:00100000:1.0:1784044229.606856:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565226240 00000100:00100000:1.0:1784044229.606869:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565226368 00000100:00100000:1.0:1784044229.606872:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565226368 00000100:00100000:1.0:1784044229.606893:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 22 00000100:00100000:1.0:1784044229.606904:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843735c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c4a09ad9-a185-4679-99bb-b6a07b865440+12:2407:x1870705565226112:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784044229.606944:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784044229.606965:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b3843798c00/0x89871fc3aba18050 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca657b expref: 12 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044229.606982:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784044229.607035:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843735c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c4a09ad9-a185-4679-99bb-b6a07b865440+11:2407:x1870705565226112:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 133us (414us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044229.607044:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 22 00000100:00100000:1.0:1784044229.607065:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 23 00000100:00100000:1.0:1784044229.607072:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843736a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c4a09ad9-a185-4679-99bb-b6a07b865440+10:2408:x1870705565226240:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784044229.607081:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784044229.607091:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b3843799600/0x89871fc3aba18057 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca65ac expref: 10 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044229.607100:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784044229.607118:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843736a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c4a09ad9-a185-4679-99bb-b6a07b865440+9:2408:x1870705565226240:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 47us (439us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044229.607123:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 23 00000100:00100000:1.0:1784044229.607136:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 24 00000100:00100000:1.0:1784044229.607142:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843735f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c4a09ad9-a185-4679-99bb-b6a07b865440+8:2407:x1870705565226368:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784044229.607149:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784044229.607168:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b38410b7200/0x89871fc3aba18248 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6638 expref: 8 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044229.607236:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784044229.607254:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843735f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c4a09ad9-a185-4679-99bb-b6a07b865440+7:2407:x1870705565226368:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 112us (528us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044229.607269:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 24 00000100:00100000:3.0:1784044229.624530:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044229.624675:0:9501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565226624 00000100:00100000:2.0:1784044229.624687:0:9501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565226624 00000100:00100000:2.0:1784044229.624846:0:9501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 260 00000100:00100000:2.0:1784044229.624865:0:9501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3975b7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68dfcea6-5d83-4dbb-8fa3-e35542d621e5+6:2406:x1870705565226624:12345-192.168.202.40@tcp:39:umount.0 00000020:00000080:2.0:1784044229.624939:0:9501:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x89871fc3aba18065 00000020:00010000:2.0:1784044229.624959:0:9501:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9b397b801000: total 0 00000100:00080000:2.0:1784044229.624969:0:9501:0:(import.c:65:import_set_state_nolock()) ffff9b397b803800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1784044229.625010:0:9501:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967527 00000020:00010000:0.0:1784044229.625030:0:6500:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9b397b801000: total 0 00010000:00010000:0.0:1784044229.625085:0:6500:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9b397b801000, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1784044229.625120:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b397b61bc00) 00010000:00010000:0.0:1784044229.625123:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1784044229.625131:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6200/0x89871fc3aba1905d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6a13 expref: 6 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044229.625166:0:6500:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9b397b801000, canceled 1 locks, left on hash table 0. 00010000:00010000:0.0:1784044229.625241:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784044229.625244:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784044229.625246:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784044229.625247:0:9501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3975b7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68dfcea6-5d83-4dbb-8fa3-e35542d621e5+3:2406:x1870705565226624:12345-192.168.202.40@tcp:39:umount.0 Request processed in 389us (731us total) trans 4294967528 rc 0/0 00000100:00100000:2.0:1784044229.625255:0:9501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 260 00000100:00100000:1.0:1784044229.637456:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044229.637555:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565226752 00000100:00100000:0.0:1784044229.637565:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565226752 00000100:00100000:0.0:1784044229.637627:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 261 00000100:00100000:0.0:1784044229.637638:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397a8a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68dfcea6-5d83-4dbb-8fa3-e35542d621e5+5:2406:x1870705565226752:12345-192.168.202.40@tcp:39:umount.0 00000020:00000080:0.0:1784044229.637694:0:6512:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x89871fc3aba1806c 00000100:00080000:0.0:1784044229.637707:0:6512:0:(import.c:65:import_set_state_nolock()) ffff9b397f9b3800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1784044229.637741:0:6512:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:0.0:1784044229.637918:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397a8a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68dfcea6-5d83-4dbb-8fa3-e35542d621e5+3:2406:x1870705565226752:12345-192.168.202.40@tcp:39:umount.0 Request processed in 280us (469us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1784044229.637926:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 261 00010000:00010000:2.0:1784044229.638022:0:10331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784044229.700981:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1784044229.701119:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565227008 00000100:00100000:1.0:1784044229.701132:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565227008 00000100:00100000:1.0:1784044229.701258:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 431 00000100:00100000:1.0:1784044229.701268:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3950372450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4a09ad9-a185-4679-99bb-b6a07b865440+7:2406:x1870705565227008:12345-192.168.202.40@tcp:251:umount.0 00000020:00000080:1.0:1784044229.701320:0:6506:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x89871fc3aba17f2a 00000020:00010000:1.0:1784044229.701330:0:6506:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9b3843c32800: total 0 00000100:00080000:1.0:1784044229.701336:0:6506:0:(import.c:65:import_set_state_nolock()) ffff9b3843c30000 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1784044229.701432:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3950372450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4a09ad9-a185-4679-99bb-b6a07b865440+3:2406:x1870705565227008:12345-192.168.202.40@tcp:251:umount.0 Request processed in 165us (465us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044229.701441:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 431 00000020:00010000:2.0:1784044229.701574:0:6499:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9b3843c32800: total 0 00010000:00010000:2.0:1784044229.701580:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784044229.701640:0:6499:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9b3843c32800, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1784044229.701697:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b39759f9600/0x89871fc3aba18003 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca656d expref: 2 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044229.701710:0:6499:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9b3843c32800, canceled 1 locks, left on hash table 0. 00000020:00000080:2.0:1784044229.701721:0:6499:0:(genops.c:906:class_export_put()) final put ffff9b3843c32800/c4a09ad9-a185-4679-99bb-b6a07b865440 00010000:00010000:2.0:1784044229.701756:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784044229.701758:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784044229.701759:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1784044229.702343:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9b3843c32800/c4a09ad9-a185-4679-99bb-b6a07b865440 for MGS 00000020:00000080:1.0:1784044229.702385:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9b3843c30000 for MGS 00000100:00100000:1.0:1784044229.709570:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b38436a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1870705581012224:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1784044229.709676:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044229.710062:0:7768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581012224 00000100:00100000:0.0:1784044229.710071:0:7768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581012224 00000100:00100000:0.0:1784044229.710132:0:7768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:0.0:1784044229.710142:0:7768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397a8a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1870705581012224:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1784044229.710213:0:7768:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446260736 avail 1300021248 00000100:00100000:0.0:1784044229.710276:0:7768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397a8a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1870705581012224:12345-0@lo:41:osp-pre-0-1.0 Request processed in 136us (605us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044229.710284:0:7768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:2.0:1784044229.710453:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b38436a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1870705581012224:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1784044230.285621:0:10330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784044230.737028:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b38436a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1870705581012352:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1784044230.737104:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044230.737319:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784044230.737330:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b38436a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1870705581012480:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784044230.737359:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044230.737477:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3975b7f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1870705581012608:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1784044230.737522:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581012352 00000100:00100000:0.0:1784044230.737529:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581012352 00000100:00100000:3.0:1784044230.737534:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044230.737580:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581012608 00000100:00100000:3.0:1784044230.737585:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581012608 00000100:00100000:3.0:1784044230.737619:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:3.0:1784044230.737627:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3975b7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1870705581012608:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1784044230.737661:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1784044230.737712:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581012480 00000100:00100000:3.0:1784044230.737715:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3975b7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1870705581012608:12345-0@lo:41:osp-pre-1-0.0 Request processed in 86us (182us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044230.737718:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581012480 00000100:00100000:3.0:1784044230.737728:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:0.0:1784044230.737745:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1784044230.737754:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38436a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1870705581012352:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1784044230.737776:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1784044230.737780:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3975b7f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1870705581012608:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1784044230.737841:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38436a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1870705581012352:12345-0@lo:13:osp-pre-0-1.0 Request processed in 89us (738us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044230.737848:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1784044230.737862:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1784044230.737868:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38436a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1870705581012480:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1784044230.737877:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1784044230.738729:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38436a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1870705581012480:12345-0@lo:13:osp-pre-0-0.0 Request processed in 857us (1365us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044230.738737:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00080000:0.0:1784044230.738763:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784044230.738992:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b38436a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1870705581012480:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784044230.739008:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b38436a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1870705581012352:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1784044231.310741:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784044231.757341:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784044231.757353:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3975b7f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1870705581012864:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1784044231.757358:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b38436a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1870705581012736:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784044231.762129:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044231.762393:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3975b7f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:3641:1870705581012992:0@lo:400:kworker.0 00000100:00100000:3.0:1784044231.762443:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044231.762469:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3975b7ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1870705581013504:0@lo:400:kworker.0 00000100:00100000:2.0:1784044231.762770:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581012864 00000100:00100000:2.0:1784044231.762780:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581012864 00000100:00100000:2.0:1784044231.762844:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1784044231.762855:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3975b7d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1870705581012864:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1784044231.762899:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784044231.762949:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3975b7d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1870705581012864:12345-0@lo:13:osp-pre-1-1.0 Request processed in 97us (827us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044231.762957:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1784044231.763317:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3975b7df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1870705581013376:0@lo:400:kworker.0 00000100:00100000:2.0:1784044231.763354:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044231.763388:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3943eb0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3640:1870705581013888:0@lo:400:kworker.0 00000100:00100000:2.0:1784044231.763411:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044231.763426:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3943eb3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1870705581014400:0@lo:400:kworker.0 00000100:00100000:2.0:1784044231.763449:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044231.763494:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3975b7f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1870705581012864:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1784044231.763529:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581013376 00000100:00100000:2.0:1784044231.763533:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581013376 00000100:00100000:2.0:1784044231.763584:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581013888 00000100:00100000:2.0:1784044231.763588:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581013888 00000100:00100000:2.0:1784044231.763609:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 411 00000100:00100000:2.0:1784044231.763616:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843735880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1870705581013376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784044231.763969:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843735880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1870705581013376:12345-0@lo:400:kworker.0 Request processed in 352us (613us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044231.763976:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 411 00000100:00100000:2.0:1784044231.763992:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 412 00000100:00100000:2.0:1784044231.763998:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843736300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1870705581013888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784044231.764027:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843736300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1870705581013888:12345-0@lo:400:kworker.0 Request processed in 30us (615us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044231.764033:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 412 00000100:00100000:2.0:1784044231.764063:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3975b7df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1870705581013376:0@lo:400:kworker.0 00000100:00100000:2.0:1784044231.764073:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3943eb0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3640:1870705581013888:0@lo:400:kworker.0 00000100:00100000:3.0:1784044231.764836:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044231.764870:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3943eb1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3641:1870705581014016:0@lo:400:kworker.0 00000100:00100000:3.0:1784044231.764895:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044231.764942:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3975b7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1870705581013248:0@lo:400:kworker.0 00000100:00100000:3.0:1784044231.764966:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044231.764993:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3943eb1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1870705581013760:0@lo:400:kworker.0 00000100:00100000:3.0:1784044231.765014:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044231.765032:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3943eb0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3639:1870705581014272:0@lo:400:kworker.0 00000100:00100000:3.0:1784044231.765053:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044231.765072:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1784044231.765079:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3975b7dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3639:1870705581013120:0@lo:400:kworker.0 00000100:00100000:3.0:1784044231.765101:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044231.765119:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3943eb3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1870705581013632:0@lo:400:kworker.0 00000100:00100000:3.0:1784044231.765151:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044231.765170:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3943eb2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3639:1870705581014144:0@lo:400:kworker.0 00000100:00100000:3.0:1784044231.765208:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044231.765234:0:13808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581014016 00000100:00100000:3.0:1784044231.765239:0:13808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581014016 00000100:00100000:3.0:1784044231.765272:0:13808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581014272 00000100:00100000:3.0:1784044231.765275:0:13808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581014272 00000100:00100000:3.0:1784044231.765289:0:13808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581013120 00000100:00100000:3.0:1784044231.765292:0:13808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581013120 00000100:00100000:3.0:1784044231.765303:0:13808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581014144 00000100:00100000:3.0:1784044231.765305:0:13808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581014144 00000100:00100000:3.0:1784044231.765322:0:13808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 413 00000100:00100000:3.0:1784044231.765328:0:13808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3943eb0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1870705581014016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044231.765383:0:13808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3943eb0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1870705581014016:12345-0@lo:400:kworker.0 Request processed in 54us (487us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044231.765390:0:13808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 413 00000100:00100000:3.0:1784044231.765406:0:13808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 414 00000100:00100000:3.0:1784044231.765412:0:13808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3943eb2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1870705581014272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044231.765441:0:13808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3943eb2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1870705581014272:12345-0@lo:400:kworker.0 Request processed in 29us (386us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044231.765446:0:13808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 414 00000100:00100000:3.0:1784044231.765457:0:13808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 415 00000100:00100000:3.0:1784044231.765462:0:13808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3943eb3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1870705581013120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044231.765485:0:13808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3943eb3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1870705581013120:12345-0@lo:400:kworker.0 Request processed in 23us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044231.765489:0:13808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 415 00000100:00100000:3.0:1784044231.765500:0:13808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 416 00000100:00100000:3.0:1784044231.765506:0:13808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3943eb1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1870705581014144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044231.765532:0:13808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3943eb1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1870705581014144:12345-0@lo:400:kworker.0 Request processed in 26us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044231.765537:0:13808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 416 00000100:00100000:3.0:1784044231.765557:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581013504 00000100:00100000:3.0:1784044231.765561:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581013504 00000100:00100000:3.0:1784044231.765588:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581013248 00000100:00100000:3.0:1784044231.765591:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581013248 00000100:00100000:3.0:1784044231.765605:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:3.0:1784044231.765611:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3943eb0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1870705581013504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044231.765641:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3943eb0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1870705581013504:12345-0@lo:400:kworker.0 Request processed in 30us (806us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044231.765657:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:3.0:1784044231.765670:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:3.0:1784044231.765675:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3943eb0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1870705581013248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044231.765705:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3943eb0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1870705581013248:12345-0@lo:400:kworker.0 Request processed in 30us (737us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044231.765711:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:3.0:1784044231.765729:0:9822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581014400 00000100:00100000:3.0:1784044231.765733:0:9822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581014400 00000100:00100000:3.0:1784044231.765759:0:9822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581013760 00000100:00100000:3.0:1784044231.765761:0:9822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581013760 00000100:00100000:3.0:1784044231.765772:0:9822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581013632 00000100:00100000:3.0:1784044231.765774:0:9822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581013632 00000100:00100000:3.0:1784044231.765786:0:9822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1784044231.765791:0:9822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843734a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3640:x1870705581014400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044231.765834:0:9822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843734a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3640:x1870705581014400:12345-0@lo:400:kworker.0 Request processed in 41us (2383us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044231.765840:0:9822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1784044231.765851:0:9822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1784044231.765856:0:9822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3943eb2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3639:x1870705581013760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044231.765881:0:9822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3943eb2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3639:x1870705581013760:12345-0@lo:400:kworker.0 Request processed in 25us (866us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044231.765887:0:9822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1784044231.765897:0:9822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1784044231.765902:0:9822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3943eb1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3639:x1870705581013632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044231.765926:0:9822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3943eb1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3639:x1870705581013632:12345-0@lo:400:kworker.0 Request processed in 24us (775us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044231.765941:0:9822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1784044231.765989:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3975b7dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3639:1870705581013120:0@lo:400:kworker.0 00000100:00100000:3.0:1784044231.766000:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3943eb3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1870705581013632:0@lo:400:kworker.0 00000100:00100000:3.0:1784044231.766008:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3943eb2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3639:1870705581014144:0@lo:400:kworker.0 00000100:00100000:3.0:1784044231.766016:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3975b7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1870705581013248:0@lo:400:kworker.0 00000100:00100000:3.0:1784044231.766024:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3943eb1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1870705581013760:0@lo:400:kworker.0 00010000:00080000:3.0:1784044231.766036:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b3943eb0000 x1870705581014272/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044247 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784044231.766046:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3943eb0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3639:1870705581014272:0@lo:400:kworker.0 00000100:00100000:3.0:1784044231.766125:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3943eb3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1870705581014400:0@lo:400:kworker.0 00000100:00100000:3.0:1784044231.766164:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3975b7ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1870705581013504:0@lo:400:kworker.0 00010000:00080000:3.0:1784044231.766199:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b3943eb1500 x1870705581014016/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044247 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784044231.766208:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3943eb1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3641:1870705581014016:0@lo:400:kworker.0 00000100:00080000:3.0:1784044231.766266:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1784044231.766270:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1784044231.766273:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784044231.766302:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581012992 00000100:00100000:3.0:1784044231.766307:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581012992 00000100:00100000:3.0:1784044231.766337:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 432 00000100:00100000:3.0:1784044231.766343:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3950373c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+24:3641:x1870705581012992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044231.766389:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3950373c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+24:3641:x1870705581012992:12345-0@lo:400:kworker.0 Request processed in 46us (3945us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044231.766395:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 432 00000100:00100000:3.0:1784044231.766445:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3975b7f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:3641:1870705581012992:0@lo:400:kworker.0 00000100:00100000:0.0:1784044231.768499:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044231.772429:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581012736 00000100:00100000:3.0:1784044231.772447:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581012736 00000100:00100000:3.0:1784044231.772513:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1784044231.772526:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38436a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1870705581012736:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1784044231.772555:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784044231.772644:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38436a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1870705581012736:12345-0@lo:13:osp-pre-1-0.0 Request processed in 121us (4152us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044231.772651:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1784044231.775824:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b38436a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1870705581012736:0@lo:13:osp-pre-1-0.0 00000001:00100000:0.0:1784044231.797036:0:6490:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 68dfcea6-5d83-4dbb-8fa3-e35542d621e5 00000001:00080000:0.0:1784044231.797053:0:6490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967528 is committed 00000020:00000080:0.0:1784044231.797059:0:6490:0:(genops.c:906:class_export_put()) final put ffff9b397b801000/68dfcea6-5d83-4dbb-8fa3-e35542d621e5 00000001:00100000:0.0:1784044231.797078:0:6490:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of a93fdf3c-d42f-420a-95ea-b0cbfe954363 00000001:00080000:0.0:1784044231.797085:0:6490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967527 is committed 00000020:00000080:0.0:1784044231.797094:0:6490:0:(genops.c:906:class_export_put()) final put ffff9b3843443000/a93fdf3c-d42f-420a-95ea-b0cbfe954363 00000020:00000080:3.0:1784044231.797457:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9b397b801000/68dfcea6-5d83-4dbb-8fa3-e35542d621e5 for lustre-MDT0000 00000020:00000080:3.0:1784044231.797536:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9b3843443000/a93fdf3c-d42f-420a-95ea-b0cbfe954363 for lustre-MDT0000 00000020:00000080:3.0:1784044231.797589:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9b397b803800 for lustre-MDT0000 00000020:00000080:3.0:1784044231.797594:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9b3843442000 for lustre-MDT0000 00010000:00010000:1.0:1784044232.340338:0:10331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1784044232.491913:0:15208:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:2.0:1784044232.541048:0:15208:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:2.0:1784044232.541110:0:15208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b39759f8a00/0x89871fc3aba17fd2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba17fd9 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044232.541138:0:15208:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b39759f8a00/0x89871fc3aba17fd2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x89871fc3aba17fd9 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044232.541146:0:15208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b39759f8a00/0x89871fc3aba17fd2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x89871fc3aba17fd9 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044232.541153:0:15208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.140@tcp lock: ffff9b39759f8a00/0x89871fc3aba17fd2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x89871fc3aba17fd9 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044232.541195:0:15208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1784044232.541201:0:15208:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1784044232.541228:0:15208:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1784044232.541232:0:15208:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1784044232.541245:0:15208:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1784044232.541270:0:15208:0:(import.c:65:import_set_state_nolock()) ffff9b397a9e9800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1784044232.541302:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843737480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3637:1870705581014528:0@lo:39:umount.0 00000100:00100000:2.0:1784044232.541376:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1784044232.541557:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784044232.541564:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: ffff9b39759f8a00/0x89871fc3aba17fd2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x89871fc3aba17fd9 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044232.541572:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b39759f8a00 already unused, calling callback (ffffffffc113cc20) 10000000:00010000:0.0:1784044232.541576:0:6499:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: ffff9b39759f8a00/0x89871fc3aba17fd2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x89871fc3aba17fd9 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044232.541585:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9b39759f8a00/0x89871fc3aba17fd2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x89871fc3aba17fd9 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784044232.541592:0:6499:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9b39759f8a00/0x89871fc3aba17fd2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x89871fc3aba17fd9 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784044232.541598:0:6499:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1784044232.541601:0:6499:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1784044232.541603:0:6499:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1784044232.541631:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.140@tcp lock: ffff9b39759f8a00/0x89871fc3aba17fd2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x89871fc3aba17fd9 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044232.541648:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784044232.541671:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: ffff9b39759f8a00/0x89871fc3aba17fd2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x89871fc3aba17fd9 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044232.541678:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9b39759f8a00/0x89871fc3aba17fd2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x89871fc3aba17fd9 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044232.541690:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784044232.541692:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784044232.541694:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784044232.541811:0:13808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581014528 00000100:00100000:3.0:1784044232.541818:0:13808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581014528 00000100:00100000:3.0:1784044232.541875:0:13808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:3.0:1784044232.541884:0:13808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843734700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1870705581014528:12345-0@lo:39:umount.0 00000020:00000080:3.0:1784044232.541908:0:13808:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x89871fc3aba17b41 00000100:00080000:3.0:1784044232.541916:0:13808:0:(import.c:65:import_set_state_nolock()) ffff9b39459d0800 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1784044232.541987:0:13808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843734700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+1:3637:x1870705581014528:12345-0@lo:39:umount.0 Request processed in 104us (611us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044232.541995:0:13808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000020:00000080:3.0:1784044232.542014:0:13808:0:(genops.c:906:class_export_put()) final put ffff9b39459d1800/lustre-MDT0000-lwp-MDT0000_UUID 00000100:00100000:3.0:1784044232.542038:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784044232.542048:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b38436a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:3640:1870705581014656:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784044232.542080:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1784044232.542111:0:10330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1784044232.542120:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9b39459d1800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1784044232.542194:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9b39459d0800 for lustre-MDT0000 00000100:00100000:3.0:1784044232.542210:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581014656 00000100:00100000:3.0:1784044232.542214:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581014656 00000100:00100000:3.0:1784044232.542246:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1784044232.542253:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3944ce6050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+24:3640:x1870705581014656:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784044232.542265:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784044232.542281:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b3940030800/0x89871fc3aba17fd9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x89871fc3aba17fd2 expref: 24 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044232.542294:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784044232.542322:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3944ce6050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+23:3640:x1870705581014656:12345-0@lo:103:ldlm_bl.0 Request processed in 70us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044232.542328:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1784044232.542390:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b38436a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:3640:1870705581014656:0@lo:103:ldlm_bl.0 00000100:00080000:3.0:1784044232.542439:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9b397a9e9800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1784044232.542447:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843737480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3637:1870705581014528:0@lo:39:umount.0 00000100:00080000:2.0:1784044232.543067:0:15208:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1784044232.543071:0:15208:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1784044232.543077:0:15208:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1784044232.545936:0:15208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b3982054e00/0x89871fc3aba17fe0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba17fe7 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044232.545958:0:15208:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b3982054e00/0x89871fc3aba17fe0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x89871fc3aba17fe7 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044232.547724:0:15208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b3982054e00/0x89871fc3aba17fe0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x89871fc3aba17fe7 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044232.547743:0:15208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.140@tcp lock: ffff9b3982054e00/0x89871fc3aba17fe0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x89871fc3aba17fe7 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044232.547776:0:15208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784044232.547786:0:15208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b3965d1c000/0x89871fc3aba17ee4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba17eeb expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044232.547793:0:15208:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b3965d1c000/0x89871fc3aba17ee4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x89871fc3aba17eeb expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044232.547800:0:15208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b3965d1c000/0x89871fc3aba17ee4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x89871fc3aba17eeb expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044232.547806:0:15208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.140@tcp lock: ffff9b3965d1c000/0x89871fc3aba17ee4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x89871fc3aba17eeb expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044232.547835:0:15208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1784044232.547843:0:15208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b3843799200/0x89871fc3aba18280 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba18287 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044232.547850:0:15208:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b3843799200/0x89871fc3aba18280 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x89871fc3aba18287 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044232.547857:0:15208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b3843799200/0x89871fc3aba18280 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x89871fc3aba18287 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044232.547863:0:15208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.140@tcp lock: ffff9b3843799200/0x89871fc3aba18280 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x89871fc3aba18287 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044232.547874:0:15208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1784044232.547879:0:15208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b3965d1de00/0x89871fc3aba17aa0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba17aa7 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044232.547886:0:15208:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b3965d1de00/0x89871fc3aba17aa0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x89871fc3aba17aa7 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044232.547893:0:15208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b3965d1de00/0x89871fc3aba17aa0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x89871fc3aba17aa7 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044232.547899:0:15208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.140@tcp lock: ffff9b3965d1de00/0x89871fc3aba17aa0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x89871fc3aba17aa7 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044232.547907:0:15208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 10000000:01000000:2.0:1784044232.547910:0:15208:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:2.0:1784044232.547951:0:15208:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000020:01000000:2.0:1784044232.547955:0:15208:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:2.0:1784044232.547960:0:15208:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1784044232.547965:0:15208:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 4/9 00010000:00010000:0.0:1784044232.548414:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1784044232.548428:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: ffff9b3982054e00/0x89871fc3aba17fe0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x89871fc3aba17fe7 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044232.548436:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3982054e00 already unused, calling callback (ffffffffc113cc20) 10000000:00010000:0.0:1784044232.548439:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: ffff9b3982054e00/0x89871fc3aba17fe0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x89871fc3aba17fe7 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044232.548448:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9b3982054e00/0x89871fc3aba17fe0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x89871fc3aba17fe7 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784044232.548455:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9b3982054e00/0x89871fc3aba17fe0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x89871fc3aba17fe7 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784044232.548460:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1784044232.548462:0:6500:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 10000000:01000000:0.0:1784044232.548465:0:6500:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 00010000:00010000:0.0:1784044232.548506:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.140@tcp lock: ffff9b3982054e00/0x89871fc3aba17fe0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x89871fc3aba17fe7 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044232.548512:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784044232.548538:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: ffff9b3982054e00/0x89871fc3aba17fe0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x89871fc3aba17fe7 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044232.548545:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9b3982054e00/0x89871fc3aba17fe0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x89871fc3aba17fe7 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044232.548562:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1784044232.548565:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: ffff9b3965d1c000/0x89871fc3aba17ee4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x89871fc3aba17eeb expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044232.548571:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3965d1c000 already unused, calling callback (ffffffffc113cc20) 10000000:00010000:0.0:1784044232.548580:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: ffff9b3965d1c000/0x89871fc3aba17ee4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x89871fc3aba17eeb expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044232.548587:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9b3965d1c000/0x89871fc3aba17ee4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x89871fc3aba17eeb expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784044232.548594:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9b3965d1c000/0x89871fc3aba17ee4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x89871fc3aba17eeb expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784044232.548599:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:0.0:1784044232.548601:0:6500:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:0.0:1784044232.548603:0:6500:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:0.0:1784044232.548617:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.140@tcp lock: ffff9b3965d1c000/0x89871fc3aba17ee4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x89871fc3aba17eeb expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044232.548622:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784044232.548628:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: ffff9b3965d1c000/0x89871fc3aba17ee4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x89871fc3aba17eeb expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044232.548634:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9b3965d1c000/0x89871fc3aba17ee4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x89871fc3aba17eeb expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044232.548656:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1784044232.548660:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: ffff9b3843799200/0x89871fc3aba18280 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x89871fc3aba18287 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044232.548665:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3843799200 already unused, calling callback (ffffffffc113cc20) 10000000:00010000:0.0:1784044232.548668:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: ffff9b3843799200/0x89871fc3aba18280 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x89871fc3aba18287 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044232.548674:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9b3843799200/0x89871fc3aba18280 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x89871fc3aba18287 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784044232.548686:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9b3843799200/0x89871fc3aba18280 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x89871fc3aba18287 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784044232.548691:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1784044232.548693:0:6500:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1784044232.548695:0:6500:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1784044232.548709:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.140@tcp lock: ffff9b3843799200/0x89871fc3aba18280 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x89871fc3aba18287 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044232.548714:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784044232.548731:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: ffff9b3843799200/0x89871fc3aba18280 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x89871fc3aba18287 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044232.548737:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9b3843799200/0x89871fc3aba18280 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x89871fc3aba18287 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044232.548747:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784044232.548750:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: ffff9b3965d1de00/0x89871fc3aba17aa0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x89871fc3aba17aa7 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044232.548756:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3965d1de00 already unused, calling callback (ffffffffc113cc20) 10000000:00010000:0.0:1784044232.548759:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: ffff9b3965d1de00/0x89871fc3aba17aa0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x89871fc3aba17aa7 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044232.548764:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9b3965d1de00/0x89871fc3aba17aa0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x89871fc3aba17aa7 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784044232.548769:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9b3965d1de00/0x89871fc3aba17aa0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x89871fc3aba17aa7 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784044232.548784:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:0.0:1784044232.548787:0:6500:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:0.0:1784044232.548789:0:6500:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:0.0:1784044232.548801:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.140@tcp lock: ffff9b3965d1de00/0x89871fc3aba17aa0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x89871fc3aba17aa7 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044232.548807:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784044232.548812:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: ffff9b3965d1de00/0x89871fc3aba17aa0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x89871fc3aba17aa7 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044232.548819:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9b3965d1de00/0x89871fc3aba17aa0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x89871fc3aba17aa7 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044232.548828:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784044232.548830:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784044232.548831:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784044232.548840:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784044232.548859:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b38436a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:3638:1870705581014784:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784044232.548938:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044232.549006:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784044232.549012:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b38436a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:3638:1870705581014912:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784044232.549034:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044232.549062:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b38436a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:3641:1870705581015168:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784044232.549084:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044232.549101:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784044232.549106:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b38436a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:3641:1870705581015040:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784044232.549126:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044232.549195:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581014784 00000100:00100000:0.0:1784044232.549202:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581014784 00000100:00100000:0.0:1784044232.549252:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581014912 00000100:00100000:0.0:1784044232.549255:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581014912 00000100:00100000:0.0:1784044232.549268:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581015168 00000100:00100000:0.0:1784044232.549269:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581015168 00000100:00100000:0.0:1784044232.549280:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581015040 00000100:00100000:0.0:1784044232.549282:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581015040 00000100:00100000:0.0:1784044232.549295:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1784044232.549303:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38436a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+26:3638:x1870705581014784:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784044232.549315:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784044232.549329:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b39759f8c00/0x89871fc3aba17fe7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x89871fc3aba17fe0 expref: 26 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044232.549341:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784044232.549371:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38436a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+25:3638:x1870705581014784:12345-0@lo:103:ldlm_bl.0 Request processed in 69us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044232.549379:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1784044232.549396:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1784044232.549401:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38436a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+24:3638:x1870705581014912:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784044232.549409:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784044232.549416:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b3982054800/0x89871fc3aba17eeb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x89871fc3aba17ee4 expref: 24 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044232.549425:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784044232.549444:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38436a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+23:3638:x1870705581014912:12345-0@lo:103:ldlm_bl.0 Request processed in 44us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044232.549450:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1784044232.549462:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1784044232.549475:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38436a0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+22:3641:x1870705581015168:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784044232.549482:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784044232.549492:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b3940030200/0x89871fc3aba17aa7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x89871fc3aba17aa0 expref: 22 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044232.549501:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784044232.549527:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38436a0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+21:3641:x1870705581015168:12345-0@lo:103:ldlm_bl.0 Request processed in 53us (441us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044232.549532:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1784044232.549544:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1784044232.549549:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38436a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+20:3641:x1870705581015040:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784044232.549556:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784044232.549565:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b39759f8e00/0x89871fc3aba18287 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x89871fc3aba18280 expref: 20 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044232.549572:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784044232.549593:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38436a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+19:3641:x1870705581015040:12345-0@lo:103:ldlm_bl.0 Request processed in 44us (467us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044232.549599:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1784044232.549632:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b38436a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:3638:1870705581014912:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784044232.549642:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b38436a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:3638:1870705581014784:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784044232.549665:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b38436a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:3641:1870705581015040:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784044232.549671:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b38436a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:3641:1870705581015168:0@lo:103:ldlm_bl.0 00000020:00080000:2.0:1784044232.551380:0:15208:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9b3843441800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1784044232.551392:0:15208:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9b38423b1800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1784044232.551397:0:15208:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9b397b775000 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1784044232.551402:0:15208:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9b3974dad800 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 4294967298 stale:0 00000020:00080000:2.0:1784044232.551408:0:15208:0:(genops.c:1574:class_disconnect_exports()) OBD device 5 (ffff9b39459bcd40) has exports, disconnecting them 00000020:00080000:2.0:1784044232.551413:0:15208:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9b3843441800), last request at 1784044231 00000020:00000080:2.0:1784044232.551420:0:15208:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x89871fc3aba17e51 00000100:00080000:2.0:1784044232.551439:0:15208:0:(import.c:65:import_set_state_nolock()) ffff9b3843443800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1784044232.551498:0:15208:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9b3843441800): rc 0 00000020:00000080:2.0:1784044232.551500:0:15208:0:(genops.c:906:class_export_put()) final put ffff9b3843441800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:2.0:1784044232.551511:0:15208:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9b38423b1800), last request at 1784044231 00000020:00000080:2.0:1784044232.551514:0:15208:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x89871fc3aba17d9b 00000100:00080000:2.0:1784044232.551520:0:15208:0:(import.c:65:import_set_state_nolock()) ffff9b38423b4800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1784044232.551527:0:15208:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9b38423b1800): rc 0 00000020:00000080:2.0:1784044232.551529:0:15208:0:(genops.c:906:class_export_put()) final put ffff9b38423b1800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:2.0:1784044232.551532:0:15208:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9b397b775000), last request at 1784043968 00000020:00000080:2.0:1784044232.551535:0:15208:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x89871fc3aba17c28 00000100:00080000:2.0:1784044232.551538:0:15208:0:(import.c:65:import_set_state_nolock()) ffff9b397b777000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1784044232.551542:0:15208:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9b397b775000): rc 0 00000020:00000080:2.0:1784044232.551544:0:15208:0:(genops.c:906:class_export_put()) final put ffff9b397b775000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:2.0:1784044232.551547:0:15208:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9b3974dad800), last request at 1784043968 00000020:00000080:2.0:1784044232.551550:0:15208:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x89871fc3aba17bf7 00000100:00080000:2.0:1784044232.551552:0:15208:0:(import.c:65:import_set_state_nolock()) ffff9b397b777800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1784044232.551558:0:15208:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967528 00010000:00010000:3.0:1784044232.551768:0:10331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1784044232.551779:0:14129:0:(genops.c:865:class_export_destroy()) destroying export ffff9b3843441800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:3.0:1784044232.551823:0:14129:0:(genops.c:865:class_export_destroy()) destroying export ffff9b38423b1800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1784044232.551847:0:14129:0:(genops.c:865:class_export_destroy()) destroying export ffff9b397b775000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:3.0:1784044232.551869:0:14129:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9b3843443800 for lustre-MDT0000 00000020:00000080:3.0:1784044232.551880:0:14129:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9b38423b4800 for lustre-MDT0000 00000020:00000080:3.0:1784044232.551883:0:14129:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9b397b777000 for lustre-MDT0000 00010000:00010000:3.0:1784044232.551892:0:10330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1784044232.552898:0:15208:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9b3974dad800): rc 0 00000004:00000080:2.0:1784044232.552906:0:15208:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffb73bc1627ae0 00000100:00080000:2.0:1784044232.552928:0:15208:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1784044232.552931:0:15208:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 3 00010000:00010000:0.0:1784044232.554598:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784044232.554607:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1784044232.557837:0:15208:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1784044232.557873:0:15208:0:(import.c:65:import_set_state_nolock()) ffff9b396f3ca000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1784044232.558288:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843734e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1870705581015296:0@lo:39:umount.0 00000100:00100000:3.0:1784044232.558373:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044232.558461:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581015296 00000100:00100000:0.0:1784044232.558470:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581015296 00000100:00100000:0.0:1784044232.558527:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:0.0:1784044232.558537:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3943eb1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1870705581015296:12345-0@lo:39:umount.0 00000020:00000080:0.0:1784044232.558566:0:6517:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x89871fc3aba17c83 00000100:00080000:0.0:1784044232.558575:0:6517:0:(import.c:65:import_set_state_nolock()) ffff9b397590f800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1784044232.558597:0:6517:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967300 00010000:00010000:2.0:1784044232.565624:0:10331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784044232.570048:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3943eb1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+3:3637:x1870705581015296:12345-0@lo:39:umount.0 Request processed in 11501us (11664us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1784044232.570064:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00080000:3.0:1784044232.570441:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9b396f3ca000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1784044232.570451:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843734e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1870705581015296:0@lo:39:umount.0 00000100:00080000:2.0:1784044232.570659:0:15208:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1784044232.570663:0:15208:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 3 00000004:00080000:2.0:1784044232.570677:0:15208:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1784044232.570730:0:15208:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:2.0:1784044232.570753:0:15208:0:(import.c:65:import_set_state_nolock()) ffff9b38423b1000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:2.0:1784044232.570772:0:15208:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1784044232.570774:0:15208:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 3 00000004:00080000:2.0:1784044232.570786:0:15208:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1784044232.570839:0:15208:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:2.0:1784044232.570848:0:15208:0:(import.c:65:import_set_state_nolock()) ffff9b3842127000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:2.0:1784044232.570877:0:15208:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff9b39459bcd40) has no exports 00000100:00100000:3.0:1784044232.571836:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843734000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1870705581015424:0@lo:9:umount.0 00000100:00100000:3.0:1784044232.571909:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044232.572867:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843737800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1870705581015552:0@lo:9:umount.0 00000100:00100000:3.0:1784044232.572903:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000001:00100000:0.0:1784044232.575400:0:7443:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:0.0:1784044232.575415:0:7443:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967301 is committed 00000020:00000080:0.0:1784044232.575420:0:7443:0:(genops.c:906:class_export_put()) final put ffff9b396f25e800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:0.0:1784044232.575441:0:7443:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 68dfcea6-5d83-4dbb-8fa3-e35542d621e5 00000001:00080000:0.0:1784044232.575446:0:7443:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967300 is committed 00000020:00000080:0.0:1784044232.575448:0:7443:0:(genops.c:906:class_export_put()) final put ffff9b397f9b1000/68dfcea6-5d83-4dbb-8fa3-e35542d621e5 00000001:00100000:0.0:1784044232.575454:0:7443:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of a93fdf3c-d42f-420a-95ea-b0cbfe954363 00000001:00080000:0.0:1784044232.575459:0:7443:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967299 is committed 00000020:00000080:0.0:1784044232.575461:0:7443:0:(genops.c:906:class_export_put()) final put ffff9b384345b800/a93fdf3c-d42f-420a-95ea-b0cbfe954363 00000020:00000080:3.0:1784044232.586424:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9b396f25e800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:3.0:1784044232.586504:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9b397f9b1000/68dfcea6-5d83-4dbb-8fa3-e35542d621e5 for lustre-MDT0001 00000020:00000080:3.0:1784044232.586526:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9b384345b800/a93fdf3c-d42f-420a-95ea-b0cbfe954363 for lustre-MDT0001 00000020:00000080:3.0:1784044232.586546:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9b397590f800 for lustre-MDT0001 00000020:00000080:3.0:1784044232.586551:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9b397f9b3800 for lustre-MDT0001 00000020:00000080:3.0:1784044232.586554:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9b384345a000 for lustre-MDT0001 00000100:00100000:2.0:1784044232.598745:0:9822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581015424 00000100:00100000:2.0:1784044232.598761:0:9822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581015424 00000100:00100000:3.0:1784044232.600596:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581015552 00000100:00100000:3.0:1784044232.600610:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581015552 00000100:00100000:3.0:1784044232.600654:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1784044232.600667:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3943eb3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1870705581015424:12345-0@lo:9:umount.0 00000020:00000080:3.0:1784044232.600700:0:8427:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x89871fc3aba17dc5 00000100:00080000:3.0:1784044232.600711:0:8427:0:(import.c:65:import_set_state_nolock()) ffff9b3842091800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1784044232.600756:0:8427:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:3.0:1784044232.600949:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3943eb3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:3637:x1870705581015424:12345-0@lo:9:umount.0 Request processed in 283us (29037us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044232.600976:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1784044232.600994:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1784044232.601000:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3943eb0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1870705581015552:12345-0@lo:9:umount.0 00000020:00000080:3.0:1784044232.601013:0:8427:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x89871fc3aba17f15 00000100:00080000:3.0:1784044232.601018:0:8427:0:(import.c:65:import_set_state_nolock()) ffff9b3843444800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1784044232.601042:0:8427:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:3.0:1784044232.601138:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3943eb0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:3637:x1870705581015552:12345-0@lo:9:umount.0 Request processed in 127us (28223us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044232.601145:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00080000:1.0:1784044232.601332:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1784044232.603085:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784044232.604385:0:10330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1784044232.604449:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9b38423b1000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1784044232.604475:0:3637:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1784044232.604477:0:3637:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1784044232.604484:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843734000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1870705581015424:0@lo:9:umount.0 00000100:00080000:3.0:1784044232.604499:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9b3842127000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1784044232.604509:0:3637:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1784044232.604511:0:3637:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1784044232.604513:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843737800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1870705581015552:0@lo:9:umount.0 00000001:00100000:3.0:1784044232.614693:0:9505:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1784044232.614706:0:9505:0:(genops.c:906:class_export_put()) final put ffff9b3843447000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:3.0:1784044232.614736:0:9505:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of a93fdf3c-d42f-420a-95ea-b0cbfe954363 00000020:00000080:3.0:1784044232.614739:0:9505:0:(genops.c:906:class_export_put()) final put ffff9b3843c36000/a93fdf3c-d42f-420a-95ea-b0cbfe954363 00000020:00000080:0.0:1784044232.614792:0:14129:0:(genops.c:865:class_export_destroy()) destroying export ffff9b3843447000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:0.0:1784044232.614839:0:14129:0:(genops.c:865:class_export_destroy()) destroying export ffff9b3843c36000/a93fdf3c-d42f-420a-95ea-b0cbfe954363 for lustre-OST0001 00000020:00000080:0.0:1784044232.614855:0:14129:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9b3843444800 for lustre-OST0001 00000020:00000080:0.0:1784044232.614860:0:14129:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9b3843c33000 for lustre-OST0001 00000001:00100000:1.0:1784044232.615016:0:8421:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1784044232.615020:0:8421:0:(genops.c:906:class_export_put()) final put ffff9b3842093800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:1.0:1784044232.615040:0:8421:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of a93fdf3c-d42f-420a-95ea-b0cbfe954363 00000020:00000080:1.0:1784044232.615042:0:8421:0:(genops.c:906:class_export_put()) final put ffff9b3944e99000/a93fdf3c-d42f-420a-95ea-b0cbfe954363 00000020:00000080:0.0:1784044232.615086:0:14129:0:(genops.c:865:class_export_destroy()) destroying export ffff9b3842093800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:0.0:1784044232.615105:0:14129:0:(genops.c:865:class_export_destroy()) destroying export ffff9b3944e99000/a93fdf3c-d42f-420a-95ea-b0cbfe954363 for lustre-OST0000 00000020:00000080:0.0:1784044232.615119:0:14129:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9b3842091800 for lustre-OST0000 00000020:00000080:0.0:1784044232.615124:0:14129:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9b3944e99800 for lustre-OST0000 00000020:00080000:0.0:1784044232.621096:0:15208:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff9b39459bcd40) has no exports 00000020:00000080:0.0:1784044232.732582:0:15208:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x89871fc3aba17afb 00000020:00000080:0.0:1784044232.732598:0:15208:0:(genops.c:906:class_export_put()) final put ffff9b397a8e8800/lustre-QMT0000_UUID 00000020:01000000:0.0:1784044232.732618:0:15208:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:1.0:1784044232.732983:0:15208:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1784044232.733000:0:15208:0:(obd_config.c:955:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1784044232.733005:0:15208:0:(genops.c:1579:class_disconnect_exports()) OBD device 7 (ffff9b39440299c0) has no exports 00000020:00000080:3.0:1784044232.734005:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9b397a8e8800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:0.0:1784044232.734757:0:15208:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x89871fc3aba17af4 00000020:00000080:0.0:1784044232.734766:0:15208:0:(genops.c:906:class_export_put()) final put ffff9b397a88f800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1784044232.734815:0:15208:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1784044232.734825:0:15208:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1784044232.734828:0:15208:0:(genops.c:906:class_export_put()) final put ffff9b397a889000/lustre-QMT0000_UUID 00000020:00000080:0.0:1784044232.734831:0:15208:0:(genops.c:865:class_export_destroy()) destroying export ffff9b397a889000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:0.0:1784044232.734838:0:15208:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:3.0:1784044232.735058:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9b397a88f800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:00010000:0.0:1784044233.357479:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784044234.381435:0:10331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784044234.831136:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1784044234.831162:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b38436a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1870705581015680:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1784044234.831268:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044234.831424:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581015680 00000100:00100000:1.0:1784044234.831433:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581015680 00000100:00100000:1.0:1784044234.831499:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:1.0:1784044234.831508:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3943eb1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3639:x1870705581015680:12345-0@lo:41:osp-pre-0-1.0 00000020:00080000:1.0:1784044234.831517:0:6516:0:(tgt_handler.c:807:tgt_request_handle()) operation 41 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1784044234.831566:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3943eb1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3639:x1870705581015680:12345-0@lo:41:osp-pre-0-1.0 Request processed in 57us (297us total) trans 0 rc -107/-107 00000100:00100000:1.0:1784044234.831574:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:02020000:0.0:1784044234.831757:0:3639:0:(client.c:1492:ptlrpc_check_status()) lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 00000100:00080000:0.0:1784044234.851068:0:3639:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1784044234.851078:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9b397b63a000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1784044234.851083:0:3639:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1784044234.893379:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9b397b63a000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1784044234.893395:0:3639:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 161 00000100:00080000:0.0:1784044234.893407:0:3639:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9b397b63a000 using connection 192.168.202.140@tcp/0@lo 00000100:00100000:1.0:1784044234.893522:0:3639:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b397a8a4000 x1870705581015808/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1784044234.893590:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397a8a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1870705581015808:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:3.0:1784044234.893670:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044234.893768:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581015808 00000100:00100000:0.0:1784044234.893776:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581015808 00000100:00100000:0.0:1784044234.893823:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:0.0:1784044234.893832:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3943eb2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3637:x1870705581015808:12345-0@lo:38:ptlrpcd_00_01.0 00010000:02000000:0.0:1784044234.893849:0:6517:0:(ldlm_lib.c:1205:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1784044234.900777:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3943eb2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3637:x1870705581015808:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 6933us (7095us total) trans 0 rc -19/-19 00000100:00100000:2.0:1784044234.900794:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00080000:3.0:1784044234.900911:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9b397b63a000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1784044234.900927:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1784044234.900932:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397a8a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1870705581015808:0@lo:38:ptlrpcd_00_01.0 00010000:00010000:3.0:1784044235.405345:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784044235.854280:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b38436a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1870705581015936:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1784044235.854396:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044235.854764:0:10713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581015936 00000100:00100000:3.0:1784044235.854773:0:10713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581015936 00000100:00100000:3.0:1784044235.854886:0:10713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1784044235.854896:0:10713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397a8a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1870705581015936:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1784044235.854927:0:10713:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1784044235.854991:0:10713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397a8a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1870705581015936:12345-0@lo:13:osp-pre-0-1.0 Request processed in 96us (594us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044235.854999:0:10713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1784044235.855093:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b38436a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1870705581015936:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1784044235.855228:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1784044236.429350:0:10330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784044236.877441:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1784044236.877460:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3943eb3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1870705581016064:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1784044236.877542:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044236.877665:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581016064 00000100:00100000:3.0:1784044236.877675:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581016064 00000100:00100000:3.0:1784044236.877759:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1784044236.877784:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843735180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1870705581016064:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1784044236.877821:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784044236.877871:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843735180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1870705581016064:12345-0@lo:13:osp-pre-1-1.0 Request processed in 104us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044236.877879:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1784044236.877919:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3943eb3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1870705581016064:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1784044236.878077:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784044236.880279:0:14129:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1784044236.880288:0:14129:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1784044236.880292:0:14129:0:(import.c:65:import_set_state_nolock()) ffff9b397b63a000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1784044236.880300:0:14129:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 428 00000100:00080000:0.0:1784044236.880321:0:14129:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1784044236.880330:0:14129:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9b397b63a000 using connection 192.168.202.140@tcp/0@lo 00000100:00100000:2.0:1784044236.880338:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b38436a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:3641:1870705581016192:0@lo:400:kworker.0 00000100:00100000:0.0:1784044236.880354:0:14129:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b38436a1c00 x1870705581016320/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1784044236.880425:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044236.880443:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b38436a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1870705581016320:0@lo:38:kworker.0 00000100:00100000:0.0:1784044236.880451:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b38436a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1870705581016448:0@lo:400:kworker.0 00000100:00100000:2.0:1784044236.880470:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843c57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3641:1870705581016832:0@lo:400:kworker.0 00000100:00100000:1.0:1784044236.880632:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843c56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3640:1870705581016704:0@lo:400:kworker.0 00000100:00100000:3.0:1784044236.888109:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044236.888238:0:7768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581016320 00000100:00100000:3.0:1784044236.888250:0:7768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581016320 00000100:00100000:3.0:1784044236.888296:0:7768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:3.0:1784044236.888303:0:7768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3943eb2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3637:x1870705581016320:12345-0@lo:38:kworker.0 00010000:02000000:3.0:1784044236.888321:0:7768:0:(ldlm_lib.c:1205:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1784044236.889952:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044236.889987:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843c57b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3638:1870705581016960:0@lo:400:kworker.0 00000100:00100000:0.0:1784044236.890015:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044236.890043:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1784044236.890050:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843c55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1870705581016576:0@lo:400:kworker.0 00000100:00100000:0.0:1784044236.890075:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044236.890110:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843c57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3638:1870705581017088:0@lo:400:kworker.0 00000100:00100000:0.0:1784044236.890132:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044236.890171:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581016192 00000100:00100000:0.0:1784044236.890202:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581016192 00000100:00100000:0.0:1784044236.890247:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 433 00000100:00100000:0.0:1784044236.890255:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3950371c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+19:3641:x1870705581016192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784044236.890311:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3950371c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+19:3641:x1870705581016192:12345-0@lo:400:kworker.0 Request processed in 56us (9885us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044236.890334:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 433 00000100:00100000:0.0:1784044236.891403:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581016576 00000100:00100000:0.0:1784044236.891410:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581016576 00000100:00100000:0.0:1784044236.891446:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1784044236.891452:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843c55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1870705581016576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784044236.891493:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843c55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1870705581016576:12345-0@lo:400:kworker.0 Request processed in 42us (1419us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044236.891509:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1784044236.891540:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843c55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1870705581016576:0@lo:400:kworker.0 00000100:00100000:0.0:1784044236.891597:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581016448 00000100:00100000:0.0:1784044236.891647:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581016448 00000100:00100000:0.0:1784044236.891665:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581016960 00000100:00100000:0.0:1784044236.891667:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581016960 00000100:00100000:0.0:1784044236.891674:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581017088 00000100:00100000:0.0:1784044236.891675:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581017088 00000100:00100000:0.0:1784044236.891691:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 417 00000100:00100000:0.0:1784044236.891695:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843c55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1870705581017088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784044236.891720:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843c55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1870705581017088:12345-0@lo:400:kworker.0 Request processed in 25us (1588us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044236.891724:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 417 00000100:00100000:0.0:1784044236.891731:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1784044236.891734:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843c56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3638:x1870705581016448:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1784044236.891737:0:6512:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1784044236.891752:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843c56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3638:x1870705581016448:12345-0@lo:400:kworker.0 Request processed in 17us (1804us total) trans 0 rc -107/-107 00000100:00100000:0.0:1784044236.891755:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1784044236.891760:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:0.0:1784044236.891763:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843c57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3638:x1870705581016960:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1784044236.891765:0:6512:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1784044236.891775:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843c57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3638:x1870705581016960:12345-0@lo:400:kworker.0 Request processed in 11us (1760us total) trans 0 rc -107/-107 00000100:00100000:0.0:1784044236.891778:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00080000:0.0:1784044236.891793:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1784044236.891806:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b3843c57480 x1870705581017088/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044252 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784044236.891819:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843c57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3638:1870705581017088:0@lo:400:kworker.0 00000100:00080000:0.0:1784044236.891829:0:3638:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1784044236.891833:0:3638:0:(import.c:65:import_set_state_nolock()) ffff9b397585d000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1784044236.891836:0:3638:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:2.0:1784044236.895312:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044236.895530:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b38436a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:3641:1870705581016192:0@lo:400:kworker.0 00000100:00100000:2.0:1784044236.895824:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581016832 00000100:00100000:2.0:1784044236.895832:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581016832 00000100:00100000:2.0:1784044236.895899:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 418 00000100:00100000:2.0:1784044236.895908:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843737800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1870705581016832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784044236.895965:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843737800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1870705581016832:12345-0@lo:400:kworker.0 Request processed in 57us (663us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044236.895972:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 418 00000100:00080000:2.0:1784044236.895998:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:2.0:1784044236.896374:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b3843c57100 x1870705581016832/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044252 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784044236.896386:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843c57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3641:1870705581016832:0@lo:400:kworker.0 00000100:00100000:1.0:1784044236.904223:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044236.905680:0:9501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581016704 00000100:00100000:2.0:1784044236.905698:0:9501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581016704 00000100:00100000:3.0:1784044236.906443:0:7768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3943eb2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3637:x1870705581016320:12345-0@lo:38:kworker.0 Request processed in 18134us (18337us total) trans 0 rc -19/-19 00000100:00100000:3.0:1784044236.906456:0:7768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00080000:3.0:1784044236.906577:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9b397b63a000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1784044236.906584:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1784044236.906588:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b38436a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1870705581016320:0@lo:38:kworker.0 00000100:00100000:2.0:1784044236.909011:0:9501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1784044236.909025:0:9501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397a8a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3640:x1870705581016704:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1784044236.909038:0:9501:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1784044236.909238:0:9501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397a8a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3640:x1870705581016704:12345-0@lo:400:kworker.0 Request processed in 213us (5021us total) trans 0 rc -107/-107 00000100:00100000:2.0:1784044236.909247:0:9501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00080000:3.0:1784044236.910676:0:3640:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1784044236.910683:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9b3974da9800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1784044236.910687:0:3640:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1784044236.910693:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9b3974da9800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784044236.910697:0:3640:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 183 00000100:00080000:3.0:1784044236.910705:0:3640:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9b3974da9800 using connection 192.168.202.140@tcp/0@lo 00000100:00100000:3.0:1784044236.910745:0:3640:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b3943eb3480 x1870705581017216/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1784044236.910773:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843c56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3640:1870705581016704:0@lo:400:kworker.0 00000100:00100000:3.0:1784044236.910821:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3943eb3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3637:1870705581017216:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:3.0:1784044236.911274:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044236.912391:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581017216 00000100:00100000:1.0:1784044236.912400:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581017216 00000100:00100000:1.0:1784044236.912451:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1784044236.912466:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3943eb3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3637:x1870705581017216:12345-0@lo:38:ptlrpcd_00_02.0 00010000:02000000:1.0:1784044236.912485:0:6511:0:(ldlm_lib.c:1205:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1784044236.912674:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3943eb3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3637:x1870705581017216:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 203us (1390us total) trans 0 rc -19/-19 00000100:00100000:1.0:1784044236.912683:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00080000:1.0:1784044236.912731:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9b3974da9800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1784044236.912736:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1784044236.912740:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3943eb3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3637:1870705581017216:0@lo:38:ptlrpcd_00_02.0 00000100:00080000:0.0:1784044236.937439:0:3638:0:(import.c:65:import_set_state_nolock()) ffff9b397585d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1784044236.937453:0:3638:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 161 00000100:00080000:0.0:1784044236.937473:0:3638:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9b397585d000 using connection 192.168.202.140@tcp/0@lo 00000100:00100000:1.0:1784044236.938716:0:3638:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b397a8a5f80 x1870705581017344/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1784044236.938817:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397a8a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3637:1870705581017344:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:3.0:1784044236.938917:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044236.939232:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b38436a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1870705581016448:0@lo:400:kworker.0 00000100:00080000:1.0:1784044236.939274:0:3638:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1784044236.939279:0:3638:0:(import.c:65:import_set_state_nolock()) ffff9b384345d800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1784044236.939283:0:3638:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1784044236.939288:0:3638:0:(import.c:65:import_set_state_nolock()) ffff9b384345d800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784044236.939291:0:3638:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 203 00000100:00080000:1.0:1784044236.939298:0:3638:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9b384345d800 using connection 192.168.202.140@tcp/0@lo 00000100:00100000:1.0:1784044236.939316:0:3638:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b397a8a5180 x1870705581017472/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1784044236.939380:0:13808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581017344 00000100:00100000:2.0:1784044236.939388:0:13808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581017344 00000100:00100000:2.0:1784044236.939452:0:13808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:2.0:1784044236.939468:0:13808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3943eb0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3637:x1870705581017344:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:2.0:1784044236.939486:0:13808:0:(ldlm_lib.c:1205:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1784044236.952710:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397a8a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3637:1870705581017472:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:3.0:1784044236.953374:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044236.953614:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581017472 00000100:00100000:0.0:1784044236.953623:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581017472 00000100:00100000:0.0:1784044236.953680:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:0.0:1784044236.953689:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3943eb3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3637:x1870705581017472:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:0.0:1784044236.953708:0:6511:0:(ldlm_lib.c:1205:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1784044236.954120:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3943eb3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3637:x1870705581017472:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 429us (745us total) trans 0 rc -19/-19 00000100:00100000:0.0:1784044236.954128:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:1.0:1784044236.954277:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843c57b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3638:1870705581016960:0@lo:400:kworker.0 00000100:00100000:2.0:1784044236.963738:0:13808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3943eb0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3637:x1870705581017344:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 24266us (24809us total) trans 0 rc -19/-19 00000100:00100000:2.0:1784044236.963755:0:13808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00080000:3.0:1784044236.968623:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9b397585d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1784044236.968636:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1784044236.968641:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397a8a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3637:1870705581017344:0@lo:38:ptlrpcd_00_00.0 00000100:00080000:3.0:1784044236.969418:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9b384345d800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1784044236.969426:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1784044236.969431:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397a8a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3637:1870705581017472:0@lo:38:ptlrpcd_00_00.0 00000040:00080000:3.0:1784044237.262386:0:13804:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1784044237.459641:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784044238.477443:0:10331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1784044238.927638:0:6490:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1784044238.927650:0:6490:0:(genops.c:906:class_export_put()) final put ffff9b3974dad800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1784044238.928216:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9b3974dad800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:3.0:1784044238.928289:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9b397b777800 for lustre-MDT0000 00010000:00010000:3.0:1784044239.501459:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784044240.525328:0:10330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784044240.973921:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397a8a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1870705581017600:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1784044240.974043:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044240.974433:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581017600 00000100:00100000:1.0:1784044240.974443:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581017600 00000100:00100000:1.0:1784044240.974505:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1784044240.974514:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3945930380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1870705581017600:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1784044240.974550:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1784044240.974605:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3945930380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1870705581017600:12345-0@lo:13:osp-pre-0-1.0 Request processed in 92us (564us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044240.974613:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00080000:3.0:1784044240.974948:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784044240.974991:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397a8a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1870705581017600:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1784044241.549763:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784044241.997703:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843734000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1870705581017728:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1784044241.997773:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1784044241.997938:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1784044241.997943:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00100000:0.0:1784044241.998082:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3945930700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:3638:1870705581017856:0@lo:400:kworker.0 00000100:00100000:0.0:1784044241.998119:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044241.998170:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581017856 00000100:00100000:0.0:1784044241.998216:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581017856 00000100:00100000:0.0:1784044241.998266:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 434 00000100:00100000:0.0:1784044241.998274:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3950372c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+19:3638:x1870705581017856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784044241.998325:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3950372c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+19:3638:x1870705581017856:12345-0@lo:400:kworker.0 Request processed in 51us (204us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044241.998332:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 434 00000100:00100000:0.0:1784044241.998376:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3945930700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:3638:1870705581017856:0@lo:400:kworker.0 00000100:00100000:2.0:1784044241.998582:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581017728 00000100:00100000:2.0:1784044241.998588:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581017728 00000100:00100000:2.0:1784044241.998637:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1784044241.998644:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843c55180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1870705581017728:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1784044241.998668:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784044241.998706:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843c55180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1870705581017728:12345-0@lo:13:osp-pre-1-1.0 Request processed in 63us (932us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044241.998711:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1784044241.998738:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843734000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1870705581017728:0@lo:13:osp-pre-1-1.0 00000100:00080000:3.0:1784044241.999658:0:37:0:(import.c:65:import_set_state_nolock()) ffff9b397b63a000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784044241.999705:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1784044242.007097:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 430 00000100:00080000:3.0:1784044242.007106:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1784044242.007114:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9b397b63a000 using connection 192.168.202.140@tcp/0@lo 00000100:00100000:3.0:1784044242.007187:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b3945930700 x1870705581017984/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1784044242.007364:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1784044242.007369:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1784044242.007372:0:37:0:(import.c:65:import_set_state_nolock()) ffff9b397585d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784044242.007376:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 430 00000100:00080000:3.0:1784044242.007379:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1784044242.007383:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9b397585d000 using connection 192.168.202.140@tcp/0@lo 00000100:00100000:3.0:1784044242.007398:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b3843ce6300 x1870705581018112/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1784044242.007441:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1784044242.007445:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1784044242.007446:0:37:0:(import.c:65:import_set_state_nolock()) ffff9b3974da9800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784044242.007450:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 430 00000100:00080000:3.0:1784044242.007453:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1784044242.007456:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9b3974da9800 using connection 192.168.202.140@tcp/0@lo 00000100:00100000:3.0:1784044242.007469:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b3843ce5f80 x1870705581018368/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1784044242.007497:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1784044242.007501:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1784044242.007503:0:37:0:(import.c:65:import_set_state_nolock()) ffff9b384345d800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784044242.007506:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 430 00000100:00080000:3.0:1784044242.007508:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1784044242.007511:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9b384345d800 using connection 192.168.202.140@tcp/0@lo 00000100:00100000:3.0:1784044242.007523:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b3843ce4a80 x1870705581018624/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1784044242.007580:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843ce6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3641:1870705581018752:0@lo:400:kworker.0 00000100:00100000:3.0:1784044242.007644:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044242.007682:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1784044242.007688:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843ce5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3641:1870705581018496:0@lo:400:kworker.0 00000100:00100000:3.0:1784044242.007708:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044242.007738:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581018752 00000100:00100000:3.0:1784044242.007745:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581018752 00000100:00100000:3.0:1784044242.007803:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581018496 00000100:00100000:3.0:1784044242.007806:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581018496 00000100:00100000:3.0:1784044242.007835:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 419 00000100:00100000:3.0:1784044242.007843:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843ce4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1870705581018752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044242.008314:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843ce4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1870705581018752:12345-0@lo:400:kworker.0 Request processed in 470us (668us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044242.008322:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 419 00000100:00100000:3.0:1784044242.008339:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 420 00000100:00100000:3.0:1784044242.008346:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843ce5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1870705581018496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044242.008374:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843ce5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1870705581018496:12345-0@lo:400:kworker.0 Request processed in 29us (664us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044242.008379:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 420 00010000:00080000:3.0:1784044242.008415:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b3843ce5180 x1870705581018496/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044258 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784044242.008427:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843ce5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3641:1870705581018496:0@lo:400:kworker.0 00010000:00080000:3.0:1784044242.008436:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b3843ce6680 x1870705581018752/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044258 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784044242.008445:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843ce6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3641:1870705581018752:0@lo:400:kworker.0 00000100:00100000:2.0:1784044242.008561:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784044242.008574:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843ce7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1870705581018240:0@lo:400:kworker.0 00000100:00100000:2.0:1784044242.008607:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044242.009327:0:9822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581018240 00000100:00100000:3.0:1784044242.009333:0:9822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581018240 00000100:00100000:3.0:1784044242.009384:0:9822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1784044242.009391:0:9822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843734000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3638:x1870705581018240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044242.009440:0:9822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843734000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3638:x1870705581018240:12345-0@lo:400:kworker.0 Request processed in 49us (832us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044242.009447:0:9822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1784044242.009480:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843ce7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1870705581018240:0@lo:400:kworker.0 00000100:00080000:1.0:1784044242.009566:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1784044242.009571:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1784044242.009584:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3945930700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1870705581017984:0@lo:38:kworker.0 00000100:00100000:1.0:1784044242.009619:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044242.009656:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843ce6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3637:1870705581018112:0@lo:38:kworker.0 00000100:00100000:1.0:1784044242.009681:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044242.009696:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843ce5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3637:1870705581018368:0@lo:38:kworker.0 00000100:00100000:1.0:1784044242.009718:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044242.009733:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843ce4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3637:1870705581018624:0@lo:38:kworker.0 00000100:00100000:1.0:1784044242.009752:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044242.009792:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581018112 00000100:00100000:1.0:1784044242.009797:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581018112 00000100:00100000:1.0:1784044242.009825:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581018368 00000100:00100000:1.0:1784044242.009828:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581018368 00000100:00100000:1.0:1784044242.009837:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581018624 00000100:00100000:1.0:1784044242.009840:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581018624 00000100:00100000:1.0:1784044242.009851:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:1.0:1784044242.009856:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397a8a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3637:x1870705581018112:12345-0@lo:38:kworker.0 00010000:02000000:1.0:1784044242.009871:0:6511:0:(ldlm_lib.c:1205:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1784044242.011113:0:13808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:2.0:1784044242.011125:0:13808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397a8a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3637:x1870705581018368:12345-0@lo:38:kworker.0 00010000:02000000:2.0:1784044242.011152:0:13808:0:(ldlm_lib.c:1205:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1784044242.011402:0:13808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397a8a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3637:x1870705581018368:12345-0@lo:38:kworker.0 Request processed in 276us (1681us total) trans 0 rc -19/-19 00000100:00100000:2.0:1784044242.011411:0:13808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:2.0:1784044242.011447:0:13808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:2.0:1784044242.011452:0:13808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397a8a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3637:x1870705581018624:12345-0@lo:38:kworker.0 00010000:02000000:2.0:1784044242.011461:0:13808:0:(ldlm_lib.c:1205:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1784044242.011488:0:13808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397a8a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3637:x1870705581018624:12345-0@lo:38:kworker.0 Request processed in 34us (1735us total) trans 0 rc -19/-19 00000100:00100000:2.0:1784044242.011494:0:13808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00080000:2.0:1784044242.011533:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9b3974da9800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1784044242.011538:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1784044242.011542:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843ce5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3637:1870705581018368:0@lo:38:kworker.0 00000100:00080000:2.0:1784044242.011562:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9b384345d800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1784044242.011566:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1784044242.011569:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843ce4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3637:1870705581018624:0@lo:38:kworker.0 00000100:00100000:3.0:1784044242.011742:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581017984 00000100:00100000:3.0:1784044242.011749:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581017984 00000100:00100000:3.0:1784044242.011796:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1784044242.011801:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397a8a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3637:x1870705581017984:12345-0@lo:38:kworker.0 00010000:02000000:3.0:1784044242.012345:0:6516:0:(ldlm_lib.c:1205:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1784044242.012386:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397a8a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3637:x1870705581017984:12345-0@lo:38:kworker.0 Request processed in 584us (2766us total) trans 0 rc -19/-19 00000100:00100000:3.0:1784044242.012394:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00080000:0.0:1784044242.012859:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9b397b63a000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1784044242.012864:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1784044242.012868:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3945930700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1870705581017984:0@lo:38:kworker.0 00000100:00100000:1.0:1784044242.025612:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397a8a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3637:x1870705581018112:12345-0@lo:38:kworker.0 Request processed in 15744us (15920us total) trans 0 rc -19/-19 00000100:00100000:1.0:1784044242.025628:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00080000:3.0:1784044242.026341:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9b397585d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1784044242.026349:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1784044242.026353:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843ce6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3637:1870705581018112:0@lo:38:kworker.0 00010000:00010000:2.0:1784044242.574555:0:10331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784044243.601972:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784044244.621356:0:10330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784044245.646690:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784044246.093930:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784044246.093949:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397a8a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1870705581018880:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1784044246.094049:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044246.094408:0:10713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581018880 00000100:00100000:2.0:1784044246.094418:0:10713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581018880 00000100:00100000:2.0:1784044246.094569:0:10713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00080000:1.0:1784044246.094823:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784044246.095291:0:10713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843c55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1870705581018880:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1784044246.095336:0:10713:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1784044246.095411:0:10713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843c55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1870705581018880:12345-0@lo:13:osp-pre-0-1.0 Request processed in 833us (1361us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044246.095419:0:10713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1784044246.096374:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397a8a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1870705581018880:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1784044246.669743:0:10331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:02000400:0.0:1784044247.117433:0:15208:0:(genops.c:1873:obd_exports_barrier()) lustre-MDT0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? 00000100:00100000:3.0:1784044247.121803:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843737480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1870705581019008:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1784044247.121905:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044247.122008:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581019008 00000100:00100000:3.0:1784044247.122017:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581019008 00000100:00100000:3.0:1784044247.122088:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1784044247.122113:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843ce6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1870705581019008:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1784044247.122163:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784044247.122228:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843ce6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1870705581019008:12345-0@lo:13:osp-pre-1-1.0 Request processed in 118us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044247.122236:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00080000:3.0:1784044247.122259:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784044247.122293:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843737480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1870705581019008:0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1784044247.125846:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1784044247.125852:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1784044247.125856:0:37:0:(import.c:65:import_set_state_nolock()) ffff9b397b63a000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784044247.125864:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 435 00000100:00080000:2.0:1784044247.125899:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1784044247.125908:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9b397b63a000 using connection 192.168.202.140@tcp/0@lo 00000100:00100000:2.0:1784044247.125937:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b3843736a00 x1870705581019264/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1784044247.125953:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1784044247.125957:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1784044247.125959:0:37:0:(import.c:65:import_set_state_nolock()) ffff9b397585d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784044247.125963:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 435 00000100:00080000:2.0:1784044247.125965:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1784044247.125968:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9b397585d000 using connection 192.168.202.140@tcp/0@lo 00000100:00100000:2.0:1784044247.125979:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b3843735f80 x1870705581019392/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1784044247.126005:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1784044247.126008:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1784044247.126010:0:37:0:(import.c:65:import_set_state_nolock()) ffff9b3974da9800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784044247.126014:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 435 00000100:00080000:2.0:1784044247.126017:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1784044247.126021:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9b3974da9800 using connection 192.168.202.140@tcp/0@lo 00000100:00100000:2.0:1784044247.126032:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b38436a1880 x1870705581019648/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1784044247.126068:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1784044247.126072:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1784044247.126074:0:37:0:(import.c:65:import_set_state_nolock()) ffff9b384345d800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784044247.126078:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 435 00000100:00080000:2.0:1784044247.126086:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00100000:1.0:1784044247.126364:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843737480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1870705581019520:0@lo:400:kworker.0 00000100:00100000:1.0:1784044247.126437:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044247.126491:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1784044247.126497:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843735c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:3641:1870705581019136:0@lo:400:kworker.0 00000100:00100000:1.0:1784044247.126532:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044247.126592:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581019520 00000100:00100000:1.0:1784044247.126599:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581019520 00000100:00100000:1.0:1784044247.126648:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1784044247.126657:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397a8a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1870705581019520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044247.126723:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397a8a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1870705581019520:12345-0@lo:400:kworker.0 Request processed in 67us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044247.126731:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1784044247.126773:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843737480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1870705581019520:0@lo:400:kworker.0 00000100:00100000:3.0:1784044247.126875:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843736a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1870705581019264:0@lo:38:kworker.0 00000100:00100000:3.0:1784044247.126962:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044247.127003:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b38436a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1870705581019776:0@lo:400:kworker.0 00000100:00100000:1.0:1784044247.127049:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:0.0:1784044247.132631:0:15208:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9b384358a2a0 - data ffff9b395d6fd000/ffff9b397f9a1800 00000020:01000000:0.0:1784044247.132861:0:15208:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9b3942f70960 - data ffff9b395d4aeca8/ffff9b397a842000 00000100:00080000:2.0:1784044247.133237:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9b384345d800 using connection 192.168.202.140@tcp/0@lo 00000100:00100000:2.0:1784044247.133290:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b38436a0000 x1870705581019904/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1784044247.133369:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581019136 00000100:00100000:2.0:1784044247.133378:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581019136 00000100:00100000:0.0:1784044247.133756:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 435 00000100:00100000:0.0:1784044247.133769:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3970ede850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+19:3641:x1870705581019136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784044247.133861:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3970ede850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9+19:3641:x1870705581019136:12345-0@lo:400:kworker.0 Request processed in 96us (7334us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044247.133869:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 435 00000100:00100000:0.0:1784044247.133949:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843735c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:3641:1870705581019136:0@lo:400:kworker.0 00000100:00100000:0.0:1784044247.134019:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3975b7c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3639:1870705581020032:0@lo:400:kworker.0 00000100:00100000:3.0:1784044247.137508:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843735f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3637:1870705581019392:0@lo:38:kworker.0 00000100:00100000:2.0:1784044247.138209:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581019264 00000100:00100000:2.0:1784044247.138218:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581019264 00000100:00100000:2.0:1784044247.138257:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:2.0:1784044247.138265:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843ce7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3637:x1870705581019264:12345-0@lo:38:kworker.0 00010000:02000000:2.0:1784044247.138283:0:6517:0:(ldlm_lib.c:1205:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1784044247.141060:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044247.144075:0:13808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581019776 00000100:00100000:3.0:1784044247.144091:0:13808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581019776 00000100:00100000:3.0:1784044247.144230:0:13808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 421 00000100:00100000:3.0:1784044247.144244:0:13808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397a8a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1870705581019776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044247.144411:0:13808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397a8a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1870705581019776:12345-0@lo:400:kworker.0 Request processed in 172us (17361us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044247.144419:0:13808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 421 00000100:00080000:1.0:1784044247.144626:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1784044247.144670:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b38436a1c00 x1870705581019776/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044263 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784044247.144687:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b38436a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1870705581019776:0@lo:400:kworker.0 00000100:00100000:2.0:1784044247.145540:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843ce7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3637:x1870705581019264:12345-0@lo:38:kworker.0 Request processed in 7272us (18574us total) trans 0 rc -19/-19 00000100:00100000:2.0:1784044247.145553:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:2.0:1784044247.146503:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581020032 00000100:00100000:2.0:1784044247.146514:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581020032 00000100:00100000:2.0:1784044247.146582:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 422 00000100:00100000:2.0:1784044247.146592:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843c56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1870705581020032:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1784044247.146841:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1784044247.150377:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044247.150443:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b38436a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3637:1870705581019648:0@lo:38:kworker.0 00000100:00100000:1.0:1784044247.150504:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044247.150537:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b38436a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3637:1870705581019904:0@lo:38:kworker.0 00000100:00100000:1.0:1784044247.150579:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1784044247.150620:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9b397b63a000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1784044247.150625:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1784044247.150629:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843736a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1870705581019264:0@lo:38:kworker.0 00000100:00100000:3.0:1784044247.151246:0:13808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581019392 00000100:00100000:3.0:1784044247.151254:0:13808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581019392 00000100:00100000:3.0:1784044247.151302:0:13808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581019648 00000100:00100000:3.0:1784044247.151306:0:13808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581019648 00000100:00100000:3.0:1784044247.151316:0:13808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581019904 00000100:00100000:3.0:1784044247.151319:0:13808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581019904 00000100:00100000:3.0:1784044247.151332:0:13808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:3.0:1784044247.151340:0:13808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397a8a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3637:x1870705581019392:12345-0@lo:38:kworker.0 00010000:02000000:3.0:1784044247.151358:0:13808:0:(ldlm_lib.c:1205:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1784044247.151422:0:13808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397a8a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3637:x1870705581019392:12345-0@lo:38:kworker.0 Request processed in 80us (1051us total) trans 0 rc -19/-19 00000100:00100000:3.0:1784044247.151430:0:13808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:3.0:1784044247.151448:0:13808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:3.0:1784044247.151452:0:13808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397a8a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3637:x1870705581019648:12345-0@lo:38:kworker.0 00010000:02000000:3.0:1784044247.151459:0:13808:0:(ldlm_lib.c:1205:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1784044247.151484:0:13808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397a8a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3637:x1870705581019648:12345-0@lo:38:kworker.0 Request processed in 30us (979us total) trans 0 rc -19/-19 00000100:00100000:3.0:1784044247.151490:0:13808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:3.0:1784044247.151501:0:13808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:3.0:1784044247.151505:0:13808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397a8a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3637:x1870705581019904:12345-0@lo:38:kworker.0 00010000:02000000:3.0:1784044247.151511:0:13808:0:(ldlm_lib.c:1205:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1784044247.151534:0:13808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397a8a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3637:x1870705581019904:12345-0@lo:38:kworker.0 Request processed in 27us (955us total) trans 0 rc -19/-19 00000100:00100000:3.0:1784044247.151539:0:13808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00080000:1.0:1784044247.152962:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9b384345d800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1784044247.152971:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1784044247.152975:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b38436a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3637:1870705581019904:0@lo:38:kworker.0 00000100:00080000:1.0:1784044247.153003:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9b397585d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1784044247.153007:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1784044247.153023:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843735f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3637:1870705581019392:0@lo:38:kworker.0 00000100:00080000:1.0:1784044247.153038:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9b3974da9800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1784044247.153042:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1784044247.153044:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b38436a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3637:1870705581019648:0@lo:38:kworker.0 00000100:00100000:2.0:1784044247.155255:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843c56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1870705581020032:12345-0@lo:400:kworker.0 Request processed in 8656us (14194us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044247.155269:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 422 00010000:00080000:1.0:1784044247.156138:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b3975b7c380 x1870705581020032/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044263 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784044247.156153:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3975b7c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3639:1870705581020032:0@lo:400:kworker.0 00000001:00000004:0.0:1784044247.157961:0:15208:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967528 00000100:00080000:3.0:1784044247.231365:0:15208:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1784044247.231374:0:15208:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 4 00000100:00100000:3.0:1784044247.231390:0:15208:0:(client.c:3150:ptlrpc_free_committed()) @@@ free request with old gen req@ffff9b3843734e00 x1870705581015296/t4294967301(4294967301) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1784044242 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784044247.231416:0:15208:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:1.0:1784044247.233038:0:15208:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1784044247.233045:0:15208:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 4 00000004:00080000:1.0:1784044247.233065:0:15208:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1784044247.233068:0:15208:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1784044247.234084:0:8449:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1784044247.234090:0:8449:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 8 count 1 00000040:00080000:3.0:1784044247.234100:0:8449:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:0.0:1784044247.236072:0:15208:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1784044247.236080:0:15208:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 4 00000004:00080000:0.0:1784044247.236310:0:15208:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1784044247.236314:0:15208:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1784044247.237139:0:9820:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1784044247.237144:0:9820:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 5 count 1 00000040:00080000:1.0:1784044247.237154:0:9820:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:3.0:1784044247.240638:0:15208:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x89871fc3aba17ac3 00000020:00000080:3.0:1784044247.240650:0:15208:0:(genops.c:906:class_export_put()) final put ffff9b39741cc800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1784044247.241106:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9b39741cc800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1784044247.250806:0:15208:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x89871fc3aba17ad8 00000020:00000080:3.0:1784044247.250821:0:15208:0:(genops.c:906:class_export_put()) final put ffff9b39459d0000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1784044247.250882:0:15208:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:3.0:1784044247.251034:0:15208:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1784044247.251061:0:15208:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1784044247.251066:0:15208:0:(genops.c:1579:class_disconnect_exports()) OBD device 4 (ffff9b39459b99c0) has no exports 00000004:01000000:3.0:1784044247.251282:0:15208:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:3.0:1784044247.251490:0:15208:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x89871fc3aba17f0e 00000020:00000080:3.0:1784044247.251497:0:15208:0:(genops.c:906:class_export_put()) final put ffff9b3843440000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1784044247.253575:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9b39459d0000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:3.0:1784044247.253849:0:15208:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:3.0:1784044247.253873:0:15208:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1784044247.253903:0:15208:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1784044247.253909:0:15208:0:(genops.c:1579:class_disconnect_exports()) OBD device 28 (ffff9b3842454d40) has no exports 00000020:00000080:3.0:1784044247.253920:0:15208:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x89871fc3aba17f07 00000020:00000080:3.0:1784044247.253928:0:15208:0:(genops.c:906:class_export_put()) final put ffff9b3842120800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1784044247.254520:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9b3843440000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00010000:01000000:3.0:1784044247.255117:0:15208:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:3.0:1784044247.255123:0:15208:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1784044247.255128:0:15208:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 5 00000004:00080000:3.0:1784044247.255136:0:15208:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1784044247.255138:0:15208:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1784044247.255846:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9b3842120800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1784044247.256079:0:15208:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1784044247.256094:0:15208:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1784044247.256104:0:15208:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x89871fc3aba17d5c 00000020:00000080:3.0:1784044247.256113:0:15208:0:(genops.c:906:class_export_put()) final put ffff9b3842095800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1784044247.256691:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9b3842127000 for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1784044247.256700:0:37:0:(genops.c:906:class_export_put()) final put ffff9b3843445800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1784044247.256703:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9b3843445800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:0.0:1784044247.256708:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1784044247.257051:0:15208:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:3.0:1784044247.257057:0:15208:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1784044247.257065:0:15208:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1784044247.257070:0:15208:0:(genops.c:1579:class_disconnect_exports()) OBD device 20 (ffff9b38421119c0) has no exports 00000020:00000080:3.0:1784044247.257079:0:15208:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x89871fc3aba17d55 00000020:00000080:3.0:1784044247.257084:0:15208:0:(genops.c:906:class_export_put()) final put ffff9b38423b6000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1784044247.257503:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9b3842095800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1784044247.257649:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9b38423b6000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:3.0:1784044247.258878:0:15208:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:3.0:1784044247.258885:0:15208:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1784044247.258890:0:15208:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 5 00000004:00080000:3.0:1784044247.258910:0:15208:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1784044247.258912:0:15208:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1784044247.258959:0:15208:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1784044247.258981:0:15208:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:3.0:1784044247.259006:0:15208:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:3.0:1784044247.259015:0:15208:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x89871fc3aba17c7c 00000020:00000080:3.0:1784044247.259022:0:15208:0:(genops.c:906:class_export_put()) final put ffff9b39703c5000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1784044247.259042:0:15208:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:3.0:1784044247.259046:0:15208:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1784044247.259051:0:15208:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1784044247.259054:0:15208:0:(genops.c:1579:class_disconnect_exports()) OBD device 15 (ffff9b394402cd40) has no exports 00000020:00000080:3.0:1784044247.259061:0:15208:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x89871fc3aba17c75 00000020:00000080:3.0:1784044247.259064:0:15208:0:(genops.c:906:class_export_put()) final put ffff9b396f3ce000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1784044247.260933:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9b38423b1000 for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1784044247.260947:0:37:0:(genops.c:906:class_export_put()) final put ffff9b3974da8000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1784044247.260950:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9b3974da8000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:0.0:1784044247.260958:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1784044247.261063:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9b39703c5000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:0.0:1784044247.261070:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9b396f3ce000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:3.0:1784044247.284683:0:15208:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:3.0:1784044247.284693:0:15208:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1784044247.284697:0:15208:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 5 00000100:00100000:3.0:1784044247.284706:0:15208:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1784044247.284856:0:15208:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1784044247.284871:0:15208:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1784044247.285032:0:15208:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1784044247.285037:0:15208:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1784044247.285044:0:15208:0:(genops.c:906:class_export_put()) final put ffff9b39741ca800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1784044247.285049:0:15208:0:(genops.c:865:class_export_destroy()) destroying export ffff9b39741ca800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:3.0:1784044247.285067:0:15208:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1784044247.285368:0:15208:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x89871fc3aba17adf 00000020:00000080:3.0:1784044247.285378:0:15208:0:(genops.c:906:class_export_put()) final put ffff9b39459d5800/lustre-MDD0000_UUID 00000020:00000080:0.0:1784044247.285744:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9b396f3ca000 for lustre-MDT0001-osp-MDT0000 00000020:00000080:0.0:1784044247.285753:0:37:0:(genops.c:906:class_export_put()) final put ffff9b397590d000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1784044247.285755:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9b397590d000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:0.0:1784044247.285762:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1784044247.286094:0:15208:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:3.0:1784044247.286100:0:15208:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1784044247.286107:0:15208:0:(obd_config.c:955:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1784044247.286110:0:15208:0:(genops.c:1579:class_disconnect_exports()) OBD device 6 (ffff9b39459b8000) has no exports 00000020:00000080:3.0:1784044247.286134:0:15208:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1784044247.286139:0:15208:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:3.0:1784044247.286144:0:15208:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x89871fc3aba17ae6 00000020:00000080:3.0:1784044247.286149:0:15208:0:(genops.c:906:class_export_put()) final put ffff9b39459d6800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1784044247.286746:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9b39459d5800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:0.0:1784044247.286754:0:37:0:(genops.c:906:class_export_put()) final put ffff9b39741ca000/lustre-MDD0000_UUID 00000020:00000080:0.0:1784044247.286756:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9b39741ca000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:0.0:1784044247.286761:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:01000004:3.0:1784044247.287066:0:15208:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9b397418c800 from lustre-MDT0000, refs=3 00000020:01000004:3.0:1784044247.287080:0:15208:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9b397418c800 3 00000020:01000004:3.0:1784044247.287084:0:15208:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9b397418c800 from lustre-MDT0000 00000020:00000080:3.0:1784044247.287122:0:15208:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1784044247.287131:0:15208:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:3.0:1784044247.287134:0:15208:0:(genops.c:906:class_export_put()) final put ffff9b39741c9800/lustre-MDT0000_UUID 00000020:00000080:3.0:1784044247.287137:0:15208:0:(genops.c:865:class_export_destroy()) destroying export ffff9b39741c9800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:3.0:1784044247.287145:0:15208:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:3.0:1784044247.288089:0:15208:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:3.0:1784044247.288096:0:15208:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:3.0:1784044247.288101:0:15208:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:3.0:1784044247.288105:0:15208:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1784044247.288110:0:15208:0:(obd_config.c:955:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1784044247.288116:0:15208:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff9b3944fd7000 8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1784044247.288123:0:15208:0:(genops.c:1574:class_disconnect_exports()) OBD device 1 (ffff9b3974254d40) has exports, disconnecting them 00000020:00080000:3.0:1784044247.288127:0:15208:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff9b3944fd7000), last request at 1784043946 00000020:00000080:3.0:1784044247.288143:0:15208:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x89871fc3aba17a7d 00000020:00010000:3.0:1784044247.288149:0:15208:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9b3944fd7000: total 1 00000100:00080000:3.0:1784044247.288154:0:15208:0:(import.c:65:import_set_state_nolock()) ffff9b3944fd2000 : changing import state from FULL to CLOSED 00000020:00000080:0.0:1784044247.288401:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9b39459d6800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00080000:3.0:1784044247.288660:0:15208:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9b3944fd7000): rc 0 00000020:00080000:3.0:1784044247.288666:0:15208:0:(genops.c:1579:class_disconnect_exports()) OBD device 1 (ffff9b3974254d40) has no exports 00000100:00100000:3.0:1784044247.288761:0:6504:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff9b394ac25c00:6504] 0 exiting: rc = 1 00000100:00100000:0.0:1784044247.289759:0:6505:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff9b3974126e00:6505] 1 exiting: rc = 0 00000100:00100000:0.0:1784044247.289858:0:6506:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff9b397420ce00:6506] 2 exiting: rc = 0 00000100:00100000:3.0:1784044247.290060:0:15208:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044247.290067:0:15208:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044247.290074:0:15208:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044247.290080:0:15208:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044247.290086:0:15208:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044247.290092:0:15208:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044247.290099:0:15208:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044247.290104:0:15208:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044247.290111:0:15208:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044247.290117:0:15208:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044247.290122:0:15208:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044247.290146:0:15208:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044247.290152:0:15208:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044247.290158:0:15208:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044247.290164:0:15208:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044247.290170:0:15208:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044247.290195:0:15208:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044247.290201:0:15208:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044247.290208:0:15208:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044247.290215:0:15208:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044247.290220:0:15208:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044247.290226:0:15208:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044247.290233:0:15208:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044247.290250:0:15208:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044247.290256:0:15208:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044247.290264:0:15208:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044247.290269:0:15208:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044247.290276:0:15208:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044247.290281:0:15208:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044247.290287:0:15208:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044247.290367:0:15208:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044247.290374:0:15208:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044247.290379:0:15208:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044247.290386:0:15208:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044247.290392:0:15208:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044247.290399:0:15208:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044247.290405:0:15208:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044247.290411:0:15208:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044247.290417:0:15208:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044247.290422:0:15208:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044247.290427:0:15208:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044247.290433:0:15208:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044247.290438:0:15208:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044247.290443:0:15208:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044247.290448:0:15208:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044247.290454:0:15208:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044247.290470:0:15208:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044247.290475:0:15208:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044247.290480:0:15208:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044247.290485:0:15208:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044247.290490:0:15208:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044247.290496:0:15208:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044247.290502:0:15208:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044247.290508:0:15208:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044247.290515:0:15208:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044247.290520:0:15208:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044247.290526:0:15208:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044247.290532:0:15208:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044247.290537:0:15208:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044247.290543:0:15208:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044247.290548:0:15208:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044247.290554:0:15208:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044247.290559:0:15208:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044247.290564:0:15208:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:3.0:1784044247.292393:0:15208:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff9b3965d1ce00/0x89871fc3aba17b80 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0x89871fc3aba17b79 expref: 14 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044247.292419:0:15208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b3965d1ce00/0x89871fc3aba17b80 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0x89871fc3aba17b79 expref: 14 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044247.292437:0:15208:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff9b39586ef600/0x89871fc3aba17f85 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0x89871fc3aba17f7e expref: 13 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044247.292446:0:15208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b39586ef600/0x89871fc3aba17f85 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0x89871fc3aba17f7e expref: 13 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044247.292454:0:15208:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff9b39586efe00/0x89871fc3aba17f93 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0x89871fc3aba17f8c expref: 12 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044247.292462:0:15208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b39586efe00/0x89871fc3aba17f93 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0x89871fc3aba17f8c expref: 12 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044247.292486:0:15208:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff9b39759f9a00/0x89871fc3aba17fa1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0x89871fc3aba17f9a expref: 11 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044247.292496:0:15208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b39759f9a00/0x89871fc3aba17fa1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0x89871fc3aba17f9a expref: 11 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044247.292504:0:15208:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff9b3940031200/0x89871fc3aba17faf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0x89871fc3aba17fa8 expref: 10 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044247.292511:0:15208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b3940031200/0x89871fc3aba17faf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0x89871fc3aba17fa8 expref: 10 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044247.292521:0:15208:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff9b3940031e00/0x89871fc3aba17fbd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0x89871fc3aba17fb6 expref: 9 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044247.292529:0:15208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b3940031e00/0x89871fc3aba17fbd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0x89871fc3aba17fb6 expref: 9 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044247.292537:0:15208:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff9b39759f8400/0x89871fc3aba17fcb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0x89871fc3aba17fc4 expref: 8 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044247.292546:0:15208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b39759f8400/0x89871fc3aba17fcb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0x89871fc3aba17fc4 expref: 8 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044247.292554:0:15208:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff9b3982054c00/0x89871fc3aba17ff5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0x89871fc3aba17fee expref: 7 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044247.292562:0:15208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b3982054c00/0x89871fc3aba17ff5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0x89871fc3aba17fee expref: 7 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044247.292594:0:15208:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff9b394166b000/0x89871fc3aba17ea5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0x89871fc3aba17e9e expref: 6 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044247.292603:0:15208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b394166b000/0x89871fc3aba17ea5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0x89871fc3aba17e9e expref: 6 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044247.292615:0:15208:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff9b394166ba00/0x89871fc3aba17b8e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0x89871fc3aba17b87 expref: 5 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044247.292622:0:15208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b394166ba00/0x89871fc3aba17b8e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0x89871fc3aba17b87 expref: 5 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044247.292633:0:15208:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff9b38410b7400/0x89871fc3aba1825d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0x89871fc3aba18256 expref: 4 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044247.292640:0:15208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b38410b7400/0x89871fc3aba1825d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0x89871fc3aba18256 expref: 4 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044247.292648:0:15208:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff9b3843798800/0x89871fc3aba1826b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0x89871fc3aba18264 expref: 3 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044247.292655:0:15208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b3843798800/0x89871fc3aba1826b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0x89871fc3aba18264 expref: 3 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044247.292663:0:15208:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff9b39759f9800/0x89871fc3aba18279 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0x89871fc3aba18272 expref: 2 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044247.292670:0:15208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b39759f9800/0x89871fc3aba18279 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0x89871fc3aba18272 expref: 2 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00010000:1.0:1784044247.293509:0:6500:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9b3944fd7000: total 0 00010000:00010000:1.0:1784044247.293603:0:6500:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9b3944fd7000, canceled 0 locks, left on hash table 0. 00010000:00010000:1.0:1784044247.293622:0:6500:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9b3944fd7000, canceled 0 locks, left on hash table 0. 00000020:00000080:1.0:1784044247.293635:0:6500:0:(genops.c:906:class_export_put()) final put ffff9b3944fd7000/8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9 00010000:00010000:1.0:1784044247.293656:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784044247.293659:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784044247.293660:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1784044247.293758:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9b3944fd7000/8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9 for MGS 00000020:00000080:3.0:1784044247.293798:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9b3944fd2000 for MGS 00000040:00080000:3.0:1784044247.504434:0:13804:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1784044247.693472:0:10330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784044248.717612:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:3.0:1784044249.295150:0:15208:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9b38434f55a0 - data ffff9b395d6fc000/ffff9b397f957800 00000020:01000000:3.0:1784044249.295320:0:15208:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9b3942f706c0 - data ffff9b395d4bc510/ffff9b3953974c00 00000020:00000080:3.0:1784044249.296403:0:15208:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x89871fc3aba17a68 00000020:00000080:3.0:1784044249.296414:0:15208:0:(genops.c:906:class_export_put()) final put ffff9b396f0a4000/lustre-MDT0000-osd_UUID 00000020:01000004:3.0:1784044249.296434:0:15208:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9b397418c800 from MGS, refs=2 00000020:01000004:3.0:1784044249.296438:0:15208:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9b397418c800 2 00000020:01000004:3.0:1784044249.296442:0:15208:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9b397418c800 from MGS 00000020:00000080:3.0:1784044249.296466:0:15208:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1784044249.296473:0:15208:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:1.0:1784044249.296474:0:14129:0:(genops.c:865:class_export_destroy()) destroying export ffff9b396f0a4000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1784044249.296476:0:15208:0:(genops.c:906:class_export_put()) final put ffff9b396f0a4800/MGS 00000020:00000080:3.0:1784044249.296481:0:15208:0:(genops.c:865:class_export_destroy()) destroying export ffff9b396f0a4800/MGS for MGS 00000020:01000000:3.0:1784044249.296489:0:15208:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:3.0:1784044249.296554:0:15208:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:3.0:1784044249.296558:0:15208:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1784044249.296563:0:15208:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1784044249.296570:0:15208:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9b397a9ec800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1784044249.296576:0:15208:0:(genops.c:1574:class_disconnect_exports()) OBD device 8 (ffff9b3970fe0000) has exports, disconnecting them 00000020:00080000:3.0:1784044249.296581:0:15208:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff9b397a9ec800), last request at 1784043947 00000020:00000080:3.0:1784044249.296585:0:15208:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x89871fc3aba17b33 00000020:00080000:3.0:1784044249.296595:0:15208:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9b397a9ec800): rc 0 00000020:00000080:3.0:1784044249.296600:0:15208:0:(genops.c:906:class_export_put()) final put ffff9b397a9ec800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1784044249.296778:0:14129:0:(genops.c:865:class_export_destroy()) destroying export ffff9b397a9ec800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:2.0:1784044249.298510:0:15208:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:2.0:1784044249.298517:0:15208:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1784044249.298521:0:15208:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1784044249.298527:0:15208:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1784044249.298649:0:15208:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1784044249.298656:0:15208:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:2.0:1784044249.298661:0:15208:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9b397418c800 1 00000020:00000080:2.0:1784044249.298679:0:15208:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x89871fc3aba17a5a 00000020:00000080:2.0:1784044249.298697:0:15208:0:(genops.c:906:class_export_put()) final put ffff9b396f0a7000/lustre-MDT0000-osd_UUID 00000020:01000000:2.0:1784044249.298701:0:15208:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:2.0:1784044249.298705:0:15208:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1784044249.298708:0:15208:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1784044249.298711:0:15208:0:(genops.c:1579:class_disconnect_exports()) OBD device 0 (ffff9b39742519c0) has no exports 00000020:00000080:1.0:1784044249.298845:0:14129:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9b397a9e9800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1784044249.298852:0:14129:0:(genops.c:906:class_export_put()) final put ffff9b397a9e8000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:1.0:1784044249.298854:0:14129:0:(genops.c:865:class_export_destroy()) destroying export ffff9b397a9e8000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:1.0:1784044249.298866:0:14129:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:1.0:1784044249.298949:0:14129:0:(genops.c:865:class_export_destroy()) destroying export ffff9b396f0a7000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1784044249.368611:0:15208:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1784044249.368624:0:15208:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:0.0:1784044249.368630:0:15208:0:(genops.c:906:class_export_put()) final put ffff9b396f0a3800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1784044249.368634:0:15208:0:(genops.c:865:class_export_destroy()) destroying export ffff9b396f0a3800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1784044249.368639:0:15208:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:0.0:1784044249.368753:0:15208:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9b397418e800 00000020:02000400:0.0:1784044249.368815:0:15208:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:0.0:1784044249.746653:0:10331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784044250.767603:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784044251.214834:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784044251.214867:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397a8a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1870705581020160:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1784044251.222133:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044251.222254:0:10713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581020160 00000100:00100000:2.0:1784044251.222272:0:10713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581020160 00000100:00100000:2.0:1784044251.222389:0:10713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:2.0:1784044251.222408:0:10713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843c54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1870705581020160:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1784044251.222458:0:10713:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1784044251.222565:0:10713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843c54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1870705581020160:12345-0@lo:13:osp-pre-0-1.0 Request processed in 165us (441us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044251.222574:0:10713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:2.0:1784044251.222703:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397a8a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1870705581020160:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1784044251.223413:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1784044251.793665:0:10330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1784044252.237500:0:14129:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1784044252.237510:0:14129:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1784044252.237515:0:14129:0:(import.c:65:import_set_state_nolock()) ffff9b397b63a000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784044252.237526:0:14129:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 440 00000100:00080000:1.0:1784044252.237531:0:14129:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1784044252.237539:0:14129:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9b397b63a000 using connection 192.168.202.140@tcp/0@lo 00000100:00100000:1.0:1784044252.237570:0:14129:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b397a8a4000 x1870705581020416/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1784044252.237591:0:14129:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1784044252.237594:0:14129:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1784044252.237596:0:14129:0:(import.c:65:import_set_state_nolock()) ffff9b397585d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784044252.237600:0:14129:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 440 00000100:00080000:1.0:1784044252.237605:0:14129:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1784044252.237608:0:14129:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9b397585d000 using connection 192.168.202.140@tcp/0@lo 00000100:00100000:1.0:1784044252.237620:0:14129:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b38436a1880 x1870705581020544/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1784044252.237712:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784044252.237735:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397a8a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:3640:1870705581020288:0@lo:400:kworker.0 00000400:00000100:3.0:1784044252.237804:0:3640:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1870705581020288 offset 0 length 224: 4 00000100:00100000:0.0:1784044252.241422:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397a8a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1870705581020416:0@lo:38:kworker.0 00000100:00100000:0.0:1784044252.244418:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044252.244479:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b38436a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3637:1870705581020544:0@lo:38:kworker.0 00000100:00100000:0.0:1784044252.244593:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044252.244672:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b38436a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1870705581020672:0@lo:400:kworker.0 00000100:00100000:0.0:1784044252.244703:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044252.244725:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784044252.244732:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843ce6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1870705581020800:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1784044252.244772:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044252.244970:0:7768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581020416 00000100:00100000:2.0:1784044252.244986:0:7768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581020416 00000100:00100000:2.0:1784044252.245051:0:7768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:2.0:1784044252.245063:0:7768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843c54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3637:x1870705581020416:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1784044252.245098:0:7768:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1784044252.245495:0:13808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581020544 00000100:00100000:0.0:1784044252.245505:0:13808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581020544 00000100:00100000:0.0:1784044252.245966:0:13808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:0.0:1784044252.245975:0:13808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843c56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3637:x1870705581020544:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1784044252.245997:0:13808:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00080000:1.0:1784044252.246089:0:14129:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1784044252.246097:0:14129:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1784044252.246102:0:14129:0:(import.c:65:import_set_state_nolock()) ffff9b3974da9800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784044252.246118:0:14129:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 440 00000100:00080000:1.0:1784044252.246125:0:14129:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1784044252.246149:0:14129:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9b3974da9800 using connection 192.168.202.140@tcp/0@lo 00000100:00100000:1.0:1784044252.246209:0:14129:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b38436a1c00 x1870705581020928/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1784044252.246216:0:13808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843c56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3637:x1870705581020544:12345-0@lo:38:kworker.0 Request processed in 91us (1549us total) trans 0 rc -19/-19 00000100:00100000:0.0:1784044252.246232:0:13808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00080000:1.0:1784044252.246267:0:14129:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1784044252.246271:0:14129:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1784044252.246273:0:14129:0:(import.c:65:import_set_state_nolock()) ffff9b384345d800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784044252.246278:0:14129:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 440 00000100:00080000:1.0:1784044252.246281:0:14129:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1784044252.246286:0:14129:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9b384345d800 using connection 192.168.202.140@tcp/0@lo 00000100:00100000:1.0:1784044252.246309:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843734e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1870705581021056:0@lo:400:kworker.0 00000100:00100000:1.0:1784044252.246373:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044252.246432:0:9501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581021056 00000100:00100000:1.0:1784044252.246437:0:9501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581021056 00000100:00100000:1.0:1784044252.246514:0:9501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 423 00000100:00100000:0.0:1784044252.246515:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b38436a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3637:1870705581020928:0@lo:38:kworker.0 00000100:00100000:1.0:1784044252.246527:0:9501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843735f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1870705581021056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044252.246581:0:9501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843735f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1870705581021056:12345-0@lo:400:kworker.0 Request processed in 57us (207us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044252.246588:0:9501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 423 00000100:00080000:1.0:1784044252.246611:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1784044252.246645:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff9b3843734e00 x1870705581021056/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044268 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784044252.246661:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843734e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1870705581021056:0@lo:400:kworker.0 00000100:00100000:1.0:1784044252.246691:0:14129:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b3843734e00 x1870705581021184/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1784044252.246721:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843736a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3641:1870705581021312:0@lo:400:kworker.0 00000100:00100000:1.0:1784044252.246757:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044252.246788:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581021312 00000100:00100000:1.0:1784044252.246792:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581021312 00000100:00100000:1.0:1784044252.246823:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 424 00000100:00100000:1.0:1784044252.246829:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843735c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1870705581021312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044252.246865:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843735c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1870705581021312:12345-0@lo:400:kworker.0 Request processed in 35us (107us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044252.246871:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 424 00000100:00080000:1.0:1784044252.246884:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1784044252.246899:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff9b3843736a00 x1870705581021312/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044268 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784044252.246907:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843736a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3641:1870705581021312:0@lo:400:kworker.0 00000100:00100000:0.0:1784044252.247362:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1784044252.247411:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9b397585d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:1.0:1784044252.247415:0:9501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581020928 00000100:00080000:0.0:1784044252.247419:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1784044252.247424:0:9501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581020928 00000100:00100000:0.0:1784044252.247428:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b38436a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3637:1870705581020544:0@lo:38:kworker.0 00000100:00100000:1.0:1784044252.247458:0:9501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:0.0:1784044252.247462:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843734e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3637:1870705581021184:0@lo:38:kworker.0 00000100:00100000:1.0:1784044252.247472:0:9501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843c54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3637:x1870705581020928:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1784044252.247495:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00020000:1.0:1784044252.247500:0:9501:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1784044252.247546:0:9501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843c54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3637:x1870705581020928:12345-0@lo:38:kworker.0 Request processed in 77us (184us total) trans 0 rc -19/-19 00000100:00100000:1.0:1784044252.247553:0:9501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:1.0:1784044252.247564:0:9501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581021184 00000100:00100000:1.0:1784044252.247567:0:9501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581021184 00000100:00100000:1.0:1784044252.247585:0:9501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:1.0:1784044252.247593:0:9501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843c57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3637:x1870705581021184:12345-0@lo:38:kworker.0 00000100:00080000:0.0:1784044252.247601:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9b3974da9800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00010000:00020000:1.0:1784044252.247606:0:9501:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00080000:0.0:1784044252.247612:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1784044252.247617:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b38436a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3637:1870705581020928:0@lo:38:kworker.0 00000100:00100000:1.0:1784044252.247655:0:9501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843c57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3637:x1870705581021184:12345-0@lo:38:kworker.0 Request processed in 58us (158us total) trans 0 rc -19/-19 00000100:00080000:0.0:1784044252.247661:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9b384345d800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1784044252.247668:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1784044252.247679:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843734e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3637:1870705581021184:0@lo:38:kworker.0 00000100:00100000:1.0:1784044252.247689:0:9501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:1.0:1784044252.247772:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581020800 00000100:00100000:1.0:1784044252.247778:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581020800 00000100:00100000:0.0:1784044252.247858:0:9822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581020672 00000100:00100000:0.0:1784044252.247865:0:9822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581020672 00000100:00100000:0.0:1784044252.248002:0:9822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1784044252.248009:0:9822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843c54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3638:x1870705581020672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044252.248919:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:1.0:1784044252.248937:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843c54700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1870705581020800:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1784044252.248993:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784044252.249005:0:9822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843c54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3638:x1870705581020672:12345-0@lo:400:kworker.0 Request processed in 986us (4292us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044252.249018:0:9822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1784044252.256169:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843ce6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1870705581020800:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1784044252.256244:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b38436a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1870705581020672:0@lo:400:kworker.0 00000100:00080000:0.0:1784044252.257304:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784044252.259846:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843c54700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1870705581020800:12345-0@lo:13:osp-pre-1-1.0 Request processed in 7166us (11323us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044252.259874:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:2.0:1784044252.276320:0:7768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843c54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3637:x1870705581020416:12345-0@lo:38:kworker.0 Request processed in 31250us (31901us total) trans 0 rc -19/-19 00000100:00100000:2.0:1784044252.276336:0:7768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00080000:3.0:1784044252.277564:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9b397b63a000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1784044252.277575:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1784044252.277581:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397a8a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1870705581020416:0@lo:38:kworker.0 00010000:00010000:1.0:1784044252.821376:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784044253.848375:0:10331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1784044253.931515:0:15411:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:3.0:1784044253.957058:0:15411:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0001 00010000:00010000:3.0:1784044253.957117:0:15411:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b3982055a00/0x89871fc3aba17fb6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba17fbd expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044253.957132:0:15411:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b3982055a00/0x89871fc3aba17fb6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x89871fc3aba17fbd expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044253.957139:0:15411:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b3982055a00/0x89871fc3aba17fb6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x89871fc3aba17fbd expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044253.957146:0:15411:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.140@tcp lock: ffff9b3982055a00/0x89871fc3aba17fb6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x89871fc3aba17fbd expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044253.957204:0:15411:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1784044253.957211:0:15411:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1784044253.957245:0:15411:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1784044253.957249:0:15411:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:3.0:1784044253.957260:0:15411:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1784044253.957268:0:15411:0:(import.c:65:import_set_state_nolock()) ffff9b397585d000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:3.0:1784044253.957273:0:15411:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1784044253.957275:0:15411:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1784044253.957278:0:15411:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1784044253.959058:0:15411:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b39586eea00/0x89871fc3aba17fc4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba17fcb expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044253.959077:0:15411:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b39586eea00/0x89871fc3aba17fc4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x89871fc3aba17fcb expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044253.959098:0:15411:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b39586eea00/0x89871fc3aba17fc4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x89871fc3aba17fcb expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044253.959105:0:15411:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.140@tcp lock: ffff9b39586eea00/0x89871fc3aba17fc4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x89871fc3aba17fcb expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044253.959122:0:15411:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1784044253.959128:0:15411:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b3982055000/0x89871fc3aba17e9e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba17ea5 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044253.959135:0:15411:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b3982055000/0x89871fc3aba17e9e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x89871fc3aba17ea5 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044253.959140:0:15411:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b3982055000/0x89871fc3aba17e9e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x89871fc3aba17ea5 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044253.959146:0:15411:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.140@tcp lock: ffff9b3982055000/0x89871fc3aba17e9e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x89871fc3aba17ea5 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044253.959162:0:15411:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1784044253.959168:0:15411:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b3843798e00/0x89871fc3aba18272 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba18279 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044253.959196:0:15411:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b3843798e00/0x89871fc3aba18272 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x89871fc3aba18279 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044253.959202:0:15411:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b3843798e00/0x89871fc3aba18272 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x89871fc3aba18279 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044253.959218:0:15411:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.140@tcp lock: ffff9b3843798e00/0x89871fc3aba18272 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x89871fc3aba18279 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044253.959229:0:15411:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:3.0:1784044253.959235:0:15411:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b39586ee200/0x89871fc3aba17b87 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba17b8e expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044253.959241:0:15411:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b39586ee200/0x89871fc3aba17b87 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x89871fc3aba17b8e expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044253.959247:0:15411:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b39586ee200/0x89871fc3aba17b87 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x89871fc3aba17b8e expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044253.959255:0:15411:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.140@tcp lock: ffff9b39586ee200/0x89871fc3aba17b87 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x89871fc3aba17b8e expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044253.959262:0:15411:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 10000000:01000000:3.0:1784044253.959266:0:15411:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0001 (0) 00000020:01000004:3.0:1784044253.959293:0:15411:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0001 00000020:01000000:3.0:1784044253.959297:0:15411:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001 (flags='F') 00000020:00000080:3.0:1784044253.959302:0:15411:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1784044253.959308:0:15411:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001: forcing exports to disconnect: 2/5 00000020:00080000:3.0:1784044253.959315:0:15411:0:(genops.c:1840:print_export_data()) lustre-MDT0001: ACTIVE ffff9b397b801800 lustre-MDT0001-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1784044253.959320:0:15411:0:(genops.c:1840:print_export_data()) lustre-MDT0001: ACTIVE ffff9b38423b4000 lustre-MDT0001-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1784044253.959324:0:15411:0:(genops.c:1574:class_disconnect_exports()) OBD device 11 (ffff9b3974da0000) has exports, disconnecting them 00000020:00080000:3.0:1784044253.959329:0:15411:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff9b397b801800), last request at 1784044252 00000020:00000080:3.0:1784044253.959336:0:15411:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x89871fc3aba17e66 00000100:00080000:3.0:1784044253.959364:0:15411:0:(import.c:65:import_set_state_nolock()) ffff9b397b804800 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1784044253.959425:0:15411:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9b397b801800): rc 0 00000020:00000080:3.0:1784044253.959428:0:15411:0:(genops.c:906:class_export_put()) final put ffff9b397b801800/lustre-MDT0001-lwp-OST0001_UUID 00000020:00080000:3.0:1784044253.959438:0:15411:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff9b38423b4000), last request at 1784044252 00000020:00000080:3.0:1784044253.959442:0:15411:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x89871fc3aba17db0 00000100:00080000:3.0:1784044253.959449:0:15411:0:(import.c:65:import_set_state_nolock()) ffff9b38423b2000 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1784044253.959455:0:15411:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9b38423b4000): rc 0 00000020:00000080:3.0:1784044253.959457:0:15411:0:(genops.c:906:class_export_put()) final put ffff9b38423b4000/lustre-MDT0001-lwp-OST0000_UUID 00000004:00000080:3.0:1784044253.959464:0:15411:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0001: cmd=400866e7 len=0 karg=ffffb73bc192fae0 00000100:00080000:3.0:1784044253.959481:0:15411:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1784044253.959491:0:15411:0:(client.c:3601:ptlrpc_abort_inflight()) @@@ aborting waiting req req@ffff9b38436a1500 x1870705581015680/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1784044250 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784044253.959506:0:15411:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 3 00010000:00010000:0.0:1784044253.960902:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1784044253.960913:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: ffff9b3982055a00/0x89871fc3aba17fb6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x89871fc3aba17fbd expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044253.960924:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3982055a00 already unused, calling callback (ffffffffc113cc20) 10000000:00010000:0.0:1784044253.960928:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: ffff9b3982055a00/0x89871fc3aba17fb6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x89871fc3aba17fbd expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044253.960947:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9b3982055a00/0x89871fc3aba17fb6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x89871fc3aba17fbd expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784044253.960954:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9b3982055a00/0x89871fc3aba17fb6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x89871fc3aba17fbd expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784044253.960960:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1784044253.960963:0:6500:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1784044253.960965:0:6500:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1784044253.961003:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.140@tcp lock: ffff9b3982055a00/0x89871fc3aba17fb6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x89871fc3aba17fbd expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044253.961024:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784044253.961046:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: ffff9b3982055a00/0x89871fc3aba17fb6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x89871fc3aba17fbd expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044253.961053:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9b3982055a00/0x89871fc3aba17fb6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x89871fc3aba17fbd expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044253.961069:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1784044253.961073:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: ffff9b39586eea00/0x89871fc3aba17fc4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x89871fc3aba17fcb expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044253.961078:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b39586eea00 already unused, calling callback (ffffffffc113cc20) 10000000:00010000:0.0:1784044253.961081:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: ffff9b39586eea00/0x89871fc3aba17fc4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x89871fc3aba17fcb expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044253.961088:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9b39586eea00/0x89871fc3aba17fc4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x89871fc3aba17fcb expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784044253.961094:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9b39586eea00/0x89871fc3aba17fc4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x89871fc3aba17fcb expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784044253.961099:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1784044253.961101:0:6500:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0001: stopping, won't requeue 10000000:01000000:0.0:1784044253.961103:0:6500:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0001 00010000:00010000:0.0:1784044253.961116:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.140@tcp lock: ffff9b39586eea00/0x89871fc3aba17fc4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x89871fc3aba17fcb expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044253.961122:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784044253.961128:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: ffff9b39586eea00/0x89871fc3aba17fc4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x89871fc3aba17fcb expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044253.961143:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9b39586eea00/0x89871fc3aba17fc4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x89871fc3aba17fcb expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044253.961153:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1784044253.961157:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: ffff9b3982055000/0x89871fc3aba17e9e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x89871fc3aba17ea5 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044253.961161:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3982055000 already unused, calling callback (ffffffffc113cc20) 10000000:00010000:0.0:1784044253.961164:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: ffff9b3982055000/0x89871fc3aba17e9e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x89871fc3aba17ea5 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044253.961171:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9b3982055000/0x89871fc3aba17e9e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x89871fc3aba17ea5 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784044253.961203:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9b3982055000/0x89871fc3aba17e9e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x89871fc3aba17ea5 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784044253.961210:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:0.0:1784044253.961212:0:6500:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:0.0:1784044253.961214:0:6500:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:0.0:1784044253.961229:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.140@tcp lock: ffff9b3982055000/0x89871fc3aba17e9e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x89871fc3aba17ea5 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044253.961235:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784044253.961254:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: ffff9b3982055000/0x89871fc3aba17e9e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x89871fc3aba17ea5 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044253.961261:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9b3982055000/0x89871fc3aba17e9e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x89871fc3aba17ea5 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044253.961285:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1784044253.961288:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: ffff9b3843798e00/0x89871fc3aba18272 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x89871fc3aba18279 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044253.961294:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3843798e00 already unused, calling callback (ffffffffc113cc20) 10000000:00010000:0.0:1784044253.961297:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: ffff9b3843798e00/0x89871fc3aba18272 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x89871fc3aba18279 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044253.961303:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9b3843798e00/0x89871fc3aba18272 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x89871fc3aba18279 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784044253.961309:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9b3843798e00/0x89871fc3aba18272 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x89871fc3aba18279 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784044253.961314:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1784044253.961316:0:6500:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1784044253.961317:0:6500:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1784044253.961331:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.140@tcp lock: ffff9b3843798e00/0x89871fc3aba18272 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x89871fc3aba18279 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044253.961337:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784044253.961344:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: ffff9b3843798e00/0x89871fc3aba18272 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x89871fc3aba18279 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044253.961350:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9b3843798e00/0x89871fc3aba18272 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x89871fc3aba18279 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044253.961369:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784044253.961372:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: ffff9b39586ee200/0x89871fc3aba17b87 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x89871fc3aba17b8e expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044253.961384:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b39586ee200 already unused, calling callback (ffffffffc113cc20) 10000000:00010000:0.0:1784044253.961387:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: ffff9b39586ee200/0x89871fc3aba17b87 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x89871fc3aba17b8e expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044253.961400:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9b39586ee200/0x89871fc3aba17b87 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x89871fc3aba17b8e expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784044253.961407:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9b39586ee200/0x89871fc3aba17b87 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x89871fc3aba17b8e expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784044253.961412:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:0.0:1784044253.961414:0:6500:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:0.0:1784044253.961416:0:6500:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:0.0:1784044253.961429:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.140@tcp lock: ffff9b39586ee200/0x89871fc3aba17b87 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x89871fc3aba17b8e expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044253.961435:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784044253.961440:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: ffff9b39586ee200/0x89871fc3aba17b87 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x89871fc3aba17b8e expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044253.961446:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9b39586ee200/0x89871fc3aba17b87 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x89871fc3aba17b8e expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044253.961457:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784044253.961459:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784044253.961461:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784044253.961468:0:10330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784044253.961473:0:10331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1784044253.961483:0:14129:0:(genops.c:865:class_export_destroy()) destroying export ffff9b397b801800/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00000020:00000080:0.0:1784044253.961527:0:14129:0:(genops.c:865:class_export_destroy()) destroying export ffff9b38423b4000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000020:00000080:0.0:1784044253.961557:0:14129:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9b397b804800 for lustre-MDT0001 00000020:00000080:0.0:1784044253.961561:0:14129:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9b38423b2000 for lustre-MDT0001 00000100:00100000:0.0:1784044253.961582:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843c57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:3638:1870705581021440:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784044253.961646:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044253.961877:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b38436a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:3638:1870705581021952:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784044253.961901:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044253.961925:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784044253.961930:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843c56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:3638:1870705581021568:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784044253.961961:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044253.961985:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843c57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:3640:1870705581021696:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784044253.962005:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044253.962020:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784044253.962024:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b38436a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:3640:1870705581021824:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784044253.962038:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044253.962062:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581021440 00000100:00100000:0.0:1784044253.962068:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581021440 00000100:00100000:0.0:1784044253.962094:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581021952 00000100:00100000:0.0:1784044253.962096:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581021952 00000100:00100000:0.0:1784044253.962102:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581021568 00000100:00100000:0.0:1784044253.962104:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581021568 00000100:00100000:0.0:1784044253.962110:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581021696 00000100:00100000:0.0:1784044253.962111:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581021696 00000100:00100000:0.0:1784044253.962118:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581021824 00000100:00100000:0.0:1784044253.962119:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581021824 00000100:00100000:0.0:1784044253.962130:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1784044253.962137:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38436a1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3638:x1870705581021440:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1784044253.962143:0:6498:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1784044253 with bad export cookie 9909924430310636157 00000100:00080000:3.0:1784044253.967923:0:15411:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1784044253.967947:0:15411:0:(import.c:65:import_set_state_nolock()) ffff9b397b63a000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00100000:2.0:1784044253.972228:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1784044253.972241:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3945930700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3638:x1870705581021952:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1784044253.972249:0:6496:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1784044253 with bad export cookie 9909924430310636157 00000100:00080000:3.0:1784044253.972257:0:15411:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1784044253.972262:0:15411:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967298 gen 3 00000004:00080000:3.0:1784044253.972285:0:15411:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1784044253.972339:0:15411:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:2.0:1784044253.972349:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3945930700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3638:x1870705581021952:12345-0@lo:103:ldlm_bl.0 Request processed in 109us (10446us total) trans 0 rc -107/-107 00000100:00100000:2.0:1784044253.972367:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:3.0:1784044253.972603:0:15411:0:(import.c:65:import_set_state_nolock()) ffff9b3842126000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1784044253.972616:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00080000:3.0:1784044253.972620:0:15411:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1784044253.972622:0:15411:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 3 00000100:00100000:2.0:1784044253.972623:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3944ce6850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3638:x1870705581021568:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1784044253.972628:0:6496:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1784044253 with bad export cookie 9909924430310636157 00000004:00080000:3.0:1784044253.972630:0:15411:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1784044253.972657:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3944ce6850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3638:x1870705581021568:12345-0@lo:103:ldlm_bl.0 Request processed in 33us (10695us total) trans 0 rc -107/-107 00000100:00100000:2.0:1784044253.972663:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1784044253.972678:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1784044253.972682:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3947eead80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3640:x1870705581021696:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1784044253.972686:0:6496:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1784044253 with bad export cookie 9909924430310636157 00000100:00100000:2.0:1784044253.972717:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3947eead80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3640:x1870705581021696:12345-0@lo:103:ldlm_bl.0 Request processed in 33us (10710us total) trans 0 rc -107/-107 00000100:00100000:2.0:1784044253.972723:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1784044253.972736:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1784044253.972740:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3947eeb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3640:x1870705581021824:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1784044253.972744:0:6496:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1784044253 with bad export cookie 9909924430310636157 00000100:00100000:2.0:1784044253.972768:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3947eeb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3640:x1870705581021824:12345-0@lo:103:ldlm_bl.0 Request processed in 27us (10728us total) trans 0 rc -107/-107 00000100:00100000:2.0:1784044253.972774:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1784044253.972788:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843ce5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1870705581022080:0@lo:9:umount.0 00000100:00100000:3.0:1784044253.972832:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1784044253.972884:0:15411:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:3.0:1784044253.972896:0:15411:0:(import.c:65:import_set_state_nolock()) ffff9b396f2f4000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1784044253.972912:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843ce4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1870705581022208:0@lo:9:umount.0 00000100:00100000:3.0:1784044253.972961:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:3.0:1784044253.973023:0:15411:0:(genops.c:1579:class_disconnect_exports()) OBD device 11 (ffff9b3974da0000) has no exports 00000100:00100000:2.0:1784044253.973145:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581022080 00000100:00100000:2.0:1784044253.973152:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581022080 00000100:00100000:2.0:1784044253.973228:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581022208 00000100:00100000:2.0:1784044253.973232:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581022208 00000100:00100000:2.0:1784044253.973256:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1784044253.973262:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843ce7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1870705581022080:12345-0@lo:9:umount.0 00000020:00000080:2.0:1784044253.973289:0:8427:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x89871fc3aba17dbe 00000100:00080000:2.0:1784044253.973303:0:8427:0:(import.c:65:import_set_state_nolock()) ffff9b3842094800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1784044253.973652:0:8427:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:2.0:1784044253.973822:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843ce7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+2:3637:x1870705581022080:12345-0@lo:9:umount.0 Request processed in 559us (989us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044253.973829:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1784044253.973842:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1784044253.973849:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843ce5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1870705581022208:12345-0@lo:9:umount.0 00000020:00000080:2.0:1784044253.973862:0:8427:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x89871fc3aba17edd 00000100:00080000:2.0:1784044253.973868:0:8427:0:(import.c:65:import_set_state_nolock()) ffff9b384317d800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1784044253.973889:0:8427:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:2.0:1784044253.974172:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843ce5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+2:3637:x1870705581022208:12345-0@lo:9:umount.0 Request processed in 133us (1018us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044253.974201:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00080000:2.0:1784044253.974248:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9b396f2f4000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1784044253.974259:0:3637:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1784044253.974261:0:3637:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1784044253.974265:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843ce4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1870705581022208:0@lo:9:umount.0 00000100:00080000:2.0:1784044253.974277:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9b3842126000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1784044253.974280:0:3637:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1784044253.974281:0:3637:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1784044253.974284:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843ce5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1870705581022080:0@lo:9:umount.0 00000100:00080000:3.0:1784044253.974586:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1784044253.976832:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784044253.976856:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b38436a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1870705581015680:0@lo:41:osp-pre-0-1.0 00000100:00080000:2.0:1784044253.977320:0:3640:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.202.140@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1784044253.977325:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9b3950226800 MGS: changing import state from FULL to DISCONN 00000100:02020000:2.0:1784044253.977329:0:3640:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.202.140@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:3.0:1784044253.978614:0:3638:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.202.140@tcp of MGS@0@lo abruptly disconnected: reconnecting 00010000:00010000:0.0:1784044253.979974:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784044253.979997:0:10330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784044253.980203:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38436a1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3638:x1870705581021440:12345-0@lo:103:ldlm_bl.0 Request processed in 18061us (18552us total) trans 0 rc -107/-107 00000100:00100000:0.0:1784044253.980216:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:2.0:1784044254.020884:0:3640:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.202.140@tcp not replayable, auto-deactivating 00000100:00080000:2.0:1784044254.020890:0:3640:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1784044254.020900:0:3640:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9b397a8a5880 x1870705581020288/t0(0) o400->MGC192.168.202.140@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1784044268 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784044254.020943:0:3640:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9b3843c57480 x1870705581021440/t0(0) o103->MGC192.168.202.140@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1784044269 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784044254.020955:0:3640:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9b38436a1c00 x1870705581021952/t0(0) o103->MGC192.168.202.140@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1784044269 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784044254.020965:0:3640:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9b3843c56d80 x1870705581021568/t0(0) o103->MGC192.168.202.140@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1784044269 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784044254.020974:0:3640:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9b3843c57100 x1870705581021696/t0(0) o103->MGC192.168.202.140@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1784044269 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784044254.020988:0:3640:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9b38436a0000 x1870705581021824/t0(0) o103->MGC192.168.202.140@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1784044269 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1784044254.020998:0:3640:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1784044254.021002:0:3640:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1784044254.021003:0:3640:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1784044254.025221:0:3638:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff9b3950226800 already not connected (conn 1, was 1): DISCONN 00000100:00100000:3.0:1784044254.025284:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843c57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:3638:1870705581021440:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784044254.025296:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b38436a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:3638:1870705581021952:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784044254.025328:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843c56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:3638:1870705581021568:0@lo:103:ldlm_bl.0 00000100:00080000:2.0:1784044254.028031:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9b3950226800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784044254.028046:0:3640:0:(import.c:510:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 0@lo last attempt 139 00000100:00080000:2.0:1784044254.028058:0:3640:0:(import.c:624:import_select_connection()) MGC192.168.202.140@tcp: import ffff9b3950226800 using connection 192.168.202.140@tcp/0@lo 00000100:00100000:2.0:1784044254.028129:0:3640:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b3975b7f100 x1870705581022336/t0(0) o250->MGC192.168.202.140@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1784044254.028294:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843c57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:3640:1870705581021696:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784044254.028305:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397a8a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:3640:1870705581020288:0@lo:400:kworker.0 00000100:00100000:2.0:1784044254.028354:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b38436a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:3640:1870705581021824:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784044254.028490:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3975b7f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:3637:1870705581022336:0@lo:250:ptlrpcd_00_02.0 00000400:00000100:3.0:1784044254.028539:0:3637:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1870705581022336 offset 0 length 520: 4 00000020:00080000:3.0:1784044254.042068:0:15411:0:(genops.c:1579:class_disconnect_exports()) OBD device 11 (ffff9b3974da0000) has no exports 00000020:01000000:0.0:1784044254.088634:0:15411:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9b38425c01e0 - data ffff9b395d6e0870/ffff9b397b816c00 00000020:01000000:0.0:1784044254.088914:0:15411:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9b397421df00 - data ffff9b395d62ee58/ffff9b397b779c00 00000001:00000004:1.0:1784044254.102604:0:15411:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967301 00000100:00080000:0.0:1784044254.189155:0:15411:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1784044254.189167:0:15411:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 4 00000100:00100000:0.0:1784044254.189213:0:15411:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:0.0:1784044254.193305:0:15411:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1784044254.193316:0:15411:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967298 gen 4 00000004:00080000:0.0:1784044254.193331:0:15411:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1784044254.193334:0:15411:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1784044254.195334:0:8445:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1784044254.195343:0:8445:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 1 count 1 00000040:00080000:1.0:1784044254.195367:0:8445:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:0.0:1784044254.196334:0:15411:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1784044254.196341:0:15411:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 4 00000004:00080000:0.0:1784044254.196366:0:15411:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1784044254.196369:0:15411:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1784044254.197400:0:9814:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1784044254.197405:0:9814:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 1 count 1 00000040:00080000:1.0:1784044254.197416:0:9814:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:0.0:1784044254.198907:0:15411:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x89871fc3aba17baa 00000020:00000080:0.0:1784044254.198919:0:15411:0:(genops.c:906:class_export_put()) final put ffff9b3974daf000/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1784044254.201900:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9b3974daf000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:0.0:1784044254.207160:0:15411:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x89871fc3aba17bbf 00000020:00000080:0.0:1784044254.207521:0:15411:0:(genops.c:906:class_export_put()) final put ffff9b3974dae000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:0.0:1784044254.207576:0:15411:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdtlov (flags='') 00000020:00000080:0.0:1784044254.207583:0:15411:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1784044254.207594:0:15411:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1784044254.207600:0:15411:0:(genops.c:1579:class_disconnect_exports()) OBD device 10 (ffff9b3974da4d40) has no exports 00000004:01000000:0.0:1784044254.207791:0:15411:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:0.0:1784044254.207799:0:15411:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x89871fc3aba17ec8 00000020:00000080:0.0:1784044254.207804:0:15411:0:(genops.c:906:class_export_put()) final put ffff9b3843459800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1784044254.213086:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9b3974dae000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:0.0:1784044254.213243:0:15411:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0001 (flags='') 00000020:00000080:0.0:1784044254.213610:0:15411:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1784044254.213627:0:15411:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1784044254.213632:0:15411:0:(genops.c:1579:class_disconnect_exports()) OBD device 27 (ffff9b38435619c0) has no exports 00000020:00000080:0.0:1784044254.213651:0:15411:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x89871fc3aba17ec1 00000020:00000080:0.0:1784044254.213659:0:15411:0:(genops.c:906:class_export_put()) final put ffff9b396f2f7800/lustre-MDT0001-osd_UUID 00010000:01000000:0.0:1784044254.214085:0:15411:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0001: client import never connected 00000100:00080000:0.0:1784044254.214090:0:15411:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1784044254.214094:0:15411:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 5 00000004:00080000:0.0:1784044254.214100:0:15411:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1784044254.214102:0:15411:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1784044254.214135:0:15411:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1784044254.214143:0:15411:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1784044254.214151:0:15411:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x89871fc3aba17d1d 00000020:00000080:0.0:1784044254.214487:0:15411:0:(genops.c:906:class_export_put()) final put ffff9b3842087000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:0.0:1784044254.214493:0:15411:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0001 (flags='') 00000020:00000080:0.0:1784044254.214498:0:15411:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1784044254.214503:0:15411:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1784044254.214506:0:15411:0:(genops.c:1579:class_disconnect_exports()) OBD device 18 (ffff9b3842113380) has no exports 00000020:00000080:0.0:1784044254.214511:0:15411:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x89871fc3aba17d16 00000020:00000080:0.0:1784044254.214516:0:15411:0:(genops.c:906:class_export_put()) final put ffff9b3842123000/lustre-MDT0001-osd_UUID 00010000:01000000:0.0:1784044254.214995:0:15411:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0001: client import never connected 00000100:00080000:0.0:1784044254.214999:0:15411:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1784044254.215002:0:15411:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967298 gen 5 00000004:00080000:0.0:1784044254.215007:0:15411:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1784044254.215008:0:15411:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1784044254.215035:0:15411:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1784044254.215040:0:15411:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000004:01000000:0.0:1784044254.215055:0:15411:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:0.0:1784044254.215061:0:15411:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x89871fc3aba17be2 00000020:00000080:0.0:1784044254.215065:0:15411:0:(genops.c:906:class_export_put()) final put ffff9b397b63e000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:0.0:1784044254.215069:0:15411:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osp-MDT0001 (flags='F') 00000020:00000080:0.0:1784044254.215073:0:15411:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1784044254.215076:0:15411:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osp-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1784044254.215079:0:15411:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff9b3970fe3380) has no exports 00000020:00000080:0.0:1784044254.215083:0:15411:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x89871fc3aba17bdb 00000020:00000080:0.0:1784044254.215094:0:15411:0:(genops.c:906:class_export_put()) final put ffff9b397b63c000/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1784044254.215381:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9b3843459800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:00000080:1.0:1784044254.215794:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9b396f2f7800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1784044254.215803:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9b396f2f4000 for lustre-OST0001-osc-MDT0001 00000020:00000080:1.0:1784044254.215810:0:37:0:(genops.c:906:class_export_put()) final put ffff9b397b806800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1784044254.215813:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9b397b806800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:01000000:1.0:1784044254.215818:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1784044254.215911:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9b3842087000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:00000080:1.0:1784044254.215915:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9b3842123000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1784044254.215919:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9b3842126000 for lustre-OST0000-osc-MDT0001 00000020:00000080:1.0:1784044254.215923:0:37:0:(genops.c:906:class_export_put()) final put ffff9b39741fb800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1784044254.215925:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9b39741fb800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:1.0:1784044254.215942:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1784044254.215969:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9b397b63e000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:1.0:1784044254.215973:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9b397b63c000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:1.0:1784044254.222555:0:15411:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000100:00080000:1.0:1784044254.222565:0:15411:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1784044254.222569:0:15411:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 5 00000100:00100000:1.0:1784044254.222578:0:15411:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1784044254.222635:0:15411:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1784044254.222647:0:15411:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1784044254.222697:0:15411:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1784044254.222701:0:15411:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1784044254.222707:0:15411:0:(genops.c:906:class_export_put()) final put ffff9b3974dab800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1784044254.222712:0:15411:0:(genops.c:865:class_export_destroy()) destroying export ffff9b3974dab800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:1.0:1784044254.222722:0:15411:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1784044254.222918:0:15411:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x89871fc3aba17bc6 00000020:00000080:1.0:1784044254.222926:0:15411:0:(genops.c:906:class_export_put()) final put ffff9b3974dab000/lustre-MDD0001_UUID 00000020:01000000:1.0:1784044254.222944:0:15411:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:1.0:1784044254.222949:0:15411:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1784044254.222953:0:15411:0:(obd_config.c:955:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1784044254.222957:0:15411:0:(genops.c:1579:class_disconnect_exports()) OBD device 12 (ffff9b3974da3380) has no exports 00000020:00000080:1.0:1784044254.222981:0:15411:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1784044254.222984:0:15411:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:1.0:1784044254.222989:0:15411:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x89871fc3aba17bcd 00000020:00000080:1.0:1784044254.222993:0:15411:0:(genops.c:906:class_export_put()) final put ffff9b3974daa800/lustre-MDT0001-osd_UUID 00000020:01000004:1.0:1784044254.223013:0:15411:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9b396f3cf800 from lustre-MDT0001, refs=2 00000020:01000004:1.0:1784044254.223028:0:15411:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9b396f3cf800 2 00000020:01000004:1.0:1784044254.223032:0:15411:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9b396f3cf800 from lustre-MDT0001 00000020:00000080:1.0:1784044254.223053:0:15411:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1784044254.223057:0:15411:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:1.0:1784044254.223059:0:15411:0:(genops.c:906:class_export_put()) final put ffff9b3974daf800/lustre-MDT0001_UUID 00000020:00000080:1.0:1784044254.223062:0:15411:0:(genops.c:865:class_export_destroy()) destroying export ffff9b3974daf800/lustre-MDT0001_UUID for lustre-MDT0001 00000020:01000000:1.0:1784044254.223069:0:15411:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:01000004:1.0:1784044254.223100:0:15411:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000000:1.0:1784044254.223104:0:15411:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:1.0:1784044254.223106:0:15411:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1784044254.223109:0:15411:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1784044254.223116:0:15411:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffff9b3975858000 lustre-MDT0000-lwp-MDT0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1784044254.223121:0:15411:0:(genops.c:1574:class_disconnect_exports()) OBD device 14 (ffff9b3974da19c0) has exports, disconnecting them 00000020:00080000:1.0:1784044254.223125:0:15411:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 0@lo (ffff9b3975858000), last request at 1784043968 00000020:00000080:1.0:1784044254.223129:0:15411:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x89871fc3aba17c21 00000020:00080000:1.0:1784044254.223143:0:15411:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9b3975858000): rc 0 00000020:00000080:1.0:1784044254.223147:0:15411:0:(genops.c:906:class_export_put()) final put ffff9b3975858000/lustre-MDT0000-lwp-MDT0001 00000020:00000080:3.0:1784044254.223400:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9b397b63a000 for lustre-MDT0000-osp-MDT0001 00000020:00000080:3.0:1784044254.223408:0:37:0:(genops.c:906:class_export_put()) final put ffff9b3970ff4800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1784044254.223411:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9b3970ff4800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:01000000:3.0:1784044254.223418:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1784044254.223537:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9b3974dab000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:00000080:3.0:1784044254.223541:0:37:0:(genops.c:906:class_export_put()) final put ffff9b3974da8800/lustre-MDD0001_UUID 00000020:00000080:3.0:1784044254.223543:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9b3974da8800/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000000:3.0:1784044254.223547:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:00000080:3.0:1784044254.223738:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9b3974daa800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1784044254.223742:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9b3975858000/lustre-MDT0000-lwp-MDT0001 for lustre-MDT0000-lwp-MDT0001 00010000:01000000:0.0:1784044254.260250:0:15411:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0001: client import never connected 00000100:00080000:0.0:1784044254.260258:0:15411:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1784044254.260263:0:15411:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1784044254.260270:0:15411:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1784044254.260603:0:15411:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1784044254.260612:0:15411:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000004:0.0:1784044254.260619:0:15411:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9b396f3cf800 1 00000020:00000080:0.0:1784044254.260626:0:15411:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x89871fc3aba17b5d 00000020:00000080:0.0:1784044254.260633:0:15411:0:(genops.c:906:class_export_put()) final put ffff9b396f3cd800/lustre-MDT0001-osd_UUID 00000020:01000000:0.0:1784044254.260639:0:15411:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osd (flags='') 00000020:00000080:0.0:1784044254.260643:0:15411:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1784044254.260646:0:15411:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1784044254.260650:0:15411:0:(genops.c:1579:class_disconnect_exports()) OBD device 9 (ffff9b39459bb380) has no exports 00000020:00000080:3.0:1784044254.264153:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9b397585d000 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:3.0:1784044254.264195:0:37:0:(genops.c:906:class_export_put()) final put ffff9b3974dac000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:3.0:1784044254.264199:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9b3974dac000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000-lwp-MDT0001 00000020:01000000:3.0:1784044254.264212:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0001 (lustre-MDT0000-lwp-MDT0001_UUID) 00000020:00000080:3.0:1784044254.264310:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9b396f3cd800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:0.0:1784044254.416205:0:15411:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1784044254.416224:0:15411:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00000020:00000080:0.0:1784044254.416235:0:15411:0:(genops.c:906:class_export_put()) final put ffff9b396f3ce800/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1784044254.416240:0:15411:0:(genops.c:865:class_export_destroy()) destroying export ffff9b396f3ce800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:0.0:1784044254.416250:0:15411:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osd (lustre-MDT0001-osd_UUID) 00000020:01000004:0.0:1784044254.416579:0:15411:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9b396f3c8800 00000020:01000000:0.0:1784044254.416601:0:15411:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:0.0:1784044254.416605:0:15411:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1784044254.416610:0:15411:0:(obd_config.c:955:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1784044254.416614:0:15411:0:(genops.c:1579:class_disconnect_exports()) OBD device 3 (ffff9b3970fe4d40) has no exports 00000100:00100000:3.0:1784044254.416820:0:6511:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff9b3965d1e000:6511] 0 exiting: rc = 1 00000100:00100000:3.0:1784044254.416969:0:6512:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff9b3965d1ec00:6512] 1 exiting: rc = 0 00000100:00100000:0.0:1784044254.417263:0:6513:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff9b3965d1fc00:6513] 2 exiting: rc = 0 00000100:00100000:1.0:1784044254.417398:0:13808:0:(service.c:3183:ptlrpc_main()) mdt00_004: service thread [ffff9b3843ce1a00:13808] 4 exiting: rc = 0 00000100:00100000:0.0:1784044254.417793:0:9501:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff9b3842031000:9501] 3 exiting: rc = 0 00000100:00100000:2.0:1784044254.417899:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044254.417908:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044254.417913:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044254.417919:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044254.417924:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044254.417952:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044254.417958:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044254.417964:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044254.417970:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044254.417975:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044254.417980:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044254.417985:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044254.417990:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044254.418004:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044254.418010:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044254.418016:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044254.418021:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044254.418027:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044254.418032:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044254.418037:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044254.418041:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044254.418046:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044254.418051:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044254.418056:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044254.418062:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044254.418067:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044254.418071:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044254.418077:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044254.418081:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044254.418087:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044254.418092:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044254.418107:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044254.418114:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044254.418119:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044254.418124:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044254.418129:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044254.418134:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044254.418140:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044254.418145:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044254.418152:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044254.418165:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044254.418170:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044254.418327:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044254.418334:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044254.418339:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044254.418345:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044254.418350:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044254.418418:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044254.418427:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044254.418433:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044254.418440:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044254.418447:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044254.418452:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044254.418458:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044254.418463:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044254.418468:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044254.418475:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044254.418480:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044254.418486:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044254.418492:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044254.418498:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044254.418503:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044254.418529:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044254.418537:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044254.437989:0:6515:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff9b3965d1f000:6515] 1 exiting: rc = 0 00000100:00100000:0.0:1784044254.442984:0:6514:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff9b3965d1ea00:6514] 0 exiting: rc = 1 00000100:00100000:1.0:1784044254.443156:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044254.443167:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044254.443212:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044254.443222:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044254.443229:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044254.443236:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044254.443244:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044254.443251:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044254.443257:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044254.443264:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044254.443271:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044254.443299:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044254.443307:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044254.443312:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044254.443318:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044254.443324:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044254.443330:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044254.443336:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044254.443341:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044254.443347:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044254.443353:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044254.443359:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044254.443365:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044254.443371:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044254.443377:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044254.443383:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044254.443390:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044254.443395:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044254.443400:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044254.443405:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044254.443410:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044254.443414:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044254.443419:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044254.443424:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044254.443429:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044254.443434:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044254.443439:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044254.443445:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044254.443450:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044254.443455:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044254.443460:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044254.443466:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044254.443472:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044254.443478:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044254.443484:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044254.443489:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044254.443505:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044254.443510:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044254.443516:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044254.443521:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044254.443528:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044254.443534:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044254.443541:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044254.443547:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044254.443553:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044254.443558:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044254.443564:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044254.443569:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044254.443575:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044254.443581:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044254.443586:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044254.443592:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044254.443598:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044254.443604:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044254.445369:0:6517:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff9b3965d19000:6517] 1 exiting: rc = 0 00000100:00100000:2.0:1784044254.445496:0:7768:0:(service.c:3183:ptlrpc_main()) mdt_out00_002: service thread [ffff9b3965db0800:7768] 2 exiting: rc = 0 00000100:00100000:0.0:1784044254.445668:0:6516:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff9b3965d18200:6516] 0 exiting: rc = 1 00000100:00100000:1.0:1784044254.446612:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044254.446623:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044254.446631:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044254.446638:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044254.446656:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044254.446666:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044254.446673:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044254.446679:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044254.446686:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044254.446694:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044254.446702:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044254.446708:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044254.446715:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044254.446731:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044254.446738:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044254.446744:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044254.446750:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044254.446770:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044254.446776:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044254.446782:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044254.446789:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044254.446795:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044254.446802:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044254.446808:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044254.446814:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044254.446835:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044254.446843:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044254.446850:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044254.446857:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044254.446863:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044254.446869:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044254.446875:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044254.446881:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044254.446887:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044254.446892:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044254.446898:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044254.446905:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044254.446942:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044254.446951:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044254.446957:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044254.446963:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044254.446969:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044254.446976:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044254.446981:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044254.446987:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044254.446993:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044254.446999:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044254.447004:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044254.447010:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044254.447030:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044254.447037:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044254.447043:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044254.447055:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044254.447061:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044254.447067:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044254.447073:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044254.447079:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044254.447085:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044254.447091:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044254.447104:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044254.447111:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044254.447116:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044254.447122:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044254.447135:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044254.466907:0:6518:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff9b3965d18600:6518] 0 exiting: rc = 1 00000100:00100000:3.0:1784044254.467136:0:6519:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff9b3965d18c00:6519] 1 exiting: rc = 0 00000100:00100000:0.0:1784044254.467744:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044254.467751:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044254.467756:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044254.467761:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044254.467776:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044254.467782:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044254.467787:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044254.467792:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044254.467797:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044254.467802:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044254.467806:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044254.467811:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044254.467817:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044254.467822:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044254.467827:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044254.467831:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044254.467836:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044254.467854:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044254.467859:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044254.467864:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044254.467869:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044254.467873:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044254.467878:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044254.467883:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044254.467888:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044254.467893:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044254.467898:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044254.467902:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044254.467907:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044254.467913:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044254.467918:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044254.467923:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044254.467937:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044254.467942:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044254.467948:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044254.467953:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044254.467958:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044254.467963:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044254.467967:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044254.467980:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044254.467986:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044254.467992:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044254.467998:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044254.468003:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044254.468008:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044254.468013:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044254.468018:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044254.468025:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044254.468031:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044254.468038:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044254.468043:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044254.468049:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044254.468055:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044254.468060:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044254.468066:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044254.468071:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044254.468076:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044254.468081:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044254.468087:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044254.468092:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044254.468097:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044254.468102:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044254.468106:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044254.468112:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044254.469099:0:6521:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff9b39502de600:6521] 1 exiting: rc = 0 00000100:00100000:1.0:1784044254.471906:0:6520:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff9b39502df600:6520] 0 exiting: rc = 1 00000100:00100000:0.0:1784044254.472141:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044254.472149:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044254.472155:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044254.472160:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044254.472165:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044254.472170:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044254.472208:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044254.472214:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044254.472220:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044254.472225:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044254.472246:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044254.472251:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044254.472256:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044254.472261:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044254.472266:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044254.472271:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044254.472276:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044254.472281:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044254.472286:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044254.472291:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044254.472296:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044254.472301:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044254.472306:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044254.472311:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044254.472316:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044254.472322:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044254.472327:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044254.472331:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044254.472336:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044254.472342:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044254.472348:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044254.472354:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044254.472359:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044254.472364:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044254.472369:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044254.472374:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044254.472379:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044254.472384:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044254.472389:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044254.472394:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044254.472399:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044254.472404:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044254.472409:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044254.472414:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044254.472419:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044254.472432:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044254.472437:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044254.472442:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044254.472459:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044254.472466:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044254.472471:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044254.472476:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044254.472482:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044254.472487:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044254.472493:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044254.472498:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044254.472503:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044254.472508:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044254.472514:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044254.472519:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044254.472523:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044254.472527:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044254.472532:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044254.472537:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044254.473199:0:6523:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff9b395038ae00:6523] 1 exiting: rc = 0 00000100:00100000:1.0:1784044254.473355:0:6522:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff9b395038a400:6522] 0 exiting: rc = 1 00000100:00100000:1.0:1784044254.477566:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044254.477576:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044254.477581:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044254.477585:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044254.477592:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044254.477596:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044254.477601:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044254.477606:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044254.477611:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044254.477615:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044254.477621:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044254.477626:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044254.477631:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044254.477635:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044254.477640:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044254.477644:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044254.477649:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044254.477653:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044254.477657:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044254.477661:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044254.477665:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044254.477683:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044254.477687:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044254.477691:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044254.477696:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044254.477700:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044254.477705:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044254.477710:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044254.477714:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044254.477718:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044254.477722:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044254.477727:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044254.477731:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044254.477736:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044254.477744:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044254.477749:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044254.477754:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044254.477759:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044254.477764:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044254.477769:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044254.477774:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044254.477779:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044254.477785:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044254.477791:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044254.477797:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044254.477802:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044254.477808:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044254.477817:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044254.477822:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044254.477826:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044254.477831:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044254.477849:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044254.477855:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044254.477860:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044254.477865:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044254.477870:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044254.477882:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044254.477887:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044254.477892:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044254.477896:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044254.477902:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044254.477907:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044254.477913:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044254.477919:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044254.483189:0:6524:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff9b3965d18400:6524] 0 exiting: rc = 1 00000100:00100000:3.0:1784044254.483406:0:6526:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff9b39498ed800:6526] 2 exiting: rc = 0 00000100:00100000:0.0:1784044254.488017:0:6525:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff9b395038b400:6525] 1 exiting: rc = 0 00000100:00100000:2.0:1784044254.489290:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044254.489302:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044254.489309:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044254.489315:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044254.489320:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044254.489339:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044254.489357:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044254.489365:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044254.489387:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044254.489394:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044254.489401:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044254.489407:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044254.489413:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044254.489419:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044254.489426:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044254.489432:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044254.489438:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044254.489444:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044254.489459:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044254.489466:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044254.489471:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044254.489477:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044254.489484:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044254.489489:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044254.489494:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044254.489499:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044254.489505:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044254.489511:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044254.489517:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044254.489523:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044254.489547:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044254.489554:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044254.489559:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044254.489564:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044254.489569:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044254.489575:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044254.489581:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044254.489587:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044254.489593:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044254.489600:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044254.489606:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044254.489611:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044254.489616:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044254.489630:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044254.489636:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044254.489641:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044254.489647:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044254.489652:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044254.489658:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044254.489664:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044254.489669:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044254.489674:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044254.489680:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044254.489686:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044254.489705:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044254.489712:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044254.489717:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044254.489722:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044254.489728:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044254.489733:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044254.489738:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044254.489745:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044254.489752:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784044254.489758:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1784044254.496796:0:15411:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1784044254.496809:0:15411:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:2.0:1784044254.496815:0:15411:0:(genops.c:906:class_export_put()) final put ffff9b39741fe000/MDS_uuid 00000020:00000080:2.0:1784044254.496820:0:15411:0:(genops.c:865:class_export_destroy()) destroying export ffff9b39741fe000/MDS_uuid for MDS 00000020:01000000:2.0:1784044254.496829:0:15411:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:2.0:1784044254.497565:0:15411:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0001 complete 00010000:00010000:1.0:1784044254.872512:0:10331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784044255.891123:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784044256.909314:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1784044257.359585:0:14129:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1784044257.359597:0:14129:0:(pinger.c:247:ptlrpc_pinger_process_import()) 8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1784044257.359600:0:14129:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1784044257.359604:0:14129:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1784044257.359608:0:14129:0:(import.c:65:import_set_state_nolock()) ffff9b3974da9800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784044257.359618:0:14129:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 445 00000100:00080000:1.0:1784044257.359624:0:14129:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1784044257.359632:0:14129:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9b3974da9800 using connection 192.168.202.140@tcp/0@lo 00000100:00100000:1.0:1784044257.359674:0:14129:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b3843736a00 x1870705581022464/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1784044257.359733:0:14129:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1784044257.359736:0:14129:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1784044257.359738:0:14129:0:(import.c:65:import_set_state_nolock()) ffff9b384345d800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784044257.359742:0:14129:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 445 00000100:00080000:1.0:1784044257.359744:0:14129:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1784044257.359747:0:14129:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9b384345d800 using connection 192.168.202.140@tcp/0@lo 00000100:00100000:1.0:1784044257.359760:0:14129:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b3843736d80 x1870705581022720/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1784044257.359831:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843737480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3639:1870705581022592:0@lo:400:kworker.0 00000400:00000100:1.0:1784044257.359885:0:3639:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1870705581022592 offset 0 length 224: 4 00000100:00100000:1.0:1784044257.359977:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843737100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3640:1870705581022848:0@lo:400:kworker.0 00000400:00000100:1.0:1784044257.359996:0:3640:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1870705581022848 offset 0 length 224: 4 00000100:00100000:2.0:1784044257.360093:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843736a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3637:1870705581022464:0@lo:38:kworker.0 00000400:00000100:2.0:1784044257.360116:0:3637:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1870705581022464 offset 0 length 520: 4 00000100:00100000:2.0:1784044257.360127:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843736d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3637:1870705581022720:0@lo:38:kworker.0 00000400:00000100:2.0:1784044257.360140:0:3637:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1870705581022720 offset 0 length 520: 4 00010000:00010000:1.0:1784044257.933950:0:10330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1784044258.767937:0:15612:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:3.0:1784044258.783244:0:15612:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0000 00010000:00010000:3.0:1784044258.783346:0:15612:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b3982055600/0x89871fc3aba17f9a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba17fa1 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044258.783368:0:15612:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b3982055600/0x89871fc3aba17f9a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x89871fc3aba17fa1 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044258.783377:0:15612:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b3982055600/0x89871fc3aba17f9a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x89871fc3aba17fa1 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044258.783386:0:15612:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.140@tcp lock: ffff9b3982055600/0x89871fc3aba17f9a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x89871fc3aba17fa1 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044258.783423:0:15612:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1784044258.783431:0:15612:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1784044258.783470:0:15612:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1784044258.783490:0:15612:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9b3843736a00 x1870705581022464/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1784044282 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784044258.783520:0:15612:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1784044258.783529:0:15612:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1784044258.783558:0:15612:0:(import.c:65:import_set_state_nolock()) ffff9b3974da9800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:3.0:1784044258.783566:0:15612:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1784044258.783572:0:15612:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9b3843736a00 x1870705581022464/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1784044282 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784044258.783580:0:15612:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1784044258.783584:0:15612:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 32s for inflight to error out 00010000:00010000:0.0:1784044258.783605:0:10331:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784044258.783614:0:10331:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: ffff9b3982055600/0x89871fc3aba17f9a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x89871fc3aba17fa1 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044258.783623:0:10331:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3982055600 already unused, calling callback (ffffffffc113cc20) 10000000:00010000:0.0:1784044258.783637:0:10331:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: ffff9b3982055600/0x89871fc3aba17f9a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x89871fc3aba17fa1 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044258.783648:0:10331:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9b3982055600/0x89871fc3aba17f9a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x89871fc3aba17fa1 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044258.783649:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843736a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3637:1870705581022464:0@lo:38:kworker.0 10000000:00010000:0.0:1784044258.783656:0:10331:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9b3982055600/0x89871fc3aba17f9a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x89871fc3aba17fa1 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784044258.783671:0:10331:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1784044258.783673:0:10331:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1784044258.783676:0:10331:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1784044258.783694:0:10331:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9b3950226800 00010000:00010000:0.0:1784044258.783707:0:10331:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: ffff9b3982055600/0x89871fc3aba17f9a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x89871fc3aba17fa1 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044258.783716:0:10331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9b3982055600/0x89871fc3aba17f9a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x89871fc3aba17fa1 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044258.783729:0:10331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784044258.783731:0:10331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784044258.783733:0:10331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1784044258.784588:0:15612:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1784044258.784603:0:15612:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9b3843737480 x1870705581022592/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044273 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784044258.784626:0:15612:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1784044258.784633:0:15612:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1784044258.784663:0:15612:0:(import.c:65:import_set_state_nolock()) ffff9b384244e000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1784044258.784709:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843ce6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3637:1870705581022976:0@lo:39:umount.0 00000400:00000100:3.0:1784044258.784782:0:3637:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1870705581022976 offset 0 length 224: 4 00000100:00100000:0.0:1784044258.785681:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843737480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3639:1870705581022592:0@lo:400:kworker.0 00010000:00010000:3.0:1784044258.959637:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1784044259.405613:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1784044259.405630:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1784044259.405634:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1784044259.405638:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1784044259.406382:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784044259.406418:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843734380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3640:1870705581023104:0@lo:400:kworker.0 00000400:00000100:2.0:1784044259.406548:0:3640:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1870705581023104 offset 0 length 224: 4 00000001:00100000:3.0:1784044259.933249:0:8421:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1784044259.933259:0:8421:0:(genops.c:906:class_export_put()) final put ffff9b3842097800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1784044259.933329:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9b3842097800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:1.0:1784044259.933420:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9b3842094800 for lustre-OST0000 00000001:00100000:3.0:1784044259.934728:0:9505:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1784044259.934739:0:9505:0:(genops.c:906:class_export_put()) final put ffff9b384317d000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1784044259.940512:0:14129:0:(genops.c:865:class_export_destroy()) destroying export ffff9b384317d000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000020:00000080:0.0:1784044259.944164:0:14129:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9b384317d800 for lustre-OST0001 00010000:00010000:0.0:1784044259.983572:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784044261.009997:0:10330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784044262.031693:0:10331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1784044262.415654:0:14129:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1784044262.415672:0:14129:0:(pinger.c:247:ptlrpc_pinger_process_import()) 8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1784044262.415675:0:14129:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1784044262.415679:0:14129:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1784044262.415895:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1784044262.415931:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3947eea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3639:1870705581023232:0@lo:400:kworker.0 00000400:00000100:2.0:1784044262.416015:0:3639:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1870705581023232 offset 0 length 224: 4 00010000:00010000:3.0:1784044263.053413:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784044264.083258:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784044264.911237:0:3637:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1784044254/real 1784044254] req@ffff9b3975b7f100 x1870705581022336/t0(0) o250->MGC192.168.202.140@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1784044264 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784044264.911324:0:3637:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9b3975b7f100 x1870705581022336/t0(0) o250->MGC192.168.202.140@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1784044264 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1784044264.911352:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9b3950226800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1784044264.911388:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:0.0:1784044264.911394:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3975b7f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:3637:1870705581022336:0@lo:250:ptlrpcd_00_02.0 00000100:00080000:3.0:1784044264.911515:0:14129:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1784044264.911522:0:14129:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1784044264.911526:0:14129:0:(import.c:65:import_set_state_nolock()) ffff9b3950226800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784044264.911532:0:14129:0:(import.c:510:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 0@lo last attempt 447 00000100:00080000:3.0:1784044264.911538:0:14129:0:(import.c:589:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1784044264.911556:0:14129:0:(import.c:624:import_select_connection()) MGC192.168.202.140@tcp: import ffff9b3950226800 using connection 192.168.202.140@tcp/0@lo 00000100:00100000:3.0:1784044264.911597:0:14129:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b3843ce5500 x1870705581023360/t0(0) o250->MGC192.168.202.140@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1784044264.911630:0:14129:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1784044264.911635:0:14129:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1784044264.911762:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843ce7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3639:1870705581023488:0@lo:400:kworker.0 00000400:00000100:2.0:1784044264.911848:0:3639:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1870705581023488 offset 0 length 224: 4 00000100:00100000:0.0:1784044264.913093:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843ce5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:3637:1870705581023360:0@lo:250:kworker.0 00000400:00000100:0.0:1784044264.913153:0:3637:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1870705581023360 offset 0 length 520: 4 00010000:00010000:1.0:1784044265.102035:0:10330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784044266.126232:0:10331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784044267.149393:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784044268.174374:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784044269.005386:0:3637:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1784044258/real 1784044258] req@ffff9b3843ce6d80 x1870705581022976/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1784044268 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784044269.005430:0:3637:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9b3843ce6d80 x1870705581022976/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1784044268 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1784044269.005455:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9b384244e000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1784044269.005474:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843ce6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3637:1870705581022976:0@lo:39:umount.0 00000100:00080000:3.0:1784044269.005634:0:15612:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1784044269.005650:0:15612:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1784044269.005657:0:15612:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1784044269.007011:0:15612:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b39586ef800/0x89871fc3aba17fa8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba17faf expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044269.007037:0:15612:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b39586ef800/0x89871fc3aba17fa8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x89871fc3aba17faf expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044269.007047:0:15612:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b39586ef800/0x89871fc3aba17fa8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x89871fc3aba17faf expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044269.007056:0:15612:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.140@tcp lock: ffff9b39586ef800/0x89871fc3aba17fa8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x89871fc3aba17faf expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044269.007228:0:15612:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784044269.007239:0:15612:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b38426fd200/0x89871fc3aba18264 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba1826b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044269.007247:0:15612:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b38426fd200/0x89871fc3aba18264 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x89871fc3aba1826b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044269.007255:0:15612:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b38426fd200/0x89871fc3aba18264 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x89871fc3aba1826b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044269.007283:0:15612:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.140@tcp lock: ffff9b38426fd200/0x89871fc3aba18264 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x89871fc3aba1826b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044269.011220:0:10330:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1784044269.011240:0:10330:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: ffff9b39586ef800/0x89871fc3aba17fa8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x89871fc3aba17faf expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044269.011255:0:10330:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b39586ef800 already unused, calling callback (ffffffffc113cc20) 10000000:00010000:1.0:1784044269.011260:0:10330:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: ffff9b39586ef800/0x89871fc3aba17fa8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x89871fc3aba17faf expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044269.011273:0:10330:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9b39586ef800/0x89871fc3aba17fa8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x89871fc3aba17faf expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784044269.011282:0:10330:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9b39586ef800/0x89871fc3aba17fa8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x89871fc3aba17faf expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784044269.011314:0:10330:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1784044269.011317:0:10330:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 00010000:00010000:1.0:1784044269.011338:0:10330:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9b3950226800 00010000:00010000:1.0:1784044269.011342:0:10330:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: ffff9b39586ef800/0x89871fc3aba17fa8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x89871fc3aba17faf expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044269.011349:0:10330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9b39586ef800/0x89871fc3aba17fa8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x89871fc3aba17faf expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044269.011371:0:10330:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784044269.011375:0:10330:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: ffff9b38426fd200/0x89871fc3aba18264 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x89871fc3aba1826b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044269.011380:0:10330:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38426fd200 already unused, calling callback (ffffffffc113cc20) 10000000:00010000:1.0:1784044269.011383:0:10330:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: ffff9b38426fd200/0x89871fc3aba18264 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x89871fc3aba1826b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044269.011390:0:10330:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9b38426fd200/0x89871fc3aba18264 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x89871fc3aba1826b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784044269.011396:0:10330:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9b38426fd200/0x89871fc3aba18264 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x89871fc3aba1826b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784044269.011402:0:10330:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1784044269.011404:0:10330:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:1.0:1784044269.011409:0:10330:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9b3950226800 00010000:00010000:1.0:1784044269.011412:0:10330:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: ffff9b38426fd200/0x89871fc3aba18264 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x89871fc3aba1826b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044269.011429:0:10330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784044269.011431:0:10330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784044269.011433:0:10330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784044269.011791:0:15612:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1784044269.011814:0:15612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9b38426fd200/0x89871fc3aba18264 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x89871fc3aba1826b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784044269.011829:0:15612:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:3.0:1784044269.011837:0:15612:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 10000000:01000000:3.0:1784044269.011841:0:15612:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:3.0:1784044269.011899:0:15612:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0000 00000020:01000000:3.0:1784044269.011905:0:15612:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:3.0:1784044269.011914:0:15612:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1784044269.011921:0:15612:0:(obd_config.c:955:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1784044269.011926:0:15612:0:(genops.c:1579:class_disconnect_exports()) OBD device 19 (ffff9b3974253380) has no exports 00010000:00010000:0.0:1784044269.012074:0:10331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:3.0:1784044269.012409:0:15612:0:(genops.c:1579:class_disconnect_exports()) OBD device 19 (ffff9b3974253380) has no exports 00000020:01000000:3.0:1784044269.019051:0:15612:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9b38425c0240 - data ffff9b395d62fe58/ffff9b397b960800 00000020:01000000:2.0:1784044269.020145:0:15612:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9b38425080c0 - data ffff9b395d698870/ffff9b3975b66c00 00100000:10000000:2.0:1784044269.048527:0:15612:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:1.0:1784044269.069869:0:15612:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x89871fc3aba17d2b 00000020:00000080:1.0:1784044269.069892:0:15612:0:(genops.c:906:class_export_put()) final put ffff9b3842083800/lustre-OST0000-osd_UUID 00000020:01000004:1.0:1784044269.069909:0:15612:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9b3975aa3000 from lustre-OST0000, refs=2 00000020:01000004:1.0:1784044269.069913:0:15612:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9b3975aa3000 2 00000020:01000004:1.0:1784044269.069916:0:15612:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9b3975aa3000 from lustre-OST0000 00000020:00000080:1.0:1784044269.069941:0:15612:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1784044269.069984:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9b3842083800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1784044269.070022:0:15612:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:1.0:1784044269.070026:0:15612:0:(genops.c:906:class_export_put()) final put ffff9b3842085000/lustre-OST0000_UUID 00000020:00000080:1.0:1784044269.070029:0:15612:0:(genops.c:865:class_export_destroy()) destroying export ffff9b3842085000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:1.0:1784044269.070035:0:15612:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:1.0:1784044269.070100:0:15612:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:1.0:1784044269.070105:0:15612:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:1.0:1784044269.070109:0:15612:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1784044269.070114:0:15612:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1784044269.070121:0:15612:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff9b3842094000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1784044269.070127:0:15612:0:(genops.c:1574:class_disconnect_exports()) OBD device 21 (ffff9b3842453380) has exports, disconnecting them 00000020:00080000:1.0:1784044269.070132:0:15612:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff9b3842094000), last request at 1784043990 00000020:00000080:1.0:1784044269.070136:0:15612:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x89871fc3aba17d94 00000020:00080000:1.0:1784044269.070146:0:15612:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9b3842094000): rc 0 00000020:00000080:1.0:1784044269.070162:0:15612:0:(genops.c:906:class_export_put()) final put ffff9b3842094000/lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1784044269.071736:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9b3842094000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:0.0:1784044269.078440:0:15612:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:0.0:1784044269.078448:0:15612:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1784044269.078453:0:15612:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1784044269.078460:0:15612:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1784044269.078561:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9b3974da9800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1784044269.078696:0:15612:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1784044269.078706:0:15612:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:0.0:1784044269.078712:0:15612:0:(genops.c:906:class_export_put()) final put ffff9b3842091000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:0.0:1784044269.078716:0:15612:0:(genops.c:865:class_export_destroy()) destroying export ffff9b3842091000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:0.0:1784044269.078737:0:15612:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:0.0:1784044269.078820:0:15612:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:0.0:1784044269.078824:0:15612:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1784044269.078829:0:15612:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1784044269.078836:0:15612:0:(genops.c:1840:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff9b3842449000 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1784044269.078842:0:15612:0:(genops.c:1574:class_disconnect_exports()) OBD device 22 (ffff9b3970fe19c0) has exports, disconnecting them 00000020:00080000:0.0:1784044269.078847:0:15612:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff9b3842449000), last request at 1784043990 00000020:00000080:0.0:1784044269.078852:0:15612:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x89871fc3aba17da9 00000020:00080000:0.0:1784044269.078868:0:15612:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9b3842449000): rc 0 00000020:00000080:0.0:1784044269.078874:0:15612:0:(genops.c:906:class_export_put()) final put ffff9b3842449000/lustre-MDT0001-lwp-OST0000 00000020:00000080:3.0:1784044269.078890:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9b3842449000/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:0.0:1784044269.079649:0:15612:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:0.0:1784044269.079653:0:15612:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1784044269.079656:0:15612:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1784044269.079659:0:15612:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1784044269.079693:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9b384244e000 for lustre-MDT0001-lwp-OST0000 00000020:00000080:0.0:1784044269.079752:0:15612:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1784044269.079756:0:15612:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:0.0:1784044269.079759:0:15612:0:(genops.c:906:class_export_put()) final put ffff9b3842448800/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:0.0:1784044269.079760:0:15612:0:(genops.c:865:class_export_destroy()) destroying export ffff9b3842448800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:0.0:1784044269.079764:0:15612:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:0.0:1784044269.079806:0:15612:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9b3975aa3000 1 00000020:00000080:0.0:1784044269.079811:0:15612:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x89871fc3aba17cc2 00000020:00000080:0.0:1784044269.079816:0:15612:0:(genops.c:906:class_export_put()) final put ffff9b397590d800/lustre-OST0000-osd_UUID 00000020:01000000:0.0:1784044269.079830:0:15612:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:0.0:1784044269.079834:0:15612:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1784044269.079837:0:15612:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1784044269.079840:0:15612:0:(genops.c:1579:class_disconnect_exports()) OBD device 16 (ffff9b3944028000) has no exports 00000020:00000080:3.0:1784044269.079864:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9b397590d800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:2.0:1784044269.109467:0:15612:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1784044269.109481:0:15612:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:2.0:1784044269.109488:0:15612:0:(genops.c:906:class_export_put()) final put ffff9b3975aa2800/lustre-OST0000-osd_UUID 00000020:00000080:2.0:1784044269.109492:0:15612:0:(genops.c:865:class_export_destroy()) destroying export ffff9b3975aa2800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:2.0:1784044269.109502:0:15612:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:2.0:1784044269.109682:0:15612:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9b3975aa5800 00000020:02000400:2.0:1784044269.109723:0:15612:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:3.0:1784044269.198427:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1784044270.158610:0:14129:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1784044270.158619:0:14129:0:(pinger.c:247:ptlrpc_pinger_process_import()) 8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1784044270.158630:0:14129:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1784044270.158633:0:14129:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1784044270.158724:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1784044270.158745:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3947eeaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3641:1870705581023616:0@lo:400:kworker.0 00000400:00000100:1.0:1784044270.158809:0:3641:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1870705581023616 offset 0 length 224: 4 00010000:00010000:0.0:1784044270.221772:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784044271.246370:0:10330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784044272.277854:0:10331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784044273.294597:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000400:1.0:1784044273.741720:0:3640:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1784044257/real 1784044257] req@ffff9b3843737100 x1870705581022848/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1784044273 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784044273.786993:0:3640:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff9b3843737100 x1870705581022848/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1784044273 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1784044273.787012:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9b3843441000 lustre-MDT0001_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1784044273.787016:0:3640:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0001-lwp-OST0001: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1784044273.819027:0:3640:0:(import.c:418:ptlrpc_pinger_force()) lustre-MDT0001_UUID: waking up pinger s:DISCONN 00000100:00080000:3.0:1784044273.819116:0:14129:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1784044273.819124:0:14129:0:(pinger.c:247:ptlrpc_pinger_process_import()) 8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1784044273.819127:0:14129:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1784044273.819149:0:14129:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1784044273.819152:0:14129:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1784044273.819156:0:14129:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1784044273.819160:0:14129:0:(import.c:65:import_set_state_nolock()) ffff9b3843441000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784044273.819170:0:14129:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 203 00000100:00080000:3.0:1784044273.819203:0:14129:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff9b3843441000 using connection 192.168.202.140@tcp/0@lo 00000100:00100000:3.0:1784044273.819250:0:14129:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b3843ce4e00 x1870705581023744/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1784044273.820138:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843ce4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3637:1870705581023744:0@lo:38:kworker.0 00000400:00000100:0.0:1784044273.820236:0:3637:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1870705581023744 offset 0 length 520: 4 00000100:00100000:2.0:1784044273.831762:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843737100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3640:1870705581022848:0@lo:400:kworker.0 00010000:00010000:0.0:1784044274.317452:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1784044274.407562:0:15814:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:2.0:1784044274.422092:0:15814:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0001 00010000:00010000:2.0:1784044274.422426:0:15814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b3982055200/0x89871fc3aba17f7e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba17f85 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044274.422442:0:15814:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b3982055200/0x89871fc3aba17f7e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x89871fc3aba17f85 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044274.422451:0:15814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b3982055200/0x89871fc3aba17f7e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x89871fc3aba17f85 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044274.422460:0:15814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.140@tcp lock: ffff9b3982055200/0x89871fc3aba17f7e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x89871fc3aba17f85 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044274.422756:0:15814:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1784044274.422763:0:15814:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00010000:00010000:3.0:1784044274.422841:0:10330:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784044274.422851:0:10330:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: ffff9b3982055200/0x89871fc3aba17f7e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x89871fc3aba17f85 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044274.422861:0:10330:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3982055200 already unused, calling callback (ffffffffc113cc20) 10000000:00010000:3.0:1784044274.422866:0:10330:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: ffff9b3982055200/0x89871fc3aba17f7e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x89871fc3aba17f85 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044274.422875:0:10330:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9b3982055200/0x89871fc3aba17f7e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x89871fc3aba17f85 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784044274.422884:0:10330:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9b3982055200/0x89871fc3aba17f7e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x89871fc3aba17f85 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784044274.422890:0:10330:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1784044274.422893:0:10330:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1784044274.422895:0:10330:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1784044274.422912:0:10330:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9b3950226800 00010000:00010000:3.0:1784044274.422916:0:10330:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: ffff9b3982055200/0x89871fc3aba17f7e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x89871fc3aba17f85 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044274.422934:0:10330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9b3982055200/0x89871fc3aba17f7e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x89871fc3aba17f85 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044274.422947:0:10330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784044274.422948:0:10330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784044274.422950:0:10330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1784044274.422964:0:15814:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1784044274.422977:0:15814:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9b3843736d80 x1870705581022720/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1784044282 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784044274.423000:0:15814:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:3.0:1784044274.423005:0:15814:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1784044274.423011:0:15814:0:(import.c:65:import_set_state_nolock()) ffff9b384345d800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:3.0:1784044274.423016:0:15814:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1784044274.423020:0:15814:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9b3843736d80 x1870705581022720/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1784044282 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784044274.423027:0:15814:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1784044274.423029:0:15814:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 10s for inflight to error out 00000100:00100000:2.0:1784044274.423093:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843736d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3637:1870705581022720:0@lo:38:kworker.0 00000100:00080000:3.0:1784044274.428398:0:15814:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1784044274.428425:0:15814:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9b3843734380 x1870705581023104/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044275 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784044274.428449:0:15814:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9b3947eea680 x1870705581023232/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044278 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784044274.428470:0:15814:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9b3843ce7800 x1870705581023488/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044280 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784044274.428479:0:15814:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9b3947eeaa00 x1870705581023616/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044286 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784044274.428612:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843734380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3640:1870705581023104:0@lo:400:kworker.0 00000100:00100000:3.0:1784044274.429629:0:15814:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9b3843ce4e00 x1870705581023744/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1784044283 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784044274.429643:0:15814:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00100000:1.0:1784044274.430194:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3947eeaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3641:1870705581023616:0@lo:400:kworker.0 00000100:00100000:0.0:1784044274.430284:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843ce7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3639:1870705581023488:0@lo:400:kworker.0 00000100:00080000:3.0:1784044274.431256:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9b3843441000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1784044274.431264:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-5) 00000100:00100000:3.0:1784044274.431270:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843ce4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3637:1870705581023744:0@lo:38:kworker.0 00000100:00080000:3.0:1784044274.433791:0:15814:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1784044274.433810:0:15814:0:(import.c:65:import_set_state_nolock()) ffff9b3843441000 lustre-MDT0001_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:3.0:1784044274.433822:0:15814:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1784044274.433837:0:15814:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9b3947eea680 x1870705581023232/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044278 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784044274.433854:0:15814:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9b3843ce7800 x1870705581023488/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044280 ref 1 fl Complete:ENQU/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784044274.433864:0:15814:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9b3947eeaa00 x1870705581023616/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044286 ref 1 fl Complete:ENQU/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784044274.433874:0:15814:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1784044274.433880:0:15814:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 5s for inflight to error out 00000100:00100000:0.0:1784044274.435110:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3947eea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3639:1870705581023232:0@lo:400:kworker.0 00010000:00010000:3.0:1784044274.436851:0:15814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b3940030e00/0x89871fc3aba17f8c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba17f93 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044274.436876:0:15814:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b3940030e00/0x89871fc3aba17f8c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x89871fc3aba17f93 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044274.436885:0:15814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b3940030e00/0x89871fc3aba17f8c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x89871fc3aba17f93 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044274.436892:0:15814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.140@tcp lock: ffff9b3940030e00/0x89871fc3aba17f8c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x89871fc3aba17f93 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044274.436941:0:15814:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784044274.436950:0:15814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b39759f8600/0x89871fc3aba18256 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba1825d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044274.436957:0:15814:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b39759f8600/0x89871fc3aba18256 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x89871fc3aba1825d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044274.436962:0:15814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b39759f8600/0x89871fc3aba18256 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x89871fc3aba1825d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044274.436967:0:15814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.140@tcp lock: ffff9b39759f8600/0x89871fc3aba18256 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x89871fc3aba1825d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044274.436986:0:15814:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:3.0:1784044274.436991:0:15814:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:3.0:1784044274.437020:0:15814:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0001 00000020:01000000:3.0:1784044274.437026:0:15814:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:3.0:1784044274.437030:0:15814:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1784044274.437035:0:15814:0:(obd_config.c:955:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1784044274.437039:0:15814:0:(genops.c:1579:class_disconnect_exports()) OBD device 24 (ffff9b38424519c0) has no exports 00000020:00080000:3.0:1784044274.437061:0:15814:0:(genops.c:1579:class_disconnect_exports()) OBD device 24 (ffff9b38424519c0) has no exports 00010000:00010000:0.0:1784044274.442061:0:10331:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1784044274.442078:0:10331:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: ffff9b3940030e00/0x89871fc3aba17f8c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x89871fc3aba17f93 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044274.442093:0:10331:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3940030e00 already unused, calling callback (ffffffffc113cc20) 10000000:00010000:0.0:1784044274.442098:0:10331:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: ffff9b3940030e00/0x89871fc3aba17f8c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x89871fc3aba17f93 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044274.442112:0:10331:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9b3940030e00/0x89871fc3aba17f8c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x89871fc3aba17f93 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784044274.442122:0:10331:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9b3940030e00/0x89871fc3aba17f8c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x89871fc3aba17f93 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784044274.442129:0:10331:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1784044274.442133:0:10331:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:0.0:1784044274.442157:0:10331:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:0.0:1784044274.442215:0:10331:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9b3950226800 00010000:00010000:0.0:1784044274.442219:0:10331:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: ffff9b3940030e00/0x89871fc3aba17f8c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x89871fc3aba17f93 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044274.442228:0:10331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9b3940030e00/0x89871fc3aba17f8c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x89871fc3aba17f93 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044274.442246:0:10331:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784044274.442251:0:10331:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: ffff9b39759f8600/0x89871fc3aba18256 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x89871fc3aba1825d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044274.442256:0:10331:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b39759f8600 already unused, calling callback (ffffffffc113cc20) 10000000:00010000:0.0:1784044274.442259:0:10331:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: ffff9b39759f8600/0x89871fc3aba18256 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x89871fc3aba1825d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044274.442267:0:10331:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9b39759f8600/0x89871fc3aba18256 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x89871fc3aba1825d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784044274.442275:0:10331:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9b39759f8600/0x89871fc3aba18256 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x89871fc3aba1825d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784044274.442280:0:10331:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1784044274.442282:0:10331:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1784044274.442284:0:10331:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1784044274.442289:0:10331:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9b3950226800 00010000:00010000:0.0:1784044274.442292:0:10331:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: ffff9b39759f8600/0x89871fc3aba18256 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x89871fc3aba1825d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044274.442299:0:10331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9b39759f8600/0x89871fc3aba18256 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x89871fc3aba1825d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044274.442323:0:10331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784044274.442324:0:10331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784044274.442326:0:10331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:3.0:1784044274.443160:0:15814:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9b38425c05a0 - data ffff9b395d6e1000/ffff9b397b960c00 00000020:01000000:3.0:1784044274.443341:0:15814:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9b38425083c0 - data ffff9b395d678510/ffff9b397ba09400 00010000:00010000:1.0:1784044274.443625:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:2.0:1784044274.462839:0:15814:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1784044274.476914:0:15814:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x89871fc3aba17e20 00000020:00000080:3.0:1784044274.476935:0:15814:0:(genops.c:906:class_export_put()) final put ffff9b39741cc000/lustre-OST0001-osd_UUID 00000020:01000004:3.0:1784044274.476971:0:15814:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9b384244a000 from lustre-OST0001, refs=2 00000020:01000004:3.0:1784044274.476977:0:15814:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9b384244a000 2 00000020:01000004:3.0:1784044274.476980:0:15814:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9b384244a000 from lustre-OST0001 00000020:00000080:3.0:1784044274.477017:0:15814:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1784044274.477051:0:15814:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:3.0:1784044274.477054:0:15814:0:(genops.c:906:class_export_put()) final put ffff9b397b807000/lustre-OST0001_UUID 00000020:00000080:3.0:1784044274.477058:0:15814:0:(genops.c:865:class_export_destroy()) destroying export ffff9b397b807000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:3.0:1784044274.477068:0:15814:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:3.0:1784044274.478891:0:15814:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9->MGS 00010000:00010000:3.0:1784044274.478942:0:15814:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9b39586efc00/0x89871fc3aba17b79 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x89871fc3aba17b80 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784044274.478962:0:15814:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9b39586efc00/0x89871fc3aba17b79 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x89871fc3aba17b80 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784044274.478969:0:15814:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:3.0:1784044274.478971:0:15814:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:3.0:1784044274.478977:0:15814:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:3.0:1784044274.479012:0:15814:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9b3950226800 00010000:00010000:3.0:1784044274.479017:0:15814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9b39586efc00/0x89871fc3aba17b79 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x89871fc3aba17b80 expref: -99 pid: 7441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044274.479045:0:15814:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9b39586ee000/0x89871fc3aba17fee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x89871fc3aba17ff5 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784044274.479052:0:15814:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9b39586ee000/0x89871fc3aba17fee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x89871fc3aba17ff5 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784044274.479056:0:15814:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1784044274.479059:0:15814:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:3.0:1784044274.479061:0:15814:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:3.0:1784044274.479080:0:15814:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9b3950226800 00010000:00010000:3.0:1784044274.479084:0:15814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9b39586ee000/0x89871fc3aba17fee lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x89871fc3aba17ff5 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1784044274.479105:0:15814:0:(import.c:65:import_set_state_nolock()) ffff9b3950226800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:3.0:1784044274.479134:0:15814:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1784044274.479138:0:15814:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1784044274.479140:0:15814:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1784044274.479146:0:15814:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1784044274.479162:0:15814:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9b3843ce5500 x1870705581023360/t0(0) o250->MGC192.168.202.140@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1784044279 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1784044274.479991:0:15814:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1784044274.480001:0:15814:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 6s for inflight to error out 00000020:00000080:1.0:1784044274.480019:0:14129:0:(genops.c:865:class_export_destroy()) destroying export ffff9b39741cc000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000100:00100000:3.0:1784044274.480064:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843ce5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9:3637:1870705581023360:0@lo:250:kworker.0 10000000:01000000:3.0:1784044274.480108:0:15814:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1784044274.480122:0:15814:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x89871fc3aba17a76 00000020:00000080:3.0:1784044274.480144:0:15814:0:(genops.c:906:class_export_put()) final put ffff9b3944fd7800/8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9 00000020:01000000:3.0:1784044274.480202:0:15814:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.202.140@tcp (flags='') 00000020:00000080:1.0:1784044274.480216:0:14129:0:(genops.c:865:class_export_destroy()) destroying export ffff9b3944fd7800/8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9 for MGC192.168.202.140@tcp 00000020:00000080:3.0:1784044274.480219:0:15814:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1784044274.480234:0:15814:0:(obd_config.c:955:class_cleanup()) MGC192.168.202.140@tcp: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1784044274.480241:0:15814:0:(genops.c:1579:class_disconnect_exports()) OBD device 2 (ffff9b394402b380) has no exports 10000000:01000000:1.0:1784044274.480321:0:6508:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:3.0:1784044274.480450:0:15814:0:(obd_class.h:671:obd_cleanup_client_import()) MGC192.168.202.140@tcp: client import never connected 00000100:00080000:3.0:1784044274.480455:0:15814:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:3.0:1784044274.480459:0:15814:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1784044274.480462:0:15814:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:3.0:1784044274.480465:0:15814:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1784044274.480549:0:15814:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1784044274.480559:0:15814:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.202.140@tcp (uuid 8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9) 00000020:01000000:3.0:1784044274.480580:0:15814:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:3.0:1784044274.480589:0:15814:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1784044274.480593:0:15814:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1784044274.480600:0:15814:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff9b384244d000 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1784044274.480606:0:15814:0:(genops.c:1574:class_disconnect_exports()) OBD device 25 (ffff9b38430499c0) has exports, disconnecting them 00000020:00080000:3.0:1784044274.480610:0:15814:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff9b384244d000), last request at 1784044010 00000020:00000080:3.0:1784044274.480614:0:15814:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x89871fc3aba17e4a 00000020:00080000:3.0:1784044274.480632:0:15814:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9b384244d000): rc 0 00000020:00000080:1.0:1784044274.480738:0:14129:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9b3950226800 for MGC192.168.202.140@tcp 00000020:00000080:1.0:1784044274.480755:0:14129:0:(genops.c:906:class_export_put()) final put ffff9b39465b1800/8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9 00000020:00000080:1.0:1784044274.480758:0:14129:0:(genops.c:865:class_export_destroy()) destroying export ffff9b39465b1800/8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9 for MGC192.168.202.140@tcp 00000020:01000000:1.0:1784044274.480764:0:14129:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.202.140@tcp (8e8b2d45-ca4d-47c1-acbb-b5914ad9d1a9) 00000020:00000080:3.0:1784044274.481485:0:15814:0:(genops.c:906:class_export_put()) final put ffff9b384244d000/lustre-MDT0000-lwp-OST0001 00000020:00000080:1.0:1784044274.483632:0:14129:0:(genops.c:865:class_export_destroy()) destroying export ffff9b384244d000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:0.0:1784044274.499283:0:15814:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:0.0:1784044274.499294:0:15814:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1784044274.499298:0:15814:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1784044274.499308:0:15814:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1784044274.499504:0:15814:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1784044274.499514:0:15814:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000000:0.0:1784044274.499522:0:15814:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0001 (flags='F') 00000020:00000080:0.0:1784044274.499527:0:15814:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1784044274.499531:0:15814:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1784044274.499539:0:15814:0:(genops.c:1840:print_export_data()) lustre-MDT0001-lwp-OST0001: ACTIVE ffff9b3843445000 lustre-MDT0001-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1784044274.499546:0:15814:0:(genops.c:1574:class_disconnect_exports()) OBD device 26 (ffff9b3843563380) has exports, disconnecting them 00000020:00080000:0.0:1784044274.499551:0:15814:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0001: disconnecting export at 0@lo (ffff9b3843445000), last request at 1784044010 00000020:00000080:0.0:1784044274.499555:0:15814:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x89871fc3aba17e5f 00000020:00080000:0.0:1784044274.499572:0:15814:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9b3843445000): rc 0 00000020:00000080:0.0:1784044274.499578:0:15814:0:(genops.c:906:class_export_put()) final put ffff9b3843445000/lustre-MDT0001-lwp-OST0001 00000020:00000080:1.0:1784044274.499740:0:14129:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9b384345d800 for lustre-MDT0000-lwp-OST0001 00000020:00000080:1.0:1784044274.499777:0:14129:0:(genops.c:906:class_export_put()) final put ffff9b3842125800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:1.0:1784044274.499781:0:14129:0:(genops.c:865:class_export_destroy()) destroying export ffff9b3842125800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:1.0:1784044274.499789:0:14129:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:1.0:1784044274.499873:0:14129:0:(genops.c:865:class_export_destroy()) destroying export ffff9b3843445000/lustre-MDT0001-lwp-OST0001 for lustre-MDT0001-lwp-OST0001 00010000:01000000:1.0:1784044274.505245:0:15814:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0001: client import never connected 00000100:00080000:1.0:1784044274.505257:0:15814:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1784044274.505271:0:15814:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1784044274.505280:0:15814:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1784044274.505343:0:14129:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9b3843441000 for lustre-MDT0001-lwp-OST0001 00010000:00010000:0.0:1784044274.512391:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:3.0:1784044274.512628:0:10330:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:0.0:1784044274.512841:0:10331:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00010000:00010000:3.0:1784044274.513013:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-4 blwis in pool) 00000100:00100000:3.0:1784044274.513163:0:6495:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff9b396f053c00:6495] 1 exiting: rc = 0 00000100:00100000:2.0:1784044274.513440:0:6494:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff9b39453fc000:6494] 0 exiting: rc = 1 00000100:00100000:1.0:1784044274.513590:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044274.514164:0:13182:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff9b397aba8200:13182] 3 exiting: rc = 0 00000100:00100000:0.0:1784044274.514430:0:6497:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff9b396f052400:6497] 1 exiting: rc = 0 00000100:00100000:0.0:1784044274.514483:0:6498:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff9b396f052800:6498] 2 exiting: rc = 0 00000100:00100000:2.0:1784044274.514740:0:6496:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff9b396f052200:6496] 0 exiting: rc = 1 00000100:00100000:1.0:1784044274.514891:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.514972:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.514981:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.514987:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.514995:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.515001:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.515006:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.515012:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.515017:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.515023:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.515028:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.515035:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.515041:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.515047:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.515054:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.515059:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.515066:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.515071:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.515078:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.515085:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.515092:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.515099:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.515105:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.515111:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.515117:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.515123:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.515128:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.515134:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.515139:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.515144:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.515150:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.515158:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.515164:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.515209:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.515215:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.515221:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.515227:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.515233:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.515238:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.515243:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.515249:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.515253:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.515258:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.515411:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.515417:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.515423:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.515429:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.515435:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.515441:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.515447:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.515452:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.515457:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.515462:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.515467:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.515472:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.515479:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.515484:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.515488:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.515493:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.515499:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.515503:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.515508:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.515512:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.515518:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1784044274.516986:0:15814:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1784044274.517000:0:15814:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000020:00000080:1.0:1784044274.517007:0:15814:0:(genops.c:906:class_export_put()) final put ffff9b3842120000/lustre-MDT0001-lwp-OST0001_UUID 00000020:00000080:1.0:1784044274.517012:0:15814:0:(genops.c:865:class_export_destroy()) destroying export ffff9b3842120000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001-lwp-OST0001 00000020:01000000:1.0:1784044274.517032:0:15814:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0001 (lustre-MDT0001-lwp-OST0001_UUID) 00000020:01000004:1.0:1784044274.517085:0:15814:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9b384244a000 1 00000020:00000080:1.0:1784044274.517092:0:15814:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x89871fc3aba17def 00000020:00000080:1.0:1784044274.517099:0:15814:0:(genops.c:906:class_export_put()) final put ffff9b397b806000/lustre-OST0001-osd_UUID 00000020:01000000:1.0:1784044274.517122:0:15814:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:1.0:1784044274.517126:0:15814:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1784044274.517131:0:15814:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1784044274.517136:0:15814:0:(genops.c:1579:class_disconnect_exports()) OBD device 23 (ffff9b384304b380) has no exports 00000020:00000080:0.0:1784044274.518796:0:14129:0:(genops.c:865:class_export_destroy()) destroying export ffff9b397b806000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:1.0:1784044274.558346:0:15814:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1784044274.558365:0:15814:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:1.0:1784044274.558373:0:15814:0:(genops.c:906:class_export_put()) final put ffff9b3842448000/lustre-OST0001-osd_UUID 00000020:00000080:1.0:1784044274.558379:0:15814:0:(genops.c:865:class_export_destroy()) destroying export ffff9b3842448000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:1.0:1784044274.558395:0:15814:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:1.0:1784044274.572069:0:15814:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9b3842449800 00000020:01000000:1.0:1784044274.572113:0:15814:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:1.0:1784044274.572126:0:15814:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1784044274.572135:0:15814:0:(obd_config.c:955:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1784044274.572141:0:15814:0:(genops.c:1579:class_disconnect_exports()) OBD device 17 (ffff9b3974250000) has no exports 00000020:00000080:1.0:1784044274.572929:0:15814:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1784044274.572943:0:15814:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:1.0:1784044274.572949:0:15814:0:(genops.c:906:class_export_put()) final put ffff9b397590b800/OSS_uuid 00000020:00000080:1.0:1784044274.572954:0:15814:0:(genops.c:865:class_export_destroy()) destroying export ffff9b397590b800/OSS_uuid for OSS 00000020:01000000:1.0:1784044274.572960:0:15814:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00080000:3.0:1784044274.573051:0:6507:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:0.0:1784044274.577102:0:8428:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff9b397b607c00:8428] 2 exiting: rc = 0 00000100:00100000:2.0:1784044274.579400:0:9822:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff9b384343a800:9822] 3 exiting: rc = 0 00000100:00100000:2.0:1784044274.579594:0:8426:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff9b397b98e400:8426] 0 exiting: rc = 1 00000100:00100000:2.0:1784044274.579643:0:8427:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff9b397591a600:8427] 1 exiting: rc = 0 00000100:00100000:1.0:1784044274.580770:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.580781:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.580787:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.580794:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.580802:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.580807:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.580813:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.580819:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.580825:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.580831:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.580854:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.580859:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.580864:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.580875:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.580882:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.580887:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.580892:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.580897:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.580902:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.580908:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.580913:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.580919:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.580924:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.580930:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.580935:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.580942:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.580947:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.580952:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.580957:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.580962:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.580987:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.580993:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.580998:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.581004:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.581009:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.581014:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.581019:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.581024:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.581028:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.581033:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.581038:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.581042:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.581047:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.581052:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.581057:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.581067:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.581073:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.581078:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.581084:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.581088:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.581093:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.581098:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.581103:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.581109:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.581113:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.581118:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.581123:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.581128:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.581133:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.581138:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.581142:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.581147:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.581152:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.581160:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784044274.584461:0:8430:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff9b397b77f600:8430] 1 exiting: rc = 0 00000100:00100000:1.0:1784044274.593014:0:8429:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff9b397591fa00:8429] 0 exiting: rc = 1 00000100:00100000:1.0:1784044274.593110:0:10713:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_002: service thread [ffff9b3843ce0c00:10713] 2 exiting: rc = 0 00000100:00100000:1.0:1784044274.595423:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.595436:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.595444:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.595449:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.595456:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.595461:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.595465:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.595470:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.595477:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.595482:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.595584:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.595589:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.595593:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.595598:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.595616:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.595622:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.595627:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.595632:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.595636:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.595642:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.595648:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.595653:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.595658:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.595663:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.595668:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.595672:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.595677:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.595682:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.595687:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.595692:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.595698:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.595703:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.595709:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.595715:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.595720:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.595725:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.595730:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.595735:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.595740:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.595780:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.595787:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.595792:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.595797:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.595802:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.595807:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.595812:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.595818:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.595823:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.595828:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.595841:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.595848:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.595853:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.595859:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.595864:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.595870:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.595875:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.595881:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.595886:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.595892:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.595898:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.595903:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.595909:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.595914:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.595919:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.597165:0:8433:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff9b3975834800:8433] 2 exiting: rc = 0 00000100:00100000:3.0:1784044274.598108:0:8432:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff9b3975834c00:8432] 1 exiting: rc = 0 00000100:00100000:0.0:1784044274.599551:0:8431:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff9b397aa44c00:8431] 0 exiting: rc = 1 00000100:00100000:1.0:1784044274.599913:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.599921:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.599927:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.599933:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.599938:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.599945:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.599959:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.599967:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.599973:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.599979:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.599986:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.599991:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.599997:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.600003:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.600009:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.600014:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.600020:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.600026:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.600031:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.600047:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.600053:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.600059:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.600065:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.600081:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.600088:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.600094:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.600100:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.600105:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.600111:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.600117:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.600124:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.600130:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.600136:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.600142:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.600149:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.600155:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.600161:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.600167:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.600200:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.600207:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.600213:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.600220:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.600226:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.600232:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.600239:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.600245:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.600252:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.600373:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.600382:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.600389:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.600395:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.600402:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.600410:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.600417:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.600431:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.600438:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.600444:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.600452:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.600458:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.600465:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.600473:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.600479:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.600549:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.600558:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.613884:0:8435:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff9b3975835400:8435] 1 exiting: rc = 0 00000100:00100000:2.0:1784044274.614060:0:8434:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff9b3975835800:8434] 0 exiting: rc = 1 00000100:00100000:1.0:1784044274.614384:0:8747:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_002: service thread [ffff9b3975a17c00:8747] 2 exiting: rc = 0 00000100:00100000:3.0:1784044274.614550:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044274.614559:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044274.614564:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044274.614569:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044274.614574:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044274.614580:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044274.614584:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044274.614590:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044274.614596:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044274.614601:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044274.614607:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044274.614613:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044274.614618:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044274.614624:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044274.614629:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044274.614635:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044274.614641:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044274.614646:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044274.614652:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044274.614657:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044274.614663:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044274.614668:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044274.614674:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044274.614679:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044274.614684:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044274.614689:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044274.614694:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044274.614712:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044274.614716:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044274.614722:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044274.614727:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044274.614732:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044274.614737:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044274.614743:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044274.614908:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044274.614915:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044274.614920:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044274.614925:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044274.614931:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044274.614936:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044274.614941:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044274.614946:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044274.614951:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044274.614956:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044274.614960:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044274.614965:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044274.614971:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044274.614976:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044274.615027:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044274.615034:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044274.615039:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044274.615044:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044274.615049:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044274.615054:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044274.615060:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044274.615065:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044274.615070:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044274.615074:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044274.615079:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044274.615084:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044274.615088:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044274.615094:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044274.615107:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044274.615119:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784044274.617123:0:8436:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff9b39758e4200:8436] 0 exiting: rc = 1 00000100:00100000:0.0:1784044274.617603:0:8437:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff9b39758e5a00:8437] 1 exiting: rc = 0 00000100:00100000:3.0:1784044274.618799:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044274.618818:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044274.618825:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044274.618831:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044274.618837:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044274.618843:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044274.618868:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044274.618876:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044274.618882:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044274.618888:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044274.618895:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044274.618902:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044274.618908:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044274.618914:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044274.618920:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044274.618926:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044274.618931:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044274.618937:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044274.619229:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044274.619241:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044274.619246:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044274.619253:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044274.619259:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044274.619366:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044274.619373:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044274.619380:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044274.619386:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044274.619393:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044274.619399:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044274.619405:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044274.619428:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044274.619436:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044274.619443:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044274.619462:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044274.619469:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044274.619476:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044274.619482:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044274.619616:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044274.619623:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044274.619629:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044274.619635:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044274.619641:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044274.619671:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044274.619679:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044274.619701:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044274.619707:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044274.619714:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044274.619721:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044274.619728:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044274.619734:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044274.619740:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044274.619756:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044274.619764:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044274.619771:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044274.619793:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044274.619800:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044274.619806:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044274.619812:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044274.619818:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044274.619824:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044274.619831:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044274.619837:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044274.619843:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784044274.619856:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:2.0:1784044274.641535:0:15814:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:2.0:1784044299.062152:0:16579:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg240-server.virtnet: executing load_modules_local 00000020:01000004:0.0:1784044312.397966:0:17178:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1784044312.397975:0:17178:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:0.0:1784044312.397976:0:17178:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:0.0:1784044312.398681:0:17178:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9b397a8e8000 00000020:01000004:0.0:1784044312.398703:0:17178:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:0.0:1784044312.398714:0:17178:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1784044312.398733:0:17178:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9b38421119c0) 00000020:00000080:0.0:1784044312.398750:0:17178:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1784044312.522694:0:17178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:0.0:1784044312.524858:0:17178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:0.0:1784044312.526261:0:17178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:0.0:1784044312.526460:0:17178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:0.0:1784044312.526645:0:17178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:0.0:1784044312.527041:0:17178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:0.0:1784044312.527507:0:17178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:0.0:1784044312.527679:0:17178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:0.0:1784044312.527852:0:17178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:0.0:1784044312.528037:0:17178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:0.0:1784044312.528493:0:17178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:0.0:1784044312.528674:0:17178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:0.0:1784044312.528891:0:17178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:0.0:1784044312.529105:0:17178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:0.0:1784044312.530204:0:17178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:0.0:1784044312.530413:0:17178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:0.0:1784044312.530703:0:17178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:0.0:1784044312.530865:0:17178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:0.0:1784044312.531052:0:17178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:0.0:1784044312.531244:0:17178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:0.0:1784044312.531453:0:17178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:0.0:1784044312.531636:0:17178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:0.0:1784044312.531789:0:17178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:0.0:1784044312.531949:0:17178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:0.0:1784044312.532097:0:17178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:0.0:1784044312.532433:0:17178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:0.0:1784044312.532616:0:17178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:0.0:1784044312.532781:0:17178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:0.0:1784044312.532940:0:17178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:0.0:1784044312.533332:0:17178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:0.0:1784044312.533572:0:17178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:0.0:1784044312.533781:0:17178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:0.0:1784044312.533996:0:17178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:0.0:1784044312.534352:0:17178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:0.0:1784044312.534587:0:17178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:0.0:1784044312.534789:0:17178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:0.0:1784044312.534990:0:17178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:0.0:1784044312.535288:0:17178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:0.0:1784044312.535507:0:17178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:0.0:1784044312.535709:0:17178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:0.0:1784044312.535907:0:17178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:0.0:1784044312.536115:0:17178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:0.0:1784044312.536490:0:17178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:0.0:1784044312.536726:0:17178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:0.0:1784044312.536952:0:17178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:0.0:1784044312.537223:0:17178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:0.0:1784044312.538960:0:17178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:0.0:1784044312.540005:0:17178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:1.0:1784044312.540813:0:17178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:1.0:1784044312.541012:0:17178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:1.0:1784044312.541512:0:17178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:1.0:1784044312.541698:0:17178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:1.0:1784044312.541878:0:17178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00080000:01000000:1.0:1784044312.542705:0:17178:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1784044312.542926:0:17178:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:1.0:1784044312.542936:0:17178:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:1.0:1784044312.542950:0:17178:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x89871fc3aba1906b 00000020:01000004:1.0:1784044312.542957:0:17178:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:1.0:1784044312.542962:0:17178:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:1.0:1784044312.542967:0:17178:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9b397a8e8000 from MGS 00000020:01000004:1.0:1784044312.542971:0:17178:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:1.0:1784044312.542981:0:17178:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff9b384304b380) 00000020:00000080:1.0:1784044312.542991:0:17178:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:1.0:1784044312.543053:0:17178:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9b397a8e8000 from MGS, refs=2 00080000:01000000:1.0:1784044312.543058:0:17178:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:1.0:1784044312.543063:0:17178:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x89871fc3aba19079 00000100:00100000:1.0:1784044312.543470:0:17178:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:1.0:1784044312.543599:0:17178:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:1.0:1784044312.543605:0:17178:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:1.0:1784044312.544542:0:17178:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:1.0:1784044312.544551:0:17178:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:1.0:1784044312.545486:0:17178:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1784044312.545663:0:17178:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:1.0:1784044312.545669:0:17178:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:1.0:1784044312.546413:0:17178:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:1.0:1784044312.546421:0:17178:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:1.0:1784044312.546779:0:17178:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:1.0:1784044312.546785:0:17178:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1784044312.547518:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784044312.547522:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784044312.547523:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784044312.547877:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784044312.547880:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784044312.547882:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784044312.548382:0:17178:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00000040:01000000:2.0:1784044312.553308:0:17178:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:2.0:1784044312.553796:0:17190:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:2.0:1784044312.553813:0:17178:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:2.0:1784044312.553840:0:17178:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1784044312.556076:0:17178:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00010000:00010000:3.0:1784044312.556391:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784044312.557971:0:17178:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1784044312.558156:0:17178:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:2.0:1784044312.558163:0:17178:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1784044312.561021:0:17178:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1784044312.561033:0:17178:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:2.0:1784044312.569730:0:17178:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:2.0:1784044312.569743:0:17178:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:2.0:1784044312.570639:0:17178:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1784044312.570664:0:17178:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.202.140@tcp' 00000020:01000004:2.0:1784044312.570666:0:17178:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:2.0:1784044312.570697:0:17178:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.202.140@tcp (typ=mgc) 00000020:00000080:2.0:1784044312.570711:0:17178:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.202.140@tcp (ffff9b3842450000) 00000020:00000080:2.0:1784044312.570737:0:17178:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:2.0:1784044312.570824:0:17178:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9b384447b800@MGC192.168.202.140@tcp: add connection 192.168.202.140@tcp at head 00010000:00010000:2.0:1784044312.570990:0:17178:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.202.140@tcp-0 is initialized 00000040:01000000:2.0:1784044312.570996:0:17178:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.140@tcp ctxt 1 is initialized 00000100:00080000:3.0:1784044312.571115:0:17195:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:0.0:1784044312.576556:0:17196:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:3.0:1784044312.576643:0:17178:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.202.140@tcp (uuid 99a46fb7-9af9-40f1-9c76-329d6781ee81) 00000020:00000080:3.0:1784044312.576668:0:17178:0:(genops.c:1406:class_connect()) connect: client 99a46fb7-9af9-40f1-9c76-329d6781ee81, cookie 0x89871fc3aba19087 00000100:00080000:3.0:1784044312.576681:0:17178:0:(import.c:510:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1784044312.576687:0:17178:0:(import.c:624:import_select_connection()) MGC192.168.202.140@tcp: import ffff9b384447b800 using connection 192.168.202.140@tcp/0@lo 00000100:00100000:3.0:1784044312.576721:0:17178:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b3843ce5500 x1870705581023872/t0(0) o250->MGC192.168.202.140@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1784044312.576768:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843ce5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:99a46fb7-9af9-40f1-9c76-329d6781ee81:3637:1870705581023872:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1784044312.576839:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1784044312.576906:0:17178:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 99a46fb7-9af9-40f1-9c76-329d6781ee81->MGS 00000020:01000004:3.0:1784044312.576925:0:17178:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1784044312.576931:0:17178:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:3.0:1784044312.576945:0:17178:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff9b3843564d40) 00000020:00000080:3.0:1784044312.576959:0:17178:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:2.0:1784044312.583789:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581023872 00000100:00100000:2.0:1784044312.583805:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581023872 00000100:00100000:2.0:1784044312.583846:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1784044312.583856:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3942b86850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3637:x1870705581023872:12345-0@lo:250:mount.lustre.0 00010000:00080000:2.0:1784044312.583888:0:17192:0:(ldlm_lib.c:1445:target_handle_connect()) MGS: connection from 99a46fb7-9af9-40f1-9c76-329d6781ee81@0@lo t0 exp 0000000000000000 cur 505 last 0 00000020:00000080:2.0:1784044312.583921:0:17192:0:(genops.c:1406:class_connect()) connect: client 99a46fb7-9af9-40f1-9c76-329d6781ee81, cookie 0x89871fc3aba19095 00000100:00080000:2.0:1784044312.584066:0:17192:0:(import.c:65:import_set_state_nolock()) ffff9b384447a000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784044312.584204:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3942b86850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99a46fb7-9af9-40f1-9c76-329d6781ee81+5:3637:x1870705581023872:12345-0@lo:250:mount.lustre.0 Request processed in 349us (7363us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044312.584213:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1784044312.584316:0:3637:0:(client.c:3112:ptlrpc_free_committed()) MGC192.168.202.140@tcp: committing for last_committed 0 gen 1 00000100:00080000:2.0:1784044312.584326:0:3637:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.202.140@tcp: connect to target with instance 0 00000100:00080000:2.0:1784044312.584336:0:3637:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.202.140@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1784044312.584342:0:3637:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1784044312.584345:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9b384447b800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1784044312.584348:0:3637:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1784044312.591311:0:3637:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1784044312.591330:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843ce5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:99a46fb7-9af9-40f1-9c76-329d6781ee81:3637:1870705581023872:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1784044312.598779:0:17178:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1784044312.598972:0:17178:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:3.0:1784044312.598979:0:17178:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:3.0:1784044312.610497:0:17178:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:3.0:1784044312.610513:0:17178:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:0.0:1784044312.610887:0:17178:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:0.0:1784044312.610893:0:17178:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:1.0:1784044312.620548:0:17178:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1784044312.620770:0:17178:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:1.0:1784044312.620778:0:17178:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:3.0:1784044312.621822:0:17178:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:3.0:1784044312.621832:0:17178:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:1.0:1784044312.694717:0:17178:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1784044312.694921:0:17178:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:1.0:1784044312.694927:0:17178:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:1.0:1784044312.697006:0:17178:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:1.0:1784044312.697020:0:17178:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:1.0:1784044312.697718:0:17178:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1784044312.697891:0:17178:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:1.0:1784044312.697896:0:17178:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:1.0:1784044312.699962:0:17178:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:1.0:1784044312.699974:0:17178:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:1.0:1784044312.701621:0:17178:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1784044312.701794:0:17178:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:1.0:1784044312.701800:0:17178:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:1.0:1784044312.702412:0:17178:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:1.0:1784044312.702421:0:17178:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:1.0:1784044312.702989:0:17178:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1784044312.703321:0:17178:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1784044312.703327:0:17178:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:1.0:1784044312.706123:0:17178:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:1.0:1784044312.706147:0:17178:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:0.0:1784044312.731738:0:17178:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1784044312.731982:0:17178:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1784044312.731990:0:17178:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:0.0:1784044312.733277:0:17178:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1784044312.733288:0:17178:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1784044312.734747:0:17178:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1784044312.734761:0:17178:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1784044312.736613:0:17178:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1784044312.736648:0:17178:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:3.0:1784044312.736655:0:17178:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.140@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1784044312.736780:0:17178:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.140@tcp ctxt 0 is initialized 00000020:01000004:3.0:1784044312.736825:0:17178:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.202.140@tcp, index=0000, flags=0x20005 00000020:01000004:3.0:1784044312.736830:0:17178:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1784044312.736835:0:17178:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1784044312.736836:0:17178:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1784044312.736837:0:17178:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1784044312.736838:0:17178:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1784044312.736839:0:17178:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1784044312.736840:0:17178:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1784044312.736842:0:17178:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1784044312.736844:0:17178:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1784044312.736845:0:17178:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1784044312.736847:0:17178:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:3.0:1784044312.736850:0:17178:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1784044312.736851:0:17178:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1784044312.736852:0:17178:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1784044312.736853:0:17178:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1784044312.736853:0:17178:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1784044312.736854:0:17178:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1784044312.736855:0:17178:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1784044312.736856:0:17178:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1784044312.736857:0:17178:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1784044312.736858:0:17178:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1784044312.736889:0:17178:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1784044312.736909:0:17178:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843ce4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99a46fb7-9af9-40f1-9c76-329d6781ee81:17178:1870705581024000:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1784044312.736986:0:17178:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044312.737074:0:17178:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b394a34e600 going to sleep for 11 seconds 00000100:00100000:2.0:1784044312.737161:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581024000 00000100:00100000:2.0:1784044312.737169:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581024000 00000100:00100000:2.0:1784044312.740651:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1784044312.740665:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3975b97450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99a46fb7-9af9-40f1-9c76-329d6781ee81+5:17178:x1870705581024000:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1784044312.740749:0:17194:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1784044312.740753:0:17194:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1784044312.740762:0:17194:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:1.0:1784044312.741314:0:17216:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1784044312.742023:0:17194:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 6 20000000:01000000:2.0:1784044312.749571:0:17217:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:2.0:1784044312.749584:0:17217:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:2.0:1784044312.749587:0:17217:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:2.0:1784044312.749589:0:17217:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:2.0:1784044312.750369:0:17217:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:3.0:1784044312.750635:0:17194:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1784044312.750649:0:17194:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1784044312.752841:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3975b97450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99a46fb7-9af9-40f1-9c76-329d6781ee81+5:17178:x1870705581024000:12345-0@lo:253:mount.lustre.0 Request processed in 12169us (15844us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044312.752863:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1784044312.752995:0:17178:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843ce4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99a46fb7-9af9-40f1-9c76-329d6781ee81:17178:1870705581024000:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1784044312.753012:0:17178:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1784044312.753015:0:17178:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1784044312.753017:0:17178:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1784044312.753018:0:17178:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784044312.753019:0:17178:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1784044312.753021:0:17178:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784044312.753022:0:17178:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784044312.753024:0:17178:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1784044312.753025:0:17178:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1784044312.753027:0:17178:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784044312.753028:0:17178:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1784044312.753048:0:17178:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9b397a8e8000 from lustre-MDT0000 10000000:01000000:0.0:1784044312.753091:0:17178:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:0.0:1784044312.753094:0:17178:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1784044312.753098:0:17178:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9b3842450000 10000000:01000000:0.0:1784044312.753102:0:17178:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1784044312.753111:0:17178:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff9b3842450000 from 1 10000000:01000000:0.0:1784044312.753114:0:17178:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1784044312.753162:0:17178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b38410b7000/0x89871fc3aba1909c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044312.753207:0:17178:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9b38410b7000/0x89871fc3aba1909c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044312.753227:0:17178:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9b38410b7000/0x89871fc3aba1909c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044312.753247:0:17178:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3947eea680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99a46fb7-9af9-40f1-9c76-329d6781ee81:17178:1870705581024128:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1784044312.753283:0:17178:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044312.753332:0:17178:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b39741e1300 going to sleep for 11 seconds 00000100:00100000:2.0:1784044312.753386:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581024128 00000100:00100000:2.0:1784044312.753392:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581024128 00000100:00100000:3.0:1784044312.753584:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1784044312.753595:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3975b94850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99a46fb7-9af9-40f1-9c76-329d6781ee81+5:17178:x1870705581024128:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1784044312.753609:0:17192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784044312.753625:0:17192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b394166ba00/0x89871fc3aba190a3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x89871fc3aba1909c expref: -99 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044312.753665:0:17192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b394166ba00/0x89871fc3aba190a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x89871fc3aba1909c expref: 6 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044312.753677:0:17192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b394166ba00/0x89871fc3aba190a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x89871fc3aba1909c expref: 6 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044312.753687:0:17192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b394166ba00, rc 0) 00000100:00100000:3.0:1784044312.753727:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3975b94850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99a46fb7-9af9-40f1-9c76-329d6781ee81+6:17178:x1870705581024128:12345-0@lo:101:mount.lustre.0 Request processed in 135us (444us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044312.753733:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1784044312.753974:0:17178:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3947eea680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99a46fb7-9af9-40f1-9c76-329d6781ee81:17178:1870705581024128:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1784044312.753989:0:17178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9b38410b7000/0x89871fc3aba1909c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba190a3 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044312.753998:0:17178:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9b38410b7000/0x89871fc3aba1909c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x89871fc3aba190a3 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044312.754051:0:17178:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3947eea680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99a46fb7-9af9-40f1-9c76-329d6781ee81:17178:1870705581024256:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1784044312.754088:0:17178:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044312.754109:0:17178:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b39741e1300 going to sleep for 11 seconds 00000100:00100000:3.0:1784044312.754190:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581024256 00000100:00100000:3.0:1784044312.754203:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581024256 00000100:00100000:3.0:1784044312.754240:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1784044312.754248:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3975b94450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99a46fb7-9af9-40f1-9c76-329d6781ee81+6:17178:x1870705581024256:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1784044312.754342:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3975b94450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99a46fb7-9af9-40f1-9c76-329d6781ee81+6:17178:x1870705581024256:12345-0@lo:501:mount.lustre.0 Request processed in 95us (266us total) trans 0 rc -2/-2 00000100:00100000:3.0:1784044312.754349:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1784044312.754487:0:17178:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3947eea680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99a46fb7-9af9-40f1-9c76-329d6781ee81:17178:1870705581024256:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1784044312.754524:0:17178:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1784044312.754543:0:17178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b38410b7000/0x89871fc3aba1909c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba190a3 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044312.754550:0:17178:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9b38410b7000/0x89871fc3aba1909c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba190a3 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784044312.754558:0:17178:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9b397a8e8000 10000000:01000000:0.0:1784044312.754562:0:17178:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1784044312.754574:0:17178:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9b397a8e8000 10000000:01000000:0.0:1784044312.754576:0:17178:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1784044312.754579:0:17178:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff9b397a8e8000 from 1 10000000:01000000:0.0:1784044312.754581:0:17178:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1784044312.754599:0:17178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b38410b6000/0x89871fc3aba190aa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044312.754605:0:17178:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9b38410b6000/0x89871fc3aba190aa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044312.754612:0:17178:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9b38410b6000/0x89871fc3aba190aa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044312.754623:0:17178:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3947eea680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99a46fb7-9af9-40f1-9c76-329d6781ee81:17178:1870705581024384:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1784044312.754648:0:17178:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044312.754671:0:17178:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b39741e1300 going to sleep for 11 seconds 00000100:00100000:3.0:1784044312.754768:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581024384 00000100:00100000:3.0:1784044312.754772:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581024384 00000100:00100000:3.0:1784044312.754802:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1784044312.754807:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3975b95050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99a46fb7-9af9-40f1-9c76-329d6781ee81+6:17178:x1870705581024384:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1784044312.754814:0:17193:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784044312.754825:0:17193:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b394166a400/0x89871fc3aba190b1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x89871fc3aba190aa expref: -99 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044312.754840:0:17193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b394166a400/0x89871fc3aba190b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x89871fc3aba190aa expref: 7 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044312.754859:0:17193:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b394166a400/0x89871fc3aba190b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x89871fc3aba190aa expref: 7 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044312.754866:0:17193:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b394166a400, rc 0) 00000100:00100000:3.0:1784044312.754950:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3975b95050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99a46fb7-9af9-40f1-9c76-329d6781ee81+7:17178:x1870705581024384:12345-0@lo:101:mount.lustre.0 Request processed in 141us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044312.754956:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1784044312.756389:0:17178:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3947eea680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99a46fb7-9af9-40f1-9c76-329d6781ee81:17178:1870705581024384:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1784044312.756572:0:17178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9b38410b6000/0x89871fc3aba190aa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba190b1 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044312.756585:0:17178:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9b38410b6000/0x89871fc3aba190aa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x89871fc3aba190b1 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784044312.756603:0:17178:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1784044312.756618:0:17178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b38410b6000/0x89871fc3aba190aa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba190b1 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044312.756624:0:17178:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9b38410b6000/0x89871fc3aba190aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba190b1 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784044312.756631:0:17178:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1784044312.756640:0:17178:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1784044312.756646:0:17178:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9b397a8e8000 10000000:01000000:1.0:1784044312.756649:0:17178:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1784044312.756652:0:17178:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1784044312.756654:0:17178:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1784044312.756684:0:17178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b38426fce00/0x89871fc3aba190b8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044312.756692:0:17178:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9b38426fce00/0x89871fc3aba190b8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044312.756718:0:17178:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9b38426fce00/0x89871fc3aba190b8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044312.756740:0:17178:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843737b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99a46fb7-9af9-40f1-9c76-329d6781ee81:17178:1870705581024512:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1784044312.756796:0:17178:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044312.756895:0:17178:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b394694f3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784044312.765333:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581024512 00000100:00100000:3.0:1784044312.765349:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581024512 00000100:00100000:3.0:1784044312.765425:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1784044312.765436:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3975b95850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99a46fb7-9af9-40f1-9c76-329d6781ee81+7:17178:x1870705581024512:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1784044312.765453:0:17194:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784044312.765471:0:17194:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b394166b600/0x89871fc3aba190bf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x89871fc3aba190b8 expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044312.765627:0:17194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b394166b600/0x89871fc3aba190bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x89871fc3aba190b8 expref: 8 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044312.765641:0:17194:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b394166b600/0x89871fc3aba190bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x89871fc3aba190b8 expref: 8 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044312.765650:0:17194:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b394166b600, rc 0) 00000100:00100000:3.0:1784044312.765742:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3975b95850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99a46fb7-9af9-40f1-9c76-329d6781ee81+8:17178:x1870705581024512:12345-0@lo:101:mount.lustre.0 Request processed in 308us (8945us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044312.765749:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1784044312.765874:0:17178:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843737b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99a46fb7-9af9-40f1-9c76-329d6781ee81:17178:1870705581024512:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1784044312.765893:0:17178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9b38426fce00/0x89871fc3aba190b8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba190bf expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044312.765904:0:17178:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9b38426fce00/0x89871fc3aba190b8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x89871fc3aba190bf expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044312.765988:0:17178:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843737b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99a46fb7-9af9-40f1-9c76-329d6781ee81:17178:1870705581024640:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1784044312.766023:0:17178:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044312.766059:0:17178:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b394694f3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784044312.766071:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581024640 00000100:00100000:0.0:1784044312.766076:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581024640 00000100:00100000:0.0:1784044312.766108:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1784044312.766125:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3975b97850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99a46fb7-9af9-40f1-9c76-329d6781ee81+8:17178:x1870705581024640:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1784044312.766280:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3975b97850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99a46fb7-9af9-40f1-9c76-329d6781ee81+9:17178:x1870705581024640:12345-0@lo:501:mount.lustre.0 Request processed in 165us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044312.766287:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1784044312.766459:0:17178:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843737b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99a46fb7-9af9-40f1-9c76-329d6781ee81:17178:1870705581024640:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1784044312.766488:0:17178:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843737b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99a46fb7-9af9-40f1-9c76-329d6781ee81:17178:1870705581024768:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1784044312.766546:0:17178:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044312.766572:0:17178:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b394694f3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784044312.766610:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581024768 00000100:00100000:2.0:1784044312.766615:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581024768 00000100:00100000:2.0:1784044312.766647:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1784044312.766654:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3975b96050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99a46fb7-9af9-40f1-9c76-329d6781ee81+9:17178:x1870705581024768:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1784044312.770455:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3975b96050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99a46fb7-9af9-40f1-9c76-329d6781ee81+9:17178:x1870705581024768:12345-0@lo:503:mount.lustre.0 Request processed in 3789us (3895us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044312.770488:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1784044312.770640:0:17178:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843737b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99a46fb7-9af9-40f1-9c76-329d6781ee81:17178:1870705581024768:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1784044312.771729:0:17218:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843ce4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:99a46fb7-9af9-40f1-9c76-329d6781ee81:17218:1870705581024896:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784044312.771793:0:17218:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044312.771838:0:17218:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b394a34e0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784044312.772215:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581024896 00000100:00100000:0.0:1784044312.772223:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581024896 00000100:00100000:0.0:1784044312.772266:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1784044312.772276:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3975b96c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99a46fb7-9af9-40f1-9c76-329d6781ee81+9:17218:x1870705581024896:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784044312.775449:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3975b96c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99a46fb7-9af9-40f1-9c76-329d6781ee81+9:17218:x1870705581024896:12345-0@lo:502:llog_process_th.0 Request processed in 3164us (3646us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044312.775470:0:17218:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843ce4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:99a46fb7-9af9-40f1-9c76-329d6781ee81:17218:1870705581024896:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784044312.775482:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000020:01000000:3.0:1784044312.775529:0:17218:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784044312.775542:0:17218:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784044312.775545:0:17218:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1784044312.775551:0:17218:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1784044312.775554:0:17218:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1784044312.775569:0:17218:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff9b3843560000) 00000020:00000080:3.0:1784044312.775587:0:17218:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1784044312.775592:0:17218:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1784044312.775699:0:17218:0:(osd_handler.c:8929:osd_obd_connect()) connect #2 00000020:00000080:3.0:1784044312.775707:0:17218:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x89871fc3aba190cd 00000020:00000080:3.0:1784044312.775949:0:17218:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1784044312.775954:0:17218:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784044312.775958:0:17218:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784044312.775959:0:17218:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1784044312.775962:0:17218:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784044312.775966:0:17218:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784044312.775968:0:17218:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1784044312.775971:0:17218:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1784044312.775979:0:17218:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff9b3843563380) 00000020:00000080:3.0:1784044312.775988:0:17218:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1784044312.775992:0:17218:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1784044312.775994:0:17218:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1784044312.775998:0:17218:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1784044312.776004:0:17218:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1784044312.776052:0:17218:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9b397a8e8000 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1784044312.776064:0:17218:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff9b38435619c0) 00000020:00000080:3.0:1784044312.776072:0:17218:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1784044312.776135:0:17218:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1784044312.776154:0:17218:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x89871fc3aba190e2 00000020:00000080:3.0:1784044312.776286:0:17218:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1784044312.776292:0:17218:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1784044312.776297:0:17218:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x89871fc3aba190e9 00080000:01000000:3.0:1784044312.776301:0:17218:0:(osd_handler.c:8929:osd_obd_connect()) connect #3 00000020:00000080:3.0:1784044312.776304:0:17218:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x89871fc3aba190f0 00010000:00010000:2.0:1784044312.880039:0:17218:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:2.0:1784044312.881727:0:17218:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967528 00000001:00080000:2.0:1784044312.882021:0:17218:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1784044312.882604:0:17218:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff9b38424519c0) 00000020:00000080:2.0:1784044312.882627:0:17218:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1784044312.882704:0:17218:0:(osd_handler.c:8929:osd_obd_connect()) connect #4 00000020:00000080:2.0:1784044312.882712:0:17218:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x89871fc3aba190fe 00000020:00000080:2.0:1784044312.885446:0:17218:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1784044312.889661:0:17218:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x89871fc3aba19105 00000020:00000080:3.0:1784044312.891444:0:17218:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1784044312.891459:0:17218:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784044312.891465:0:17218:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784044312.891467:0:17218:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1784044312.891470:0:17218:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1784044312.891473:0:17218:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #8 00000020:01000000:3.0:1784044312.891475:0:17218:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1784044312.891476:0:17218:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1784044312.891478:0:17218:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1784044312.891481:0:17218:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784044312.891482:0:17218:0:(obd_config.c:1561:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:3.0:1784044312.891484:0:17218:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784044312.891489:0:17218:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784044312.891490:0:17218:0:(obd_config.c:1561:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1784044312.891494:0:17218:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1784044312.891541:0:17218:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1784044312.891557:0:17218:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784044312.891559:0:17218:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784044312.891561:0:17218:0:(obd_config.c:1561:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:3.0:1784044312.891564:0:17218:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784044312.891567:0:17218:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784044312.891568:0:17218:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:3.0:1784044312.891571:0:17218:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1784044312.891576:0:17218:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.202.140@tcp to nid 0x20000c0a8ca8c (192.168.202.140@tcp) 00000020:00000080:3.0:1784044312.891610:0:17218:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1784044312.891627:0:17218:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff9b3974250000) 00000020:00000080:3.0:1784044312.891644:0:17218:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:3.0:1784044312.891649:0:17218:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1784044312.891718:0:17218:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:3.0:1784044312.891724:0:17218:0:(osd_handler.c:8929:osd_obd_connect()) connect #5 00000020:00000080:3.0:1784044312.891730:0:17218:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x89871fc3aba19113 00010000:00080000:3.0:1784044312.891764:0:17218:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9b3974dac800@lustre-MDT0001-osp-MDT0000: add connection 192.168.202.140@tcp at head 00010000:00010000:2.0:1784044312.893998:0:17218:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-1 is initialized 00000020:00000080:3.0:1784044312.898789:0:17218:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1784044312.898804:0:17218:0:(obd_config.c:1470:class_process_config()) processing cmd: cf014 00000004:01000000:3.0:1784044312.898848:0:17218:0:(lod_lov.c:129:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:3.0:1784044312.898868:0:17218:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x89871fc3aba1911a 00000100:00080000:3.0:1784044312.898880:0:17218:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1784044312.898886:0:17218:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9b3974dac800 using connection 192.168.202.140@tcp/0@lo 00000100:00100000:3.0:1784044312.898924:0:17218:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b3843ce4700 x1870705581025024/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1784044312.898951:0:17218:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:3.0:1784044312.899004:0:17218:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784044312.899007:0:17218:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784044312.899009:0:17218:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:3.0:1784044312.899012:0:17218:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1784044312.899015:0:17218:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #18 00000020:01000000:3.0:1784044312.899016:0:17218:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1784044312.899018:0:17218:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1784044312.899020:0:17218:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1784044312.899022:0:17218:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784044312.899023:0:17218:0:(obd_config.c:1561:class_process_config()) marker 18 (0x6) lustre sys.timeout 00000020:01000000:3.0:1784044312.899025:0:17218:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1784044312.899030:0:17218:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1784044312.899033:0:17218:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784044312.899034:0:17218:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1784044312.899042:0:17218:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1784044312.899047:0:17218:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.202.140@tcp to nid 0x20000c0a8ca8c (192.168.202.140@tcp) 00000020:01000000:3.0:1784044312.899070:0:17218:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1784044312.899073:0:17218:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1784044312.899085:0:17218:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9b3974253380) 00000020:00000080:3.0:1784044312.899095:0:17218:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:3.0:1784044312.899099:0:17218:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1784044312.899191:0:17218:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1784044312.899198:0:17218:0:(osd_handler.c:8929:osd_obd_connect()) connect #6 00000020:00000080:3.0:1784044312.899204:0:17218:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x89871fc3aba19128 00010000:00080000:3.0:1784044312.899245:0:17218:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9b396f25c000@lustre-OST0000-osc-MDT0000: add connection 192.168.202.140@tcp at head 00000100:00100000:1.0:1784044312.899279:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843737b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:99a46fb7-9af9-40f1-9c76-329d6781ee81:3641:1870705581025152:0@lo:400:kworker.0 00000100:00100000:1.0:1784044312.899362:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1784044312.899441:0:17218:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-2 is initialized 00000100:00100000:3.0:1784044312.899676:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581025152 00000100:00100000:3.0:1784044312.899683:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581025152 00000100:00100000:3.0:1784044312.899737:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1784044312.899749:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3975b97050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99a46fb7-9af9-40f1-9c76-329d6781ee81+9:3641:x1870705581025152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044312.899809:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3975b97050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99a46fb7-9af9-40f1-9c76-329d6781ee81+9:3641:x1870705581025152:12345-0@lo:400:kworker.0 Request processed in 62us (447us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044312.899816:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1784044312.899864:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843737b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:99a46fb7-9af9-40f1-9c76-329d6781ee81:3641:1870705581025152:0@lo:400:kworker.0 00000040:01000000:3.0:1784044312.900793:0:17218:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1784044312.900973:0:17218:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000100:00100000:2.0:1784044312.901493:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843ce4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1870705581025024:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1784044312.901578:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044312.902054:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581025024 00000100:00100000:0.0:1784044312.902061:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581025024 00000100:00100000:0.0:1784044312.902106:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1784044312.902113:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3975b7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3637:x1870705581025024:12345-0@lo:38:llog_process_th.0 00010000:00020000:0.0:1784044312.902130:0:17205:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000040:00080000:3.0:1784044312.903371:0:17218:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1784044312.903688:0:17218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:2.0:1784044312.908807:0:17218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:2.0:1784044312.909637:0:17224:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1784044312.909643:0:17224:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1784044312.910447:0:17218:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1784044312.910463:0:17218:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1784044312.910526:0:17218:0:(lod_lov.c:129:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1784044312.910551:0:17218:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x89871fc3aba1912f 00000100:00080000:2.0:1784044312.910563:0:17218:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1784044312.910569:0:17218:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9b396f25c000 using connection 192.168.202.140@tcp/0@lo 00000100:00100000:2.0:1784044312.910610:0:17218:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b3975b7e300 x1870705581025280/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1784044312.910642:0:17218:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1784044312.910740:0:17218:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784044312.910744:0:17218:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784044312.910746:0:17218:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1784044312.910750:0:17218:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1784044312.910753:0:17218:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #25 00000020:01000000:2.0:1784044312.910754:0:17218:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1784044312.910756:0:17218:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1784044312.910757:0:17218:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1784044312.910760:0:17218:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784044312.910762:0:17218:0:(obd_config.c:1561:class_process_config()) marker 25 (0x6) lustre sys.timeout 00000020:01000000:2.0:1784044312.910765:0:17218:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1784044312.910769:0:17218:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1784044312.910773:0:17218:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784044312.910774:0:17218:0:(obd_config.c:1561:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1784044312.910778:0:17218:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1784044312.910782:0:17218:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.202.140@tcp to nid 0x20000c0a8ca8c (192.168.202.140@tcp) 00000020:01000000:2.0:1784044312.910810:0:17218:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1784044312.910813:0:17218:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1784044312.910824:0:17218:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9b3842453380) 00000020:00000080:2.0:1784044312.910838:0:17218:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:2.0:1784044312.910843:0:17218:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1784044312.910903:0:17218:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1784044312.910908:0:17218:0:(osd_handler.c:8929:osd_obd_connect()) connect #7 00000020:00000080:2.0:1784044312.910914:0:17218:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x89871fc3aba1913d 00010000:00080000:2.0:1784044312.910944:0:17218:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9b397b804800@lustre-OST0001-osc-MDT0000: add connection 192.168.202.140@tcp at head 00010000:00010000:2.0:1784044312.911146:0:17218:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-3 is initialized 00000040:01000000:2.0:1784044312.911241:0:17218:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1784044312.911255:0:17218:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000100:00100000:3.0:1784044312.911551:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3975b7e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1870705581025280:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1784044312.911617:0:3637:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1870705581025280 offset 0 length 520: 4 00000040:00080000:2.0:1784044312.914315:0:17218:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1784044312.918022:0:17218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:2.0:1784044312.918304:0:17218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000100:00100000:0.0:1784044312.919027:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3975b7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3637:x1870705581025024:12345-0@lo:38:llog_process_th.0 Request processed in 16907us (17443us total) trans 0 rc -19/-19 00000100:00100000:0.0:1784044312.919041:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000040:00080000:0.0:1784044312.919637:0:17226:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1784044312.919642:0:17226:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000100:00080000:2.0:1784044312.920552:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9b3974dac800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1784044312.920562:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1784044312.920566:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843ce4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1870705581025024:0@lo:38:llog_process_th.0 00000020:00000080:0.0:1784044312.921674:0:17218:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1784044312.921688:0:17218:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1784044312.921731:0:17218:0:(lod_lov.c:129:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1784044312.921753:0:17218:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x89871fc3aba19144 00000100:00080000:0.0:1784044312.921762:0:17218:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1784044312.921768:0:17218:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9b397b804800 using connection 192.168.202.140@tcp/0@lo 00000100:00100000:0.0:1784044312.921799:0:17218:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b3947ee9f80 x1870705581025408/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1784044312.921829:0:17218:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1784044312.921883:0:17218:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784044312.921886:0:17218:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784044312.921888:0:17218:0:(obd_config.c:1561:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1784044312.921890:0:17218:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784044312.921893:0:17218:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784044312.921895:0:17218:0:(obd_config.c:1561:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:0.0:1784044312.921898:0:17218:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1784044312.921907:0:17218:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1784044312.921909:0:17218:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784044312.921912:0:17218:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784044312.921913:0:17218:0:(obd_config.c:1561:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000020:01000000:0.0:1784044312.921915:0:17218:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784044312.921917:0:17218:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784044312.921919:0:17218:0:(obd_config.c:1561:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1784044312.921922:0:17218:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1784044312.921950:0:17218:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3947eeb800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:99a46fb7-9af9-40f1-9c76-329d6781ee81:17218:1870705581025536:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784044312.922018:0:17218:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044312.922056:0:17218:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b39741e1300 going to sleep for 11 seconds 00000100:00100000:0.0:1784044312.922088:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581025536 00000100:00100000:0.0:1784044312.922092:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581025536 00000100:00100000:0.0:1784044312.922127:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1784044312.922145:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3975b94c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99a46fb7-9af9-40f1-9c76-329d6781ee81+9:17218:x1870705581025536:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784044312.922278:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3975b94c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99a46fb7-9af9-40f1-9c76-329d6781ee81+9:17218:x1870705581025536:12345-0@lo:502:llog_process_th.0 Request processed in 142us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044312.922286:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1784044312.922339:0:17218:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3947eeb800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:99a46fb7-9af9-40f1-9c76-329d6781ee81:17218:1870705581025536:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1784044312.922364:0:17218:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784044312.922368:0:17218:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784044312.922369:0:17218:0:(obd_config.c:1561:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1784044312.922373:0:17218:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:1.0:1784044312.922788:0:17178:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:1.0:1784044312.922819:0:17178:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1784044312.922845:0:17178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b38426fce00/0x89871fc3aba190b8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba190bf expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044312.922855:0:17178:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9b38426fce00/0x89871fc3aba190b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba190bf expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784044312.922863:0:17178:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9b397a8e8000 from 1 10000000:01000000:1.0:1784044312.922866:0:17178:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1784044312.922892:0:17178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b38426fd400/0x89871fc3aba1914b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044312.922899:0:17178:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9b38426fd400/0x89871fc3aba1914b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044312.922909:0:17178:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9b38426fd400/0x89871fc3aba1914b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044312.922924:0:17178:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843735180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99a46fb7-9af9-40f1-9c76-329d6781ee81:17178:1870705581025664:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1784044312.922956:0:17178:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044312.922979:0:17178:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b394694f600 going to sleep for 11 seconds 00000100:00100000:1.0:1784044312.923001:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581025664 00000100:00100000:1.0:1784044312.923005:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581025664 00000100:00100000:1.0:1784044312.923034:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1784044312.923041:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3975b95c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99a46fb7-9af9-40f1-9c76-329d6781ee81+9:17178:x1870705581025664:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1784044312.923049:0:17192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784044312.923062:0:17192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b38426fca00/0x89871fc3aba19152 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x89871fc3aba1914b expref: -99 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044312.923098:0:17192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b38426fca00/0x89871fc3aba19152 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x89871fc3aba1914b expref: 10 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044312.923116:0:17192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b38426fca00/0x89871fc3aba19152 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x89871fc3aba1914b expref: 10 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044312.923126:0:17192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b38426fca00, rc 0) 00000100:00100000:1.0:1784044312.923297:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3975b95c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99a46fb7-9af9-40f1-9c76-329d6781ee81+10:17178:x1870705581025664:12345-0@lo:101:mount.lustre.0 Request processed in 240us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044312.923304:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1784044312.923348:0:17178:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843735180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99a46fb7-9af9-40f1-9c76-329d6781ee81:17178:1870705581025664:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1784044312.923362:0:17178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9b38426fd400/0x89871fc3aba1914b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba19152 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044312.923371:0:17178:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9b38426fd400/0x89871fc3aba1914b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x89871fc3aba19152 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044312.924016:0:17178:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843735180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99a46fb7-9af9-40f1-9c76-329d6781ee81:17178:1870705581025792:0@lo:256:mount.lustre.0 00000100:00100000:1.0:1784044312.924058:0:17178:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044312.924313:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3947ee9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1870705581025408:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1784044312.924344:0:3637:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1870705581025408 offset 0 length 520: 4 00000100:00100000:1.0:1784044312.928522:0:17178:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b394694f600 going to sleep for 11 seconds 00000100:00100000:3.0:1784044312.930991:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581025792 00000100:00100000:3.0:1784044312.931006:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581025792 00000100:00100000:3.0:1784044312.931081:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1784044312.931092:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3975b96450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99a46fb7-9af9-40f1-9c76-329d6781ee81+10:17178:x1870705581025792:12345-0@lo:256:mount.lustre.0 20000000:01000000:3.0:1784044312.931263:0:17194:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1784044312.931270:0:17194:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:3.0:1784044312.931524:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3975b96450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99a46fb7-9af9-40f1-9c76-329d6781ee81+10:17178:x1870705581025792:12345-0@lo:256:mount.lustre.0 Request processed in 432us (7463us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044312.931534:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1784044312.931690:0:17178:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843735180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99a46fb7-9af9-40f1-9c76-329d6781ee81:17178:1870705581025792:0@lo:256:mount.lustre.0 10000000:01000000:1.0:1784044312.934450:0:17178:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1784044312.934530:0:17178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b38426fd400/0x89871fc3aba1914b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba19152 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044312.934547:0:17178:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9b38426fd400/0x89871fc3aba1914b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba19152 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784044312.934557:0:17178:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9b397a8e8000 from 1 10000000:01000000:1.0:1784044312.934575:0:17178:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1784044312.934627:0:17178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b38426fc400/0x89871fc3aba19159 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044312.934636:0:17178:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9b38426fc400/0x89871fc3aba19159 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044312.934649:0:17178:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9b38426fc400/0x89871fc3aba19159 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044312.934679:0:17178:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843735180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99a46fb7-9af9-40f1-9c76-329d6781ee81:17178:1870705581025920:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1784044312.934752:0:17178:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044312.934808:0:17178:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b394694f600 going to sleep for 11 seconds 00000100:00100000:2.0:1784044312.936394:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581025920 00000100:00100000:2.0:1784044312.936416:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581025920 00000100:00100000:2.0:1784044312.936485:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1784044312.936496:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3975b95450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99a46fb7-9af9-40f1-9c76-329d6781ee81+10:17178:x1870705581025920:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1784044312.936511:0:17193:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784044312.936530:0:17193:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b3843798400/0x89871fc3aba19160 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x89871fc3aba19159 expref: -99 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044312.936558:0:17193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b3843798400/0x89871fc3aba19160 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x89871fc3aba19159 expref: 11 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044312.936570:0:17193:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b3843798400/0x89871fc3aba19160 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x89871fc3aba19159 expref: 11 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044312.936579:0:17193:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3843798400, rc 0) 00000100:00100000:2.0:1784044312.936657:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3975b95450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99a46fb7-9af9-40f1-9c76-329d6781ee81+11:17178:x1870705581025920:12345-0@lo:101:mount.lustre.0 Request processed in 163us (1904us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044312.936682:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1784044312.936899:0:17178:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843735180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99a46fb7-9af9-40f1-9c76-329d6781ee81:17178:1870705581025920:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1784044312.936919:0:17178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9b38426fc400/0x89871fc3aba19159 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba19160 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044312.936929:0:17178:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9b38426fc400/0x89871fc3aba19159 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x89871fc3aba19160 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044312.937014:0:17178:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843ce7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99a46fb7-9af9-40f1-9c76-329d6781ee81:17178:1870705581026048:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1784044312.937049:0:17178:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044312.937090:0:17178:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b397b8d3000 going to sleep for 11 seconds 00000100:00100000:2.0:1784044312.937237:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581026048 00000100:00100000:2.0:1784044312.937242:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581026048 00000100:00100000:2.0:1784044312.937277:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1784044312.937284:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3975b94050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99a46fb7-9af9-40f1-9c76-329d6781ee81+11:17178:x1870705581026048:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784044312.937473:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3975b94050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99a46fb7-9af9-40f1-9c76-329d6781ee81+11:17178:x1870705581026048:12345-0@lo:501:mount.lustre.0 Request processed in 188us (422us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044312.937481:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1784044312.937595:0:17178:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843ce7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99a46fb7-9af9-40f1-9c76-329d6781ee81:17178:1870705581026048:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1784044312.937634:0:17178:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843736680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99a46fb7-9af9-40f1-9c76-329d6781ee81:17178:1870705581026176:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1784044312.937677:0:17178:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044312.937704:0:17178:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b394694fd80 going to sleep for 11 seconds 00000100:00100000:2.0:1784044312.937758:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581026176 00000100:00100000:2.0:1784044312.937763:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581026176 00000100:00100000:2.0:1784044312.937788:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1784044312.937794:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3975b97c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99a46fb7-9af9-40f1-9c76-329d6781ee81+11:17178:x1870705581026176:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1784044312.937919:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3975b97c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99a46fb7-9af9-40f1-9c76-329d6781ee81+11:17178:x1870705581026176:12345-0@lo:503:mount.lustre.0 Request processed in 124us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044312.937927:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1784044312.943772:0:17178:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843736680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99a46fb7-9af9-40f1-9c76-329d6781ee81:17178:1870705581026176:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1784044312.944355:0:17228:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3975b7ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:99a46fb7-9af9-40f1-9c76-329d6781ee81:17228:1870705581026304:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784044312.944453:0:17228:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044312.944505:0:17228:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b396f35f000 going to sleep for 11 seconds 00000100:00100000:3.0:1784044312.944617:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581026304 00000100:00100000:3.0:1784044312.944626:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581026304 00000100:00100000:3.0:1784044312.944682:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1784044312.944693:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397424c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99a46fb7-9af9-40f1-9c76-329d6781ee81+11:17228:x1870705581026304:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784044312.945857:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397424c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99a46fb7-9af9-40f1-9c76-329d6781ee81+11:17228:x1870705581026304:12345-0@lo:502:llog_process_th.0 Request processed in 1158us (1396us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044312.945868:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1784044312.945900:0:17228:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3975b7ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:99a46fb7-9af9-40f1-9c76-329d6781ee81:17228:1870705581026304:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1784044312.945940:0:17228:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784044312.945952:0:17228:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784044312.945955:0:17228:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1784044312.945967:0:17228:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9b397a8e8000 00000020:00000080:2.0:1784044312.945970:0:17228:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1784044312.945982:0:17228:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784044312.945985:0:17228:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784044312.945995:0:17228:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1784044312.945998:0:17228:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784044312.946001:0:17228:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784044312.946003:0:17228:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1784044312.946009:0:17228:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9b397a8e8000 00000020:00000080:2.0:1784044312.946011:0:17228:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1784044312.946093:0:17228:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784044312.946097:0:17228:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784044312.946099:0:17228:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1784044312.946101:0:17228:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784044312.946104:0:17228:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784044312.946105:0:17228:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1784044312.946121:0:17228:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9b397a8e8000 00000020:00000080:2.0:1784044312.946123:0:17228:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1784044312.946142:0:17228:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784044312.946145:0:17228:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784044312.946146:0:17228:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1784044312.946149:0:17228:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784044312.946152:0:17228:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784044312.946153:0:17228:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1784044312.946156:0:17228:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9b397a8e8000 00000020:00000080:2.0:1784044312.946158:0:17228:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1784044312.946241:0:17228:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3975b7ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:99a46fb7-9af9-40f1-9c76-329d6781ee81:17228:1870705581026432:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784044312.946289:0:17228:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044312.946332:0:17228:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b396f35f000 going to sleep for 11 seconds 00000100:00100000:3.0:1784044312.947429:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581026432 00000100:00100000:3.0:1784044312.947442:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581026432 00000100:00100000:3.0:1784044312.947515:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1784044312.947535:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397424dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99a46fb7-9af9-40f1-9c76-329d6781ee81+11:17228:x1870705581026432:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784044312.947690:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397424dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99a46fb7-9af9-40f1-9c76-329d6781ee81+11:17228:x1870705581026432:12345-0@lo:502:llog_process_th.0 Request processed in 157us (1400us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044312.947699:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1784044312.949578:0:17228:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3975b7ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:99a46fb7-9af9-40f1-9c76-329d6781ee81:17228:1870705581026432:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1784044312.949623:0:17228:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784044312.949632:0:17228:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784044312.949634:0:17228:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1784044312.949640:0:17228:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:3.0:1784044312.949720:0:17178:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:3.0:1784044312.949742:0:17178:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1784044312.949764:0:17178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b38426fc400/0x89871fc3aba19159 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba19160 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044312.949776:0:17178:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9b38426fc400/0x89871fc3aba19159 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba19160 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784044312.949825:0:17178:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1784044312.949828:0:17178:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9b397a8e8000 10000000:01000000:3.0:1784044312.949831:0:17178:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9b397a8e8000 10000000:01000000:3.0:1784044312.949835:0:17178:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1784044312.949842:0:17178:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9b397a8e8000 from 1 10000000:01000000:3.0:1784044312.949845:0:17178:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1784044312.949880:0:17178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b394166bc00/0x89871fc3aba19167 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044312.949888:0:17178:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9b394166bc00/0x89871fc3aba19167 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044312.949897:0:17178:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9b394166bc00/0x89871fc3aba19167 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044312.949917:0:17178:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843ce7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99a46fb7-9af9-40f1-9c76-329d6781ee81:17178:1870705581026560:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1784044312.949973:0:17178:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044312.950020:0:17178:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b39741e13c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784044312.950030:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581026560 00000100:00100000:2.0:1784044312.950035:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581026560 00000100:00100000:2.0:1784044312.950081:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1784044312.950091:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397424c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99a46fb7-9af9-40f1-9c76-329d6781ee81+11:17178:x1870705581026560:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1784044312.950102:0:17192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784044312.950123:0:17192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b3843799c00/0x89871fc3aba1916e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x89871fc3aba19167 expref: -99 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044312.950153:0:17192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b3843799c00/0x89871fc3aba1916e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x89871fc3aba19167 expref: 12 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044312.950163:0:17192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b3843799c00/0x89871fc3aba1916e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x89871fc3aba19167 expref: 12 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044312.950190:0:17192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3843799c00, rc 0) 00000100:00100000:2.0:1784044312.950231:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397424c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99a46fb7-9af9-40f1-9c76-329d6781ee81+12:17178:x1870705581026560:12345-0@lo:101:mount.lustre.0 Request processed in 142us (258us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044312.950238:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1784044312.952151:0:17178:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843ce7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99a46fb7-9af9-40f1-9c76-329d6781ee81:17178:1870705581026560:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1784044312.952190:0:17178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9b394166bc00/0x89871fc3aba19167 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba1916e expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044312.952204:0:17178:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9b394166bc00/0x89871fc3aba19167 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x89871fc3aba1916e expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044312.952288:0:17178:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843ce7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99a46fb7-9af9-40f1-9c76-329d6781ee81:17178:1870705581026688:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1784044312.952351:0:17178:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044312.952381:0:17178:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b39741e13c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784044312.952865:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581026688 00000100:00100000:2.0:1784044312.952874:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581026688 00000100:00100000:2.0:1784044312.952922:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1784044312.952931:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397424f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99a46fb7-9af9-40f1-9c76-329d6781ee81+12:17178:x1870705581026688:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784044312.953079:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397424f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99a46fb7-9af9-40f1-9c76-329d6781ee81+12:17178:x1870705581026688:12345-0@lo:501:mount.lustre.0 Request processed in 149us (728us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044312.953087:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1784044312.953209:0:17178:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843ce7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99a46fb7-9af9-40f1-9c76-329d6781ee81:17178:1870705581026688:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1784044312.953243:0:17178:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843736680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99a46fb7-9af9-40f1-9c76-329d6781ee81:17178:1870705581026816:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1784044312.953275:0:17178:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044312.953306:0:17178:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b394694f600 going to sleep for 11 seconds 00000100:00100000:2.0:1784044312.953430:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581026816 00000100:00100000:2.0:1784044312.953435:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581026816 00000100:00100000:2.0:1784044312.953458:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1784044312.953464:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397424d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99a46fb7-9af9-40f1-9c76-329d6781ee81+12:17178:x1870705581026816:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1784044312.953549:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397424d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99a46fb7-9af9-40f1-9c76-329d6781ee81+12:17178:x1870705581026816:12345-0@lo:503:mount.lustre.0 Request processed in 85us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044312.953556:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1784044312.953632:0:17178:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843736680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99a46fb7-9af9-40f1-9c76-329d6781ee81:17178:1870705581026816:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1784044312.953935:0:17230:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843736680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:99a46fb7-9af9-40f1-9c76-329d6781ee81:17230:1870705581026944:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784044312.953970:0:17230:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044312.953997:0:17230:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b38436ea840 going to sleep for 11 seconds 00000100:00100000:2.0:1784044312.954039:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581026944 00000100:00100000:2.0:1784044312.954043:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581026944 00000100:00100000:2.0:1784044312.954078:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1784044312.954083:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397424c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99a46fb7-9af9-40f1-9c76-329d6781ee81+12:17230:x1870705581026944:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784044312.954965:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397424c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99a46fb7-9af9-40f1-9c76-329d6781ee81+12:17230:x1870705581026944:12345-0@lo:502:llog_process_th.0 Request processed in 878us (991us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044312.954974:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1784044312.955056:0:17230:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843736680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:99a46fb7-9af9-40f1-9c76-329d6781ee81:17230:1870705581026944:0@lo:502:llog_process_th.0 00000020:01000004:1.0:1784044312.955127:0:17230:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1784044312.955141:0:17230:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff9b38430499c0) 00000020:00000080:1.0:1784044312.955163:0:17230:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type lwp with refcount 2 00000020:01000004:1.0:1784044312.955341:0:17230:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9b397a8e8000 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1784044312.955345:0:17230:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9b397a8e8000 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1784044312.955348:0:17230:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9b397a8e8000 4 00010000:00080000:1.0:1784044312.955373:0:17230:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9b394740b000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.202.140@tcp at head 00010000:00010000:1.0:1784044312.956974:0:17230:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-4 is initialized 00000020:00000080:1.0:1784044312.957106:0:17230:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1784044312.957147:0:17230:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1784044312.957163:0:17230:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x89871fc3aba1917c 00000100:00080000:1.0:1784044312.957198:0:17230:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1784044312.957205:0:17230:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9b394740b000 using connection 192.168.202.140@tcp/0@lo 00000100:00100000:1.0:1784044312.957243:0:17230:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b3843736680 x1870705581027072/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1784044312.957278:0:17230:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1784044312.958246:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843736680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3637:1870705581027072:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1784044312.958319:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044312.962987:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581027072 00000100:00100000:1.0:1784044312.963004:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581027072 00000100:00100000:1.0:1784044312.963065:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1784044312.963078:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3975b7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3637:x1870705581027072:12345-0@lo:38:llog_process_th.0 00000100:00100000:1.0:1784044312.964289:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3975b7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3637:x1870705581027072:12345-0@lo:38:llog_process_th.0 Request processed in 1206us (5964us total) trans 0 rc -11/-11 00000100:00100000:1.0:1784044312.964304:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1784044312.964376:0:3637:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1784044312.964385:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9b394740b000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1784044312.964390:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1784044312.964394:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843736680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3637:1870705581027072:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1784044312.968016:0:17230:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843736680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:99a46fb7-9af9-40f1-9c76-329d6781ee81:17230:1870705581027200:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784044312.968119:0:17230:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044312.968158:0:17230:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b38436ea840 going to sleep for 11 seconds 00000100:00100000:1.0:1784044312.968253:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581027200 00000100:00100000:1.0:1784044312.968259:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581027200 00000100:00100000:1.0:1784044312.968303:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1784044312.968313:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397424e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99a46fb7-9af9-40f1-9c76-329d6781ee81+12:17230:x1870705581027200:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784044312.968462:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397424e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99a46fb7-9af9-40f1-9c76-329d6781ee81+12:17230:x1870705581027200:12345-0@lo:502:llog_process_th.0 Request processed in 148us (354us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044312.968470:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1784044312.968531:0:17230:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843736680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:99a46fb7-9af9-40f1-9c76-329d6781ee81:17230:1870705581027200:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784044312.968566:0:17230:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843736680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:99a46fb7-9af9-40f1-9c76-329d6781ee81:17230:1870705581027328:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784044312.968597:0:17230:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044312.968613:0:17230:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b38436ea840 going to sleep for 11 seconds 00000100:00100000:1.0:1784044312.968626:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581027328 00000100:00100000:1.0:1784044312.968629:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581027328 00000100:00100000:1.0:1784044312.968649:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1784044312.968656:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397424e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99a46fb7-9af9-40f1-9c76-329d6781ee81+12:17230:x1870705581027328:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784044312.968715:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397424e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99a46fb7-9af9-40f1-9c76-329d6781ee81+12:17230:x1870705581027328:12345-0@lo:502:llog_process_th.0 Request processed in 58us (117us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044312.968729:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1784044312.968763:0:17230:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843736680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:99a46fb7-9af9-40f1-9c76-329d6781ee81:17230:1870705581027328:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1784044312.968780:0:17230:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:2.0:1784044312.968862:0:17178:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1784044312.968889:0:17178:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1784044312.968928:0:17178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b394166bc00/0x89871fc3aba19167 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba1916e expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044312.968940:0:17178:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9b394166bc00/0x89871fc3aba19167 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba1916e expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1784044312.968995:0:17178:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1784044312.968998:0:17178:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1784044312.968999:0:17178:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784044312.969000:0:17178:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784044312.969001:0:17178:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784044312.969003:0:17178:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784044312.969004:0:17178:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1784044312.969006:0:17178:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1784044312.969009:0:17178:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784044312.969010:0:17178:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1784044312.969015:0:17178:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:2.0:1784044312.969018:0:17178:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1784044312.969019:0:17178:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1784044312.969021:0:17178:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784044312.969022:0:17178:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784044312.969023:0:17178:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784044312.969024:0:17178:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784044312.969026:0:17178:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1784044312.969032:0:17178:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1784044312.969033:0:17178:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784044312.969033:0:17178:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1784044312.969054:0:17178:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1784044312.969064:0:17178:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3975b7dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99a46fb7-9af9-40f1-9c76-329d6781ee81:17178:1870705581027456:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1784044312.969098:0:17178:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044312.969121:0:17178:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b396f35fc00 going to sleep for 11 seconds 00000100:00100000:1.0:1784044312.969502:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581027456 00000100:00100000:1.0:1784044312.969508:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581027456 00000100:00100000:1.0:1784044312.969544:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1784044312.969550:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397424cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99a46fb7-9af9-40f1-9c76-329d6781ee81+12:17178:x1870705581027456:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1784044312.969572:0:17193:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1784044312.969590:0:17193:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1784044312.982453:0:17193:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1784044312.982482:0:17193:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:2.0:1784044312.982517:0:17216:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1784044312.982523:0:17216:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1784044312.982555:0:17216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b3843798000/0x89871fc3aba19183 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044312.982580:0:17216:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b38426fca00/0x89871fc3aba19152 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x89871fc3aba1914b expref: 12 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044312.982589:0:17216:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b3843798000/0x89871fc3aba19183 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044312.982641:0:17216:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b38426fca00/0x89871fc3aba19152 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x89871fc3aba1914b expref: 12 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044312.982657:0:17216:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b38426fca00/0x89871fc3aba19152 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x89871fc3aba1914b expref: 12 pid: 17192 timeout: 606 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044312.982672:0:17216:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3975b7df80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17216:1870705581027584:0@lo:104: 00000100:00100000:2.0:1784044312.982747:0:17216:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044312.982799:0:17216:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b396f35f0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784044312.982815:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581027584 00000100:00100000:0.0:1784044312.982824:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581027584 00000100:00100000:0.0:1784044312.982895:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1784044312.982907:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3975b7f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:99a46fb7-9af9-40f1-9c76-329d6781ee81+3:17216:x1870705581027584:12345-0@lo:104: 00010000:00010000:0.0:1784044312.982923:0:17182:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.140@tcp lock: ffff9b38426fd400/0x89871fc3aba1914b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x89871fc3aba19152 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044312.983048:0:17216:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3975b7df80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17216:1870705581027584:0@lo:104: 00010000:00010000:2.0:1784044312.983070:0:17216:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b3843798000/0x89871fc3aba19183 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044312.983146:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397424cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99a46fb7-9af9-40f1-9c76-329d6781ee81+12:17178:x1870705581027456:12345-0@lo:253:mount.lustre.0 Request processed in 13594us (14045us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044312.983156:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1784044312.983755:0:17178:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3975b7dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99a46fb7-9af9-40f1-9c76-329d6781ee81:17178:1870705581027456:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1784044312.983775:0:17178:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00010000:00010000:0.0:1784044312.983777:0:17182:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000020:01000004:2.0:1784044312.983778:0:17178:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1784044312.983780:0:17178:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1784044312.983781:0:17178:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784044312.983782:0:17178:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784044312.983784:0:17178:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000100:00100000:0.0:1784044312.983784:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3975b7f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:99a46fb7-9af9-40f1-9c76-329d6781ee81+3:17216:x1870705581027584:12345-0@lo:104: Request processed in 879us (1037us total) trans 0 rc 0/0 00000020:01000004:2.0:1784044312.983785:0:17178:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784044312.983786:0:17178:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1784044312.983788:0:17178:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1784044312.983791:0:17178:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784044312.983792:0:17178:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:0.0:1784044312.983792:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000020:02000000:2.0:1784044312.983807:0:17178:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:1.0:1784044312.986033:0:17188:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784044312.986052:0:17188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: ffff9b38426fd400/0x89871fc3aba1914b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x89871fc3aba19152 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044312.986066:0:17188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38426fd400 already unused, calling callback (ffffffffc113cc20) 10000000:00010000:1.0:1784044312.986071:0:17188:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: ffff9b38426fd400/0x89871fc3aba1914b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x89871fc3aba19152 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044312.986083:0:17188:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9b38426fd400/0x89871fc3aba1914b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x89871fc3aba19152 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784044312.986092:0:17188:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9b38426fd400/0x89871fc3aba1914b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x89871fc3aba19152 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784044312.986098:0:17188:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1784044312.988135:0:17188:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.140@tcp lock: ffff9b38426fd400/0x89871fc3aba1914b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x89871fc3aba19152 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044312.988159:0:17188:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784044312.988217:0:17188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: ffff9b38426fd400/0x89871fc3aba1914b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x89871fc3aba19152 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044312.988225:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9b38426fd400/0x89871fc3aba1914b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x89871fc3aba19152 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044312.988249:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784044312.988252:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784044312.988254:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784044312.988300:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1784044312.988320:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843736680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:99a46fb7-9af9-40f1-9c76-329d6781ee81:3639:1870705581027712:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784044312.988408:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044313.007606:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581027712 00000100:00100000:3.0:1784044313.007622:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581027712 00010000:00010000:3.0:1784044313.007667:0:17184:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b38426fca00/0x89871fc3aba19152 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x89871fc3aba1914b expref: 12 pid: 17192 timeout: 606 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044313.007701:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1784044313.007710:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843734a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:99a46fb7-9af9-40f1-9c76-329d6781ee81+12:3639:x1870705581027712:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784044313.007723:0:17184:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784044313.007729:0:17184:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b38426fca00/0x89871fc3aba19152 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x89871fc3aba1914b expref: 12 pid: 17192 timeout: 606 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044313.007741:0:17184:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b38426fca00/0x89871fc3aba19152 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x89871fc3aba1914b expref: 12 pid: 17192 timeout: 606 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044313.007770:0:17184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b38426fca00/0x89871fc3aba19152 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x89871fc3aba1914b expref: 12 pid: 17192 timeout: 606 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044313.007784:0:17184:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b3843798000/0x89871fc3aba19183 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044313.007792:0:17184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b3843798000/0x89871fc3aba19183 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1784044313.007810:0:17184:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.025288238s 00010000:00010000:3.0:1784044313.007815:0:17184:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b3843798000/0x89871fc3aba19183 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044313.007822:0:17184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b3843798000/0x89871fc3aba19183 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044313.007828:0:17184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b3843798000/0x89871fc3aba19183 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044313.007835:0:17184:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b3843798000/0x89871fc3aba19183 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044313.007841:0:17184:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3843798000 already unused, calling callback (ffffffffc0b56230) 00010000:00010000:3.0:1784044313.007845:0:17184:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b3843798000/0x89871fc3aba19183 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044313.007853:0:17184:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b3843798000/0x89871fc3aba19183 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044313.007867:0:17184:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b3843798000/0x89871fc3aba19183 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044313.007883:0:17184:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784044313.007953:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843734a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:99a46fb7-9af9-40f1-9c76-329d6781ee81+11:3639:x1870705581027712:12345-0@lo:103:ldlm_bl.0 Request processed in 244us (19555us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044313.007961:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:3.0:1784044313.008001:0:17216:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b3843798000/0x89871fc3aba19183 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044313.008009:0:17216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b3843798000/0x89871fc3aba19183 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044313.008015:0:17216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b3843798000/0x89871fc3aba19183 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044313.008054:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843736680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:99a46fb7-9af9-40f1-9c76-329d6781ee81:3639:1870705581027712:0@lo:103:ldlm_bl.0 00000020:00080000:3.0:1784044313.019611:0:17178:0:(update_trans.c:1495:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:0.0:1784044313.020553:0:17178:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:2.0:1784044313.021057:0:17241:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1784044313.021070:0:17178:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000040:00080000:2.0:1784044313.021775:0:17241:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000020:00080000:3.0:1784044313.023601:0:17240:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:3.0:1784044313.023610:0:17240:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000100:00080000:3.0:1784044313.026358:0:17242:0:(client.c:1832:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff9b3843ce4700 x1870705581027840/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784044313.026375:0:17242:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b394a323b40 going to sleep for 0 seconds 00000040:01000000:0.0:1784044313.027073:0:17178:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1784044313.027231:0:17178:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1784044313.028240:0:17178:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1784044313.028255:0:17178:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1784044313.028643:0:17178:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1784044313.030307:0:17241:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1784044313.030411:0:17241:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000040:00080000:0.0:1784044313.030776:0:17178:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1784044313.032730:0:17178:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1784044313.032818:0:17178:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:0.0:1784044313.043416:0:17178:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x35:0x0] (8/32) registered 00000001:00000004:1.0:1784044313.056127:0:17178:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:1.0:1784044313.062645:0:17178:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1784044313.062696:0:17178:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb73bc1927988 00100000:10000000:1.0:1784044313.062706:0:17178:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:1.0:1784044313.063596:0:17178:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1784044313.063614:0:17178:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.140@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1784044313.063633:0:17178:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:1.0:1784044313.063663:0:17178:0:(super25.c:181:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:1.0:1784044313.064466:0:17178:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1784044313.064680:0:17178:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1784044313.616681:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1784044314.000486:0:17236:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1784044314.061567:0:17242:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b394a323b40 going to sleep for 0 seconds 10000000:01000000:0.0:1784044314.127379:0:17196:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1784044314.127396:0:17196:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9b397a8e8000 from 7 10000000:01000000:0.0:1784044314.127402:0:17196:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1784044314.127449:0:17196:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b38410b6400/0x89871fc3aba1918a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044314.127464:0:17196:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9b38410b6400/0x89871fc3aba1918a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044314.127474:0:17196:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9b38410b6400/0x89871fc3aba1918a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044314.127512:0:17196:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3947eeb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99a46fb7-9af9-40f1-9c76-329d6781ee81:17196:1870705581027968:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1784044314.127578:0:17196:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044314.127642:0:17196:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b384341b780 going to sleep for 11 seconds 00000100:00100000:1.0:1784044314.127688:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581027968 00000100:00100000:1.0:1784044314.127699:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581027968 00000100:00100000:1.0:1784044314.127758:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1784044314.127768:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397424d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99a46fb7-9af9-40f1-9c76-329d6781ee81+11:17196:x1870705581027968:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784044314.127782:0:17194:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784044314.127796:0:17194:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b38426fc800/0x89871fc3aba19191 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x89871fc3aba1918a expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044314.127828:0:17194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b38426fc800/0x89871fc3aba19191 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x89871fc3aba1918a expref: 12 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044314.127838:0:17194:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b38426fc800/0x89871fc3aba19191 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x89871fc3aba1918a expref: 12 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044314.127848:0:17194:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b38426fc800, rc 0) 00000100:00100000:1.0:1784044314.127889:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397424d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99a46fb7-9af9-40f1-9c76-329d6781ee81+12:17196:x1870705581027968:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 122us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044314.127895:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1784044314.127938:0:17196:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3947eeb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99a46fb7-9af9-40f1-9c76-329d6781ee81:17196:1870705581027968:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784044314.127951:0:17196:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9b38410b6400/0x89871fc3aba1918a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba19191 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044314.127959:0:17196:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9b38410b6400/0x89871fc3aba1918a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x89871fc3aba19191 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044314.128001:0:17196:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843734000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99a46fb7-9af9-40f1-9c76-329d6781ee81:17196:1870705581028096:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1784044314.128029:0:17196:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044314.128042:0:17196:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b394a34e540 going to sleep for 11 seconds 00000100:00100000:0.0:1784044314.128083:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581028096 00000100:00100000:0.0:1784044314.128088:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581028096 00000100:00100000:0.0:1784044314.128117:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1784044314.128123:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397424f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99a46fb7-9af9-40f1-9c76-329d6781ee81+12:17196:x1870705581028096:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1784044314.128138:0:17192:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1784044314.128153:0:17192:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1784044314.128156:0:17192:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:0.0:1784044314.128259:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397424f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99a46fb7-9af9-40f1-9c76-329d6781ee81+12:17196:x1870705581028096:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 135us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044314.128266:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1784044314.130112:0:17196:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843734000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99a46fb7-9af9-40f1-9c76-329d6781ee81:17196:1870705581028096:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1784044314.130201:0:17196:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1784044314.130221:0:17196:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b38410b6400/0x89871fc3aba1918a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba19191 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044314.130231:0:17196:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9b38410b6400/0x89871fc3aba1918a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba19191 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044314.637462:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1784044315.022371:0:17236:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1784044315.091035:0:17242:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b394a323b40 going to sleep for 0 seconds 00010000:00010000:3.0:1784044315.662580:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784044316.110286:0:17242:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b394a323b40 going to sleep for 0 seconds 00010000:00010000:1.0:1784044316.685535:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784044317.136336:0:17242:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b394a323b40 going to sleep for 0 seconds 00010000:00010000:3.0:1784044317.712419:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1784044318.083571:0:17484:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg240-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:3.0:1784044318.158263:0:17242:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b394a323b40 going to sleep for 0 seconds 00000100:00080000:0.0:1784044318.290694:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1784044318.290702:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1784044318.290706:0:37:0:(import.c:65:import_set_state_nolock()) ffff9b3974dac800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1784044318.290714:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 506 00000100:00080000:0.0:1784044318.290720:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1784044318.290727:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9b3974dac800 using connection 192.168.202.140@tcp/0@lo 00000100:00100000:0.0:1784044318.290750:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b3947eeb480 x1870705581028352/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1784044318.290763:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1784044318.290766:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1784044318.290768:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1784044318.290772:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1784044318.290774:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1784044318.290777:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1784044318.290786:0:37:0:(import.c:65:import_set_state_nolock()) ffff9b394740b000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1784044318.290792:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9b394740b000 using connection 192.168.202.140@tcp/0@lo 00000100:00100000:0.0:1784044318.290807:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b3947ee9180 x1870705581028480/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1784044318.291658:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3947eeb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1870705581028352:0@lo:38:kworker.0 00000100:00100000:3.0:1784044318.291818:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044318.291916:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3947ee9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3637:1870705581028480:0@lo:38:kworker.0 00000100:00100000:3.0:1784044318.291944:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044318.291978:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3947ee8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:99a46fb7-9af9-40f1-9c76-329d6781ee81:3639:1870705581028224:0@lo:400:kworker.0 00000100:00100000:3.0:1784044318.292008:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044318.292196:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581028224 00000100:00100000:3.0:1784044318.292204:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581028224 00000100:00100000:3.0:1784044318.292249:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1784044318.292258:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397424e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99a46fb7-9af9-40f1-9c76-329d6781ee81+12:3639:x1870705581028224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044318.292311:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397424e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99a46fb7-9af9-40f1-9c76-329d6781ee81+12:3639:x1870705581028224:12345-0@lo:400:kworker.0 Request processed in 53us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044318.292319:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1784044318.295833:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581028480 00000100:00100000:2.0:1784044318.295850:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581028480 00000100:00100000:2.0:1784044318.295898:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1784044318.295907:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843ce5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3637:x1870705581028480:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1784044318.295939:0:17201:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 511 last 0 00000020:00000080:2.0:1784044318.295984:0:17201:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x89871fc3aba19198 00000004:00100000:2.0:1784044318.296001:0:17201:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1784044318.296125:0:17201:0:(import.c:65:import_set_state_nolock()) ffff9b384244e000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1784044318.297747:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581028352 00000100:00100000:0.0:1784044318.297763:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581028352 00000100:00100000:0.0:1784044318.297804:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1784044318.297812:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843ce4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3637:x1870705581028352:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1784044318.297832:0:17205:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1784044318.298239:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843ce5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1870705581028480:12345-0@lo:38:kworker.0 Request processed in 2329us (6291us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044318.298249:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1784044318.300982:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3947ee8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:99a46fb7-9af9-40f1-9c76-329d6781ee81:3639:1870705581028224:0@lo:400:kworker.0 00010000:00080000:3.0:1784044318.301037:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9b3947ee9180 x1870705581028480/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784044328 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1784044318.301056:0:3637:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1784044318.301066:0:3637:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1784044318.301073:0:3637:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1784044318.301077:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9b394740b000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1784044318.301085:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3947ee9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3637:1870705581028480:0@lo:38:kworker.0 00000100:00100000:0.0:1784044318.317222:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843ce4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3637:x1870705581028352:12345-0@lo:38:kworker.0 Request processed in 19402us (25397us total) trans 0 rc -19/-19 00000100:00100000:0.0:1784044318.317237:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:1.0:1784044318.324530:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9b3974dac800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1784044318.324543:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1784044318.324549:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3947eeb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1870705581028352:0@lo:38:kworker.0 00010000:00010000:1.0:1784044318.738932:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1784044319.140517:0:17536:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1784044319.140701:0:17536:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1784044319.183262:0:17242:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b394a323b40 going to sleep for 0 seconds 00010000:00010000:3.0:1784044319.762447:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1784044320.166759:0:17587:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1784044320.168469:0:17587:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1784044320.206784:0:17242:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b394a323b40 going to sleep for 0 seconds 00010000:00010000:1.0:1784044320.781407:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784044321.230310:0:17242:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b394a323b40 going to sleep for 0 seconds 00010000:00010000:3.0:1784044321.814048:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784044322.256549:0:17242:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b394a323b40 going to sleep for 0 seconds 00000100:00100000:1.0:1784044322.381333:0:3637:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1784044312/real 1784044312] req@ffff9b3947ee9f80 x1870705581025408/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1784044322 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784044322.381372:0:3637:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9b3947ee9f80 x1870705581025408/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1784044322 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784044322.381384:0:3637:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1784044312/real 1784044312] req@ffff9b3975b7e300 x1870705581025280/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1784044322 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784044322.381395:0:3637:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9b3975b7e300 x1870705581025280/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1784044322 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1784044322.381418:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9b397b804800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1784044322.381455:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1784044322.381460:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3947ee9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1870705581025408:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1784044322.381467:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9b396f25c000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1784044322.381473:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1784044322.381497:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3975b7e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1870705581025280:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1784044322.381635:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1784044322.381640:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1784044322.381643:0:37:0:(import.c:65:import_set_state_nolock()) ffff9b3974dac800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1784044322.381650:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 511 00000100:00080000:0.0:1784044322.381657:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1784044322.381666:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9b3974dac800 using connection 192.168.202.140@tcp/0@lo 00000100:00100000:0.0:1784044322.381694:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b3947ee8a80 x1870705581028736/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1784044322.381720:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1784044322.381723:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1784044322.381725:0:37:0:(import.c:65:import_set_state_nolock()) ffff9b396f25c000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1784044322.381735:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 506 00000100:00080000:0.0:1784044322.381738:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1784044322.381742:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9b396f25c000 using connection 192.168.202.140@tcp/0@lo 00000100:00100000:0.0:1784044322.381757:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b3947eebb80 x1870705581028864/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1784044322.381767:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1784044322.381781:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1784044322.381784:0:37:0:(import.c:65:import_set_state_nolock()) ffff9b397b804800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1784044322.381787:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 506 00000100:00080000:0.0:1784044322.381789:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1784044322.381795:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9b397b804800 using connection 192.168.202.140@tcp/0@lo 00000100:00100000:2.0:1784044322.381803:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3947ee8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1870705581028736:0@lo:38:kworker.0 00000100:00100000:0.0:1784044322.381813:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b3947ee8000 x1870705581028992/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1784044322.381875:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3947ee8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3641:1870705581029120:0@lo:400:kworker.0 00000100:00100000:2.0:1784044322.381938:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044322.381956:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3947eea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:99a46fb7-9af9-40f1-9c76-329d6781ee81:3640:1870705581028608:0@lo:400:kworker.0 00000100:00100000:3.0:1784044322.381959:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044322.382017:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581028736 00000100:00100000:0.0:1784044322.382028:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581028736 00000100:00100000:0.0:1784044322.382072:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1784044322.382081:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3975b7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3637:x1870705581028736:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1784044322.382104:0:17206:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1784044322.382221:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3947eebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1870705581028864:0@lo:8:kworker.0 00000100:00100000:3.0:1784044322.382810:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581029120 00000100:00100000:3.0:1784044322.382903:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581029120 00000100:00100000:3.0:1784044322.383045:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1784044322.383056:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843ce6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1870705581029120:12345-0@lo:400:kworker.0 00000400:00000100:2.0:1784044322.384511:0:3637:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1870705581028864 offset 0 length 520: 4 00000100:00100000:2.0:1784044322.384577:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3947ee8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1870705581028992:0@lo:8:kworker.0 00000400:00000100:2.0:1784044322.384607:0:3637:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1870705581028992 offset 0 length 520: 4 00000100:00100000:1.0:1784044322.391801:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044322.391917:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843ce6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1870705581029120:12345-0@lo:400:kworker.0 Request processed in 8848us (9945us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044322.391937:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1784044322.392433:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9b3947ee8380 x1870705581029120/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044338 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784044322.392452:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3947ee8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3641:1870705581029120:0@lo:400:kworker.0 00000100:00100000:2.0:1784044322.392558:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581028608 00000100:00100000:2.0:1784044322.392572:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581028608 00000100:00100000:2.0:1784044322.392686:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1784044322.392698:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397424f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99a46fb7-9af9-40f1-9c76-329d6781ee81+12:3640:x1870705581028608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784044322.392791:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397424f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99a46fb7-9af9-40f1-9c76-329d6781ee81+12:3640:x1870705581028608:12345-0@lo:400:kworker.0 Request processed in 95us (1012us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044322.392799:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1784044322.392947:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3947eea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:99a46fb7-9af9-40f1-9c76-329d6781ee81:3640:1870705581028608:0@lo:400:kworker.0 00000100:00100000:0.0:1784044322.403711:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3975b7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3637:x1870705581028736:12345-0@lo:38:kworker.0 Request processed in 21614us (21766us total) trans 0 rc -19/-19 00000100:00100000:0.0:1784044322.403731:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:1.0:1784044322.406142:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9b3974dac800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1784044322.406159:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1784044322.406165:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3947ee8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1870705581028736:0@lo:38:kworker.0 00010000:00010000:2.0:1784044322.830225:0:14277:0:(ldlm_pool.c:1332:ldlm_pools_recalc_task()) Negative interval(0) 00010000:00010000:1.0:1784044322.830678:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784044323.282443:0:17242:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b394a323b40 going to sleep for 0 seconds 00010000:00010000:3.0:1784044323.864254:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784044324.306390:0:17242:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b394a323b40 going to sleep for 0 seconds 00010000:00010000:1.0:1784044324.881020:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1784044325.270341:0:17236:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1784044325.328542:0:17242:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b394a323b40 going to sleep for 0 seconds 00010000:00010000:3.0:1784044325.903107:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784044326.350953:0:17242:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b394a323b40 going to sleep for 0 seconds 00010000:00010000:3.0:1784044326.928487:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784044327.374160:0:17242:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b394a323b40 going to sleep for 0 seconds 00000100:00080000:2.0:1784044327.505586:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1784044327.505597:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1784044327.505602:0:37:0:(import.c:65:import_set_state_nolock()) ffff9b3974dac800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784044327.505617:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 515 00000100:00080000:2.0:1784044327.505627:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1784044327.505637:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9b3974dac800 using connection 192.168.202.140@tcp/0@lo 00000100:00100000:2.0:1784044327.505671:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b3975b7e300 x1870705581029376/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1784044327.505696:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1784044327.505709:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1784044327.505713:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1784044327.505716:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1784044327.505767:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3975b7e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1870705581029376:0@lo:38:kworker.0 00000100:00100000:2.0:1784044327.505865:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044327.505986:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581029376 00000100:00100000:2.0:1784044327.505997:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581029376 00000100:00100000:2.0:1784044327.506058:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1784044327.506068:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3975b7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3637:x1870705581029376:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1784044327.506089:0:17205:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1784044327.507378:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3975b7ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3639:1870705581029504:0@lo:400:kworker.0 00000100:00100000:3.0:1784044327.507398:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3975b7df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:99a46fb7-9af9-40f1-9c76-329d6781ee81:3638:1870705581029248:0@lo:400:kworker.0 00000100:00100000:3.0:1784044327.507486:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044327.507486:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044327.507561:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581029248 00000100:00100000:3.0:1784044327.507568:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581029248 00000100:00100000:3.0:1784044327.507650:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1784044327.507661:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397424ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99a46fb7-9af9-40f1-9c76-329d6781ee81+12:3638:x1870705581029248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044327.507753:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397424ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99a46fb7-9af9-40f1-9c76-329d6781ee81+12:3638:x1870705581029248:12345-0@lo:400:kworker.0 Request processed in 92us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044327.507764:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1784044327.509498:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3975b7df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:99a46fb7-9af9-40f1-9c76-329d6781ee81:3638:1870705581029248:0@lo:400:kworker.0 00000100:00100000:3.0:1784044327.511691:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581029504 00000100:00100000:3.0:1784044327.511709:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581029504 00000100:00100000:3.0:1784044327.511839:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1784044327.511860:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843734000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1870705581029504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044327.512778:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843734000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1870705581029504:12345-0@lo:400:kworker.0 Request processed in 917us (5285us total) trans 0 rc 0/0 00010000:00080000:1.0:1784044327.512792:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9b3975b7ed80 x1870705581029504/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044343 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784044327.512796:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1784044327.512817:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3975b7ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3639:1870705581029504:0@lo:400:kworker.0 00000100:00100000:3.0:1784044327.553556:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3975b7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3637:x1870705581029376:12345-0@lo:38:kworker.0 Request processed in 47472us (47675us total) trans 0 rc -19/-19 00000100:00100000:3.0:1784044327.553584:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:2.0:1784044327.554824:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9b3974dac800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1784044327.554841:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1784044327.554847:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3975b7e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1870705581029376:0@lo:38:kworker.0 00010000:00010000:0.0:1784044327.951743:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784044328.399701:0:17242:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b394a323b40 going to sleep for 0 seconds 00000020:01000004:1.0:1784044328.415348:0:17932:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1784044328.415356:0:17932:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:1.0:1784044328.415357:0:17932:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:1.0:1784044328.415509:0:17932:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9b396f25a800 00000020:01000004:1.0:1784044328.415531:0:17932:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200001, mountfl=0 00000020:01000004:1.0:1784044328.415548:0:17932:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1784044328.415567:0:17932:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (ffff9b384304cd40) 00000020:00000080:1.0:1784044328.415589:0:17932:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1784044328.490612:0:17932:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xd:0x0] (16/1) registered 00100000:10000000:0.0:1784044328.493650:0:17932:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:0.0:1784044328.494265:0:17932:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:0.0:1784044328.494476:0:17932:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:0.0:1784044328.494844:0:17932:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:0.0:1784044328.495317:0:17932:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:0.0:1784044328.498514:0:17932:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00100000:10000000:0.0:1784044328.498886:0:17932:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:0.0:1784044328.499434:0:17932:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:0.0:1784044328.499681:0:17932:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:0.0:1784044328.499911:0:17932:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:0.0:1784044328.500390:0:17932:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:0.0:1784044328.500604:0:17932:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00100000:10000000:0.0:1784044328.500804:0:17932:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:0.0:1784044328.506931:0:17932:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:0.0:1784044328.510127:0:17932:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x20:0x0] (24/16) registered 00100000:10000000:0.0:1784044328.510718:0:17932:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x11:0x0] (16/1) registered 00100000:10000000:0.0:1784044328.510958:0:17932:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:1.0:1784044328.515418:0:17932:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:1.0:1784044328.515911:0:17932:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:1.0:1784044328.516448:0:17932:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:1.0:1784044328.517908:0:17932:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xe:0x0] (16/1) registered 00100000:10000000:1.0:1784044328.521715:0:17932:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:1.0:1784044328.522282:0:17932:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x21:0x0] (24/16) registered 00100000:10000000:1.0:1784044328.522592:0:17932:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1f:0x0] (24/16) registered 00100000:10000000:1.0:1784044328.522832:0:17932:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:1.0:1784044328.523214:0:17932:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:1.0:1784044328.523450:0:17932:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:1.0:1784044328.523734:0:17932:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:1.0:1784044328.524305:0:17932:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:1.0:1784044328.524798:0:17932:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x23:0x0] (24/16) registered 00100000:10000000:1.0:1784044328.525104:0:17932:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:1.0:1784044328.525587:0:17932:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:1.0:1784044328.525833:0:17932:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:1.0:1784044328.526214:0:17932:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x10:0x0] (16/1) registered 00100000:10000000:1.0:1784044328.527374:0:17932:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:1.0:1784044328.529823:0:17932:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:1.0:1784044328.530515:0:17932:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:1.0:1784044328.530991:0:17932:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:1.0:1784044328.533467:0:17932:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xf:0x0] (16/1) registered 00100000:10000000:1.0:1784044328.533928:0:17932:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x24:0x0] (24/16) registered 00100000:10000000:1.0:1784044328.534402:0:17932:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:1.0:1784044328.534672:0:17932:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:1.0:1784044328.535161:0:17932:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x12:0x0] (16/1) registered 00100000:10000000:1.0:1784044328.535509:0:17932:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x22:0x0] (24/16) registered 00100000:10000000:1.0:1784044328.536312:0:17932:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x19:0x0] (16/1) registered 00080000:01000000:2.0:1784044328.541665:0:17932:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1784044328.541939:0:17932:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:2.0:1784044328.541966:0:17932:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:2.0:1784044328.541981:0:17932:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x89871fc3aba191a6 00000020:01000004:2.0:1784044328.541990:0:17932:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:2.0:1784044328.542024:0:17932:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.140@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1784044328.542028:0:17932:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.140@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1784044328.542043:0:17932:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:2.0:1784044328.542073:0:17932:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:2.0:1784044328.542077:0:17932:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.140@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:3.0:1784044328.552423:0:17932:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.140@tcp ctxt 0 is initialized 00000020:01000004:3.0:1784044328.552472:0:17932:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.202.140@tcp, index=0001, flags=0x20001 00000020:01000004:3.0:1784044328.552477:0:17932:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1784044328.552479:0:17932:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1784044328.552480:0:17932:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1784044328.552481:0:17932:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1784044328.552483:0:17932:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1784044328.552484:0:17932:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1784044328.552486:0:17932:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1784044328.552488:0:17932:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1784044328.552489:0:17932:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1784044328.552493:0:17932:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020001 00000020:01000004:3.0:1784044328.552495:0:17932:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1784044328.552497:0:17932:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1784044328.552498:0:17932:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1784044328.552499:0:17932:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1784044328.552500:0:17932:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1784044328.552502:0:17932:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1784044328.552503:0:17932:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1784044328.552504:0:17932:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1784044328.552505:0:17932:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1784044328.552535:0:17932:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:3.0:1784044328.552558:0:17932:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843ce6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99a46fb7-9af9-40f1-9c76-329d6781ee81:17932:1870705581029632:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1784044328.552632:0:17932:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044328.552762:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581029632 00000100:00100000:1.0:1784044328.552774:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581029632 00000100:00100000:1.0:1784044328.552820:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1784044328.552827:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38437a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99a46fb7-9af9-40f1-9c76-329d6781ee81+12:17932:x1870705581029632:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1784044328.552856:0:17192:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1784044328.552859:0:17192:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0001 is running on 0@lo 20000000:01000000:1.0:1784044328.552866:0:17192:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:3.0:1784044328.553118:0:17932:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b395829f180 going to sleep for 11 seconds 00000100:00100000:1.0:1784044328.555376:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38437a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99a46fb7-9af9-40f1-9c76-329d6781ee81+12:17932:x1870705581029632:12345-0@lo:253:mount.lustre.0 Request processed in 2540us (2736us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044328.555391:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1784044328.555550:0:17932:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843ce6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99a46fb7-9af9-40f1-9c76-329d6781ee81:17932:1870705581029632:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1784044328.555564:0:17932:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:3.0:1784044328.555567:0:17932:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1784044328.555569:0:17932:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1784044328.555570:0:17932:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1784044328.555571:0:17932:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1784044328.555573:0:17932:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1784044328.555574:0:17932:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1784044328.555575:0:17932:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1784044328.555577:0:17932:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1784044328.555578:0:17932:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1784044328.555597:0:17932:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9b396f25a800 from lustre-MDT0001 10000000:01000000:3.0:1784044328.555626:0:17932:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:3.0:1784044328.555629:0:17932:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:3.0:1784044328.555635:0:17932:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9b3842450000 local copy 00010000:00010000:3.0:1784044328.555646:0:17932:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b38410b7000/0x89871fc3aba1909c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba190a3 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044328.555775:0:17932:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843ce6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99a46fb7-9af9-40f1-9c76-329d6781ee81:17932:1870705581029760:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1784044328.555809:0:17932:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044328.555974:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581029760 00000100:00100000:1.0:1784044328.555981:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581029760 00000100:00100000:1.0:1784044328.556038:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1784044328.556047:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38437a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99a46fb7-9af9-40f1-9c76-329d6781ee81+12:17932:x1870705581029760:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1784044328.556128:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38437a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99a46fb7-9af9-40f1-9c76-329d6781ee81+12:17932:x1870705581029760:12345-0@lo:501:mount.lustre.0 Request processed in 82us (318us total) trans 0 rc -2/-2 00000100:00100000:1.0:1784044328.556135:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1784044328.562560:0:17932:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b395829f9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784044328.562621:0:17932:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843ce6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99a46fb7-9af9-40f1-9c76-329d6781ee81:17932:1870705581029760:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1784044328.562652:0:17932:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.140@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1784044328.562706:0:17932:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.140@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1784044328.562716:0:17932:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b38410b7000/0x89871fc3aba1909c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba190a3 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044328.562727:0:17932:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9b38410b7000/0x89871fc3aba1909c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba190a3 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784044328.562783:0:17932:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9b396f25a800 10000000:01000000:3.0:1784044328.562790:0:17932:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1784044328.562796:0:17932:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9b3842450000 10000000:01000000:3.0:1784044328.562798:0:17932:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:3.0:1784044328.562802:0:17932:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff9b3842450000 from 1 10000000:01000000:3.0:1784044328.562805:0:17932:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1784044328.562847:0:17932:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b394166aa00/0x89871fc3aba191ad lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044328.562855:0:17932:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9b394166aa00/0x89871fc3aba191ad lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044328.562866:0:17932:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9b394166aa00/0x89871fc3aba191ad lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044328.562887:0:17932:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843ce6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99a46fb7-9af9-40f1-9c76-329d6781ee81:17932:1870705581029888:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1784044328.562954:0:17932:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044328.562985:0:17932:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b395829f9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784044328.563107:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581029888 00000100:00100000:1.0:1784044328.563114:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581029888 00000100:00100000:1.0:1784044328.563199:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1784044328.563211:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38437a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99a46fb7-9af9-40f1-9c76-329d6781ee81+12:17932:x1870705581029888:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1784044328.563225:0:17194:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784044328.563239:0:17194:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b38426fc600/0x89871fc3aba191b4 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x89871fc3aba191ad expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044328.563272:0:17194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b38426fc600/0x89871fc3aba191b4 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x89871fc3aba191ad expref: 13 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044328.563284:0:17194:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b38426fc600/0x89871fc3aba191b4 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x89871fc3aba191ad expref: 13 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044328.563299:0:17194:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b38426fc600, rc 0) 00000100:00100000:1.0:1784044328.563347:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38437a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99a46fb7-9af9-40f1-9c76-329d6781ee81+13:17932:x1870705581029888:12345-0@lo:101:mount.lustre.0 Request processed in 138us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044328.563354:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1784044328.563671:0:17932:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843ce6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99a46fb7-9af9-40f1-9c76-329d6781ee81:17932:1870705581029888:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1784044328.563685:0:17932:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9b394166aa00/0x89871fc3aba191ad lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba191b4 expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044328.563694:0:17932:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9b394166aa00/0x89871fc3aba191ad lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x89871fc3aba191b4 expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784044328.563710:0:17932:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1784044328.563776:0:17932:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b394166aa00/0x89871fc3aba191ad lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba191b4 expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044328.563796:0:17932:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9b394166aa00/0x89871fc3aba191ad lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba191b4 expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784044328.563804:0:17932:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9b396f25a800 10000000:01000000:3.0:1784044328.563808:0:17932:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1784044328.563811:0:17932:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff9b396f25a800 from 1 10000000:01000000:3.0:1784044328.563813:0:17932:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1784044328.563829:0:17932:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b394166b800/0x89871fc3aba191bb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044328.563836:0:17932:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9b394166b800/0x89871fc3aba191bb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044328.563843:0:17932:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9b394166b800/0x89871fc3aba191bb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044328.563856:0:17932:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843ce6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99a46fb7-9af9-40f1-9c76-329d6781ee81:17932:1870705581030016:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1784044328.563884:0:17932:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044328.563948:0:17932:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b395829f9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784044328.567215:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581030016 00000100:00100000:2.0:1784044328.567265:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581030016 00000100:00100000:2.0:1784044328.567487:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1784044328.569666:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38437a5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99a46fb7-9af9-40f1-9c76-329d6781ee81+13:17932:x1870705581030016:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1784044328.569694:0:17193:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784044328.569717:0:17193:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b3843799a00/0x89871fc3aba191c2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x89871fc3aba191bb expref: -99 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044328.569755:0:17193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b3843799a00/0x89871fc3aba191c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x89871fc3aba191bb expref: 14 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044328.569768:0:17193:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b3843799a00/0x89871fc3aba191c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x89871fc3aba191bb expref: 14 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044328.569778:0:17193:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3843799a00, rc 0) 00000100:00100000:2.0:1784044328.569895:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38437a5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99a46fb7-9af9-40f1-9c76-329d6781ee81+14:17932:x1870705581030016:12345-0@lo:101:mount.lustre.0 Request processed in 260us (6009us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044328.569903:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1784044328.570038:0:17932:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843ce6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99a46fb7-9af9-40f1-9c76-329d6781ee81:17932:1870705581030016:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1784044328.570061:0:17932:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9b394166b800/0x89871fc3aba191bb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba191c2 expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044328.570070:0:17932:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9b394166b800/0x89871fc3aba191bb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x89871fc3aba191c2 expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784044328.570088:0:17932:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1784044328.570450:0:17932:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b394166b800/0x89871fc3aba191bb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba191c2 expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044328.570475:0:17932:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9b394166b800/0x89871fc3aba191bb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba191c2 expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784044328.570483:0:17932:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:3.0:1784044328.570489:0:17932:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1784044328.570496:0:17932:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9b396f25a800 10000000:01000000:3.0:1784044328.570499:0:17932:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1784044328.570504:0:17932:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:3.0:1784044328.570507:0:17932:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1784044328.570540:0:17932:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b394166ae00/0x89871fc3aba191c9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044328.570548:0:17932:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9b394166ae00/0x89871fc3aba191c9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044328.570556:0:17932:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9b394166ae00/0x89871fc3aba191c9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044328.570578:0:17932:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843ce6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99a46fb7-9af9-40f1-9c76-329d6781ee81:17932:1870705581030144:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1784044328.570618:0:17932:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044328.570649:0:17932:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b395829f9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784044328.570703:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581030144 00000100:00100000:0.0:1784044328.570710:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581030144 00000100:00100000:0.0:1784044328.570761:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1784044328.570769:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38437a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99a46fb7-9af9-40f1-9c76-329d6781ee81+14:17932:x1870705581030144:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1784044328.570778:0:17192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784044328.570791:0:17192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b38410b6600/0x89871fc3aba191d0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x89871fc3aba191c9 expref: -99 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044328.570808:0:17192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b38410b6600/0x89871fc3aba191d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x89871fc3aba191c9 expref: 15 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044328.570817:0:17192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b38410b6600/0x89871fc3aba191d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x89871fc3aba191c9 expref: 15 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044328.570834:0:17192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b38410b6600, rc 0) 00000100:00100000:0.0:1784044328.570869:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38437a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99a46fb7-9af9-40f1-9c76-329d6781ee81+15:17932:x1870705581030144:12345-0@lo:101:mount.lustre.0 Request processed in 101us (251us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044328.570876:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1784044328.571022:0:17932:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843ce6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99a46fb7-9af9-40f1-9c76-329d6781ee81:17932:1870705581030144:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1784044328.571035:0:17932:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9b394166ae00/0x89871fc3aba191c9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba191d0 expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044328.571043:0:17932:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9b394166ae00/0x89871fc3aba191c9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x89871fc3aba191d0 expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1784044328.572733:0:17932:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000040:00080000:3.0:1784044328.573610:0:17932:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1784044328.584654:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:3.0:1784044328.584714:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:3.0:1784044328.584729:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:3.0:1784044328.584743:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:3.0:1784044328.584757:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 00000040:00080000:3.0:1784044328.584772:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 00000040:00080000:3.0:1784044328.584785:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 00000040:00080000:3.0:1784044328.584799:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:3.0:1784044328.584813:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:3.0:1784044328.584827:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 00000040:00080000:3.0:1784044328.584840:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 00000040:00080000:3.0:1784044328.584854:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 00000040:00080000:3.0:1784044328.584869:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 00000040:00080000:3.0:1784044328.584882:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:3.0:1784044328.584896:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:3.0:1784044328.584911:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 00000040:00080000:3.0:1784044328.584945:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:3.0:1784044328.584961:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:3.0:1784044328.584974:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 00000040:00080000:3.0:1784044328.584987:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:3.0:1784044328.585387:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:3.0:1784044328.585406:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:3.0:1784044328.585418:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:3.0:1784044328.585450:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 00000040:00080000:3.0:1784044328.585457:0:17932:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 24 count 25 00000100:00100000:3.0:1784044328.585624:0:17932:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843ce6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99a46fb7-9af9-40f1-9c76-329d6781ee81:17932:1870705581030272:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1784044328.585691:0:17932:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044328.585793:0:17932:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3942ab0c00 going to sleep for 11 seconds 00000100:00100000:0.0:1784044328.588204:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581030272 00000100:00100000:0.0:1784044328.588225:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581030272 00000100:00100000:0.0:1784044328.588379:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1784044328.588392:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38437a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99a46fb7-9af9-40f1-9c76-329d6781ee81+15:17932:x1870705581030272:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1784044328.588633:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38437a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99a46fb7-9af9-40f1-9c76-329d6781ee81+15:17932:x1870705581030272:12345-0@lo:501:mount.lustre.0 Request processed in 242us (2940us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044328.588641:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1784044328.588749:0:17932:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843ce6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99a46fb7-9af9-40f1-9c76-329d6781ee81:17932:1870705581030272:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1784044328.588802:0:17932:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843ce6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99a46fb7-9af9-40f1-9c76-329d6781ee81:17932:1870705581030400:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1784044328.588861:0:17932:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044328.592114:0:17932:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3942ab0c00 going to sleep for 11 seconds 00000100:00100000:2.0:1784044328.592354:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581030400 00000100:00100000:2.0:1784044328.592365:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581030400 00000100:00100000:2.0:1784044328.592418:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1784044328.592427:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38437a6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99a46fb7-9af9-40f1-9c76-329d6781ee81+15:17932:x1870705581030400:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1784044328.595230:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38437a6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99a46fb7-9af9-40f1-9c76-329d6781ee81+15:17932:x1870705581030400:12345-0@lo:503:mount.lustre.0 Request processed in 2796us (6362us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044328.595246:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1784044328.595421:0:17932:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843ce6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99a46fb7-9af9-40f1-9c76-329d6781ee81:17932:1870705581030400:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1784044328.595912:0:17932:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1784044328.596427:0:17932:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843ce6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99a46fb7-9af9-40f1-9c76-329d6781ee81:17932:1870705581030528:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1784044328.596512:0:17932:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044328.596549:0:17932:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3942ab0c00 going to sleep for 11 seconds 00000100:00100000:0.0:1784044328.597280:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581030528 00000100:00100000:0.0:1784044328.597290:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581030528 00000100:00100000:0.0:1784044328.597348:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1784044328.597358:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38437a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99a46fb7-9af9-40f1-9c76-329d6781ee81+15:17932:x1870705581030528:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1784044328.598303:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38437a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99a46fb7-9af9-40f1-9c76-329d6781ee81+15:17932:x1870705581030528:12345-0@lo:502:mount.lustre.0 Request processed in 941us (1786us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044328.598314:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1784044328.598731:0:17932:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843ce6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99a46fb7-9af9-40f1-9c76-329d6781ee81:17932:1870705581030528:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1784044328.599528:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1784044328.599572:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 136 off8552 00000040:00080000:3.0:1784044328.599588:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 176 off8728 00000040:00080000:3.0:1784044328.599599:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8952 00000040:00080000:3.0:1784044328.599611:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9176 00000040:00080000:3.0:1784044328.599624:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9296 00000040:00080000:3.0:1784044328.599656:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 112 off9408 00000040:00080000:3.0:1784044328.599670:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 160 off9568 00000040:00080000:3.0:1784044328.599682:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9792 00000040:00080000:3.0:1784044328.599695:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off10016 00000040:00080000:3.0:1784044328.599708:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 88 off10104 00000040:00080000:3.0:1784044328.599720:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 144 off10248 00000040:00080000:3.0:1784044328.599731:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 152 off10400 00000040:00080000:3.0:1784044328.599742:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 168 off10568 00000040:00080000:3.0:1784044328.599754:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 224 off10792 00000040:00080000:3.0:1784044328.599766:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 224 off11016 00000040:00080000:3.0:1784044328.599778:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 80 off11096 00000040:00080000:3.0:1784044328.599791:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11320 00000040:00080000:3.0:1784044328.599815:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 224 off11544 00000040:00080000:3.0:1784044328.599827:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 160 off11704 00000040:00080000:3.0:1784044328.599839:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11928 00000040:00080000:3.0:1784044328.599852:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 224 off12152 00000040:00080000:3.0:1784044328.599879:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 80 off12232 00000040:00080000:3.0:1784044328.599893:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 224 off12456 00000040:00080000:3.0:1784044328.599905:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 224 off12680 00000040:00080000:3.0:1784044328.599918:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 88 off12768 00000040:00080000:3.0:1784044328.599932:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 144 off12912 00000040:00080000:3.0:1784044328.600373:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 152 off13064 00000040:00080000:3.0:1784044328.600387:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 136 off13200 00000040:00080000:3.0:1784044328.600401:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13424 00000040:00080000:3.0:1784044328.600416:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 224 off13648 00000040:00080000:3.0:1784044328.600430:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 80 off13728 00000040:00080000:3.0:1784044328.600445:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 224 off13952 00000040:00080000:3.0:1784044328.600459:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 224 off14176 00000040:00080000:3.0:1784044328.600472:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 88 off14264 00000040:00080000:3.0:1784044328.600485:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 144 off14408 00000040:00080000:3.0:1784044328.600555:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 152 off14560 00000040:00080000:3.0:1784044328.600573:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 136 off14696 00000040:00080000:3.0:1784044328.600602:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14920 00000040:00080000:3.0:1784044328.600618:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 224 off15144 00000040:00080000:3.0:1784044328.600629:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 80 off15224 00000040:00080000:3.0:1784044328.600640:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 224 off15448 00000040:00080000:3.0:1784044328.600655:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 224 off15672 00000040:00080000:3.0:1784044328.600668:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 120 off15792 00000100:00100000:3.0:1784044328.600721:0:17932:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843ce6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99a46fb7-9af9-40f1-9c76-329d6781ee81:17932:1870705581030656:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1784044328.600804:0:17932:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044328.600909:0:17932:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3942ab0c00 going to sleep for 11 seconds 00000100:00100000:0.0:1784044328.601078:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581030656 00000100:00100000:0.0:1784044328.601088:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581030656 00000100:00100000:0.0:1784044328.601353:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1784044328.601364:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38437a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99a46fb7-9af9-40f1-9c76-329d6781ee81+15:17932:x1870705581030656:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1784044328.601775:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38437a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99a46fb7-9af9-40f1-9c76-329d6781ee81+15:17932:x1870705581030656:12345-0@lo:502:mount.lustre.0 Request processed in 411us (969us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044328.601784:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1784044328.601905:0:17932:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843ce6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99a46fb7-9af9-40f1-9c76-329d6781ee81:17932:1870705581030656:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1784044328.601992:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off16016 00000040:00080000:1.0:1784044328.602401:0:17932:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 45 count 46 00000020:01000000:1.0:1784044328.603758:0:17936:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1784044328.603777:0:17936:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784044328.603779:0:17936:0:(obd_config.c:1561:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:1.0:1784044328.603787:0:17936:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:1.0:1784044328.603790:0:17936:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1784044328.603810:0:17936:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (ffff9b3843048000) 00000020:00000080:1.0:1784044328.603844:0:17936:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type lod with refcount 2 00000020:00000080:1.0:1784044328.603851:0:17936:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1784044328.603960:0:17936:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:1.0:1784044328.603972:0:17936:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x89871fc3aba191de 00000020:00000080:1.0:1784044328.604378:0:17936:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:1.0:1784044328.604382:0:17936:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784044328.604386:0:17936:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784044328.604387:0:17936:0:(obd_config.c:1561:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:1.0:1784044328.604390:0:17936:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1784044328.604393:0:17936:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784044328.604394:0:17936:0:(obd_config.c:1561:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:1.0:1784044328.604397:0:17936:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1784044328.604405:0:17936:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (ffff9b3974da19c0) 00000020:00000080:1.0:1784044328.604417:0:17936:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdt with refcount 2 00000020:00000080:1.0:1784044328.604421:0:17936:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1784044328.604423:0:17936:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:1.0:1784044328.604431:0:17936:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:1.0:1784044328.604438:0:17936:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1784044328.604486:0:17936:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9b396f25a800 from lustre-MDT0001, refs=2 00000020:00000080:1.0:1784044328.604501:0:17936:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (ffff9b3974da3380) 00000020:00000080:1.0:1784044328.604510:0:17936:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type mdd with refcount 2 00000004:01000000:1.0:1784044328.604576:0:17936:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1784044328.604582:0:17936:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x89871fc3aba191f3 00000020:00000080:1.0:1784044328.604678:0:17936:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:1.0:1784044328.604686:0:17936:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1784044328.604690:0:17936:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0x89871fc3aba191fa 00080000:01000000:1.0:1784044328.604695:0:17936:0:(osd_handler.c:8929:osd_obd_connect()) connect #2 00000020:00000080:1.0:1784044328.604698:0:17936:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x89871fc3aba19201 00010000:00010000:2.0:1784044328.682479:0:17936:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:00000004:2.0:1784044328.686625:0:17936:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 4294967301 00000001:00080000:3.0:1784044328.687937:0:17936:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1784044328.692682:0:17936:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:2.0:1784044328.692702:0:17936:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784044328.692725:0:17936:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784044328.692728:0:17936:0:(obd_config.c:1561:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:2.0:1784044328.692734:0:17936:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784044328.692795:0:17936:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784044328.692804:0:17936:0:(obd_config.c:1561:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:3.0:1784044328.692812:0:17936:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1784044328.692817:0:17936:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.202.140@tcp to nid 0x20000c0a8ca8c (192.168.202.140@tcp) 00000020:00000080:3.0:1784044328.692844:0:17936:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1784044328.692861:0:17936:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffff9b39742519c0) 00000020:00000080:3.0:1784044328.692885:0:17936:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osp with refcount 2 00000020:00000080:3.0:1784044328.692891:0:17936:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1784044328.692994:0:17936:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:3.0:1784044328.693002:0:17936:0:(osd_handler.c:8929:osd_obd_connect()) connect #3 00000020:00000080:3.0:1784044328.693009:0:17936:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x89871fc3aba1920f 00010000:00080000:3.0:1784044328.693047:0:17936:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9b3970ff5000@lustre-MDT0000-osp-MDT0001: add connection 192.168.202.140@tcp at head 00010000:00010000:3.0:1784044328.703478:0:17936:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-5 is initialized 00000020:00000080:3.0:1784044328.714389:0:17936:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1784044328.714406:0:17936:0:(obd_config.c:1470:class_process_config()) processing cmd: cf014 00000004:01000000:3.0:1784044328.714453:0:17936:0:(lod_lov.c:129:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:3.0:1784044328.714479:0:17936:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x89871fc3aba19216 00000100:00080000:3.0:1784044328.714492:0:17936:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1784044328.714499:0:17936:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9b3970ff5000 using connection 192.168.202.140@tcp/0@lo 00000100:00100000:3.0:1784044328.714555:0:17936:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b3843ce7100 x1870705581030784/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1784044328.714586:0:17936:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000020:01000000:3.0:1784044328.714669:0:17936:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784044328.714673:0:17936:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784044328.714675:0:17936:0:(obd_config.c:1561:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:3.0:1784044328.714678:0:17936:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1784044328.714681:0:17936:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #14 00000020:01000000:3.0:1784044328.714683:0:17936:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1784044328.714684:0:17936:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1784044328.714685:0:17936:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1784044328.714688:0:17936:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784044328.714689:0:17936:0:(obd_config.c:1561:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:3.0:1784044328.714697:0:17936:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784044328.714703:0:17936:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784044328.714704:0:17936:0:(obd_config.c:1561:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:3.0:1784044328.714708:0:17936:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1784044328.714744:0:17936:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1784044328.714758:0:17936:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784044328.714762:0:17936:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784044328.714763:0:17936:0:(obd_config.c:1561:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:3.0:1784044328.714766:0:17936:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1784044328.714768:0:17936:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #19 00000020:01000000:3.0:1784044328.714769:0:17936:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1784044328.714771:0:17936:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1784044328.714772:0:17936:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1784044328.714775:0:17936:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784044328.714776:0:17936:0:(obd_config.c:1561:class_process_config()) marker 19 (0x6) lustre sys.timeout 00000020:01000000:3.0:1784044328.714778:0:17936:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1784044328.714782:0:17936:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:3.0:1784044328.714786:0:17936:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784044328.714787:0:17936:0:(obd_config.c:1561:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1784044328.714791:0:17936:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1784044328.714795:0:17936:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.202.140@tcp to nid 0x20000c0a8ca8c (192.168.202.140@tcp) 00000020:01000000:3.0:1784044328.714824:0:17936:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:3.0:1784044328.714827:0:17936:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1784044328.714842:0:17936:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff9b3974254d40) 00000020:00000080:3.0:1784044328.714856:0:17936:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:3.0:1784044328.714861:0:17936:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1784044328.714928:0:17936:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:3.0:1784044328.714935:0:17936:0:(osd_handler.c:8929:osd_obd_connect()) connect #4 00000020:00000080:3.0:1784044328.714942:0:17936:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x89871fc3aba19224 00010000:00080000:3.0:1784044328.714978:0:17936:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9b3970ff4800@lustre-OST0000-osc-MDT0001: add connection 192.168.202.140@tcp at head 00010000:00010000:3.0:1784044328.715230:0:17936:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-6 is initialized 00000100:00080000:1.0:1784044328.715916:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1784044328.715923:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1784044328.715926:0:37:0:(import.c:65:import_set_state_nolock()) ffff9b3974dac800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784044328.715933:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 520 00000100:00080000:1.0:1784044328.715938:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1784044328.715944:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9b3974dac800 using connection 192.168.202.140@tcp/0@lo 00000100:00100000:1.0:1784044328.715975:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b3843735500 x1870705581030912/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1784044328.715989:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1784044328.715992:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1784044328.715996:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1784044328.716000:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1784044328.716048:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1784044328.716063:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843735880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3641:1870705581031040:0@lo:400:kworker.0 00000100:00100000:1.0:1784044328.716130:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044328.716230:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581031040 00000100:00100000:1.0:1784044328.716238:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581031040 00000100:00100000:1.0:1784044328.716296:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1784044328.716304:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843736300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1870705581031040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044328.716356:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843736300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1870705581031040:12345-0@lo:400:kworker.0 Request processed in 51us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044328.716363:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1784044328.716402:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9b3843735880 x1870705581031040/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044344 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784044328.716415:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843735880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3641:1870705581031040:0@lo:400:kworker.0 00000100:00100000:2.0:1784044328.716940:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843ce7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1870705581030784:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1784044328.716981:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044328.717013:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843735500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1870705581030912:0@lo:38:kworker.0 00000100:00100000:2.0:1784044328.717035:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044328.717095:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581030784 00000100:00100000:0.0:1784044328.717099:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581030784 00000100:00100000:0.0:1784044328.717116:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581030912 00000100:00100000:0.0:1784044328.717118:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581030912 00000100:00100000:0.0:1784044328.717129:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1784044328.717135:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3975b7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3637:x1870705581030784:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1784044328.717156:0:17205:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 521 last 0 00000020:00000080:0.0:1784044328.717206:0:17205:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x89871fc3aba1922b 00000004:00100000:0.0:1784044328.717219:0:17205:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:0.0:1784044328.717224:0:17205:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000040:01000000:1.0:1784044328.717822:0:17936:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1784044328.718294:0:17936:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:3.0:1784044328.723513:0:17936:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1784044328.727134:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000100:00080000:3.0:1784044328.730236:0:17205:0:(import.c:65:import_set_state_nolock()) ffff9b3970ff2000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1784044328.730352:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3975b7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3637:x1870705581030784:12345-0@lo:38:llog_process_th.0 Request processed in 13214us (13368us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044328.730365:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1784044328.730399:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1784044328.730405:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3975b7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3637:x1870705581030912:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1784044328.730448:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3975b7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3637:x1870705581030912:12345-0@lo:38:kworker.0 Request processed in 42us (13411us total) trans 0 rc -11/-11 00000100:00100000:3.0:1784044328.730454:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1784044328.730658:0:3637:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1784044328.730668:0:3637:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 2 00000100:00080000:2.0:1784044328.730677:0:3637:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:2.0:1784044328.730682:0:3637:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1784044328.730685:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9b3970ff5000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1784044328.730698:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843ce7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1870705581030784:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1784044328.730710:0:3637:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1784044328.730713:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9b3974dac800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1784044328.730716:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1784044328.730719:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843735500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1870705581030912:0@lo:38:kworker.0 00000100:00100000:2.0:1784044328.730883:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843735880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1870705581031168:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1784044328.730922:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044328.731010:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581031168 00000100:00100000:1.0:1784044328.731017:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581031168 00000100:00100000:1.0:1784044328.731061:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1784044328.731070:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3975b7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3641:x1870705581031168:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1784044328.731098:0:17206:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1784044328.731141:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3975b7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3641:x1870705581031168:12345-0@lo:41:osp-pre-0-1.0 Request processed in 72us (218us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044328.731147:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1784044328.731206:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843735880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1870705581031168:0@lo:41:osp-pre-0-1.0 00000040:00080000:0.0:1784044328.735154:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 64 off8256 00000040:00080000:2.0:1784044328.738271:0:17941:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1784044328.738281:0:17941:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1784044328.749327:0:17936:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1784044328.749344:0:17936:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1784044328.749392:0:17936:0:(lod_lov.c:129:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1784044328.749413:0:17936:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x89871fc3aba19232 00000100:00080000:2.0:1784044328.749424:0:17936:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1784044328.749446:0:17936:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9b3970ff4800 using connection 192.168.202.140@tcp/0@lo 00000100:00100000:2.0:1784044328.749486:0:17936:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b3975b7c000 x1870705581031296/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1784044328.749517:0:17936:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:3.0:1784044328.749741:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3975b7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1870705581031296:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1784044328.749821:0:3637:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1870705581031296 offset 0 length 520: 4 00000100:00080000:3.0:1784044328.750012:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1784044328.750017:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1784044328.750020:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1784044328.750023:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000020:01000000:2.0:1784044328.750145:0:17936:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784044328.750150:0:17936:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784044328.750152:0:17936:0:(obd_config.c:1561:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1784044328.750156:0:17936:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1784044328.750159:0:17936:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #27 00000020:01000000:2.0:1784044328.750160:0:17936:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1784044328.750162:0:17936:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1784044328.750164:0:17936:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1784044328.750166:0:17936:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784044328.750167:0:17936:0:(obd_config.c:1561:class_process_config()) marker 27 (0x6) lustre sys.timeout 00000020:01000000:2.0:1784044328.750170:0:17936:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1784044328.750204:0:17936:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:2.0:1784044328.750209:0:17936:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784044328.750211:0:17936:0:(obd_config.c:1561:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1784044328.750214:0:17936:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1784044328.750218:0:17936:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.202.140@tcp to nid 0x20000c0a8ca8c (192.168.202.140@tcp) 00000020:01000000:2.0:1784044328.750241:0:17936:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:2.0:1784044328.750245:0:17936:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1784044328.750268:0:17936:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff9b3842454d40) 00000020:00000080:2.0:1784044328.750286:0:17936:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type osp with refcount 2 00000020:00000080:2.0:1784044328.750292:0:17936:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1784044328.750374:0:17936:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:2.0:1784044328.750383:0:17936:0:(osd_handler.c:8929:osd_obd_connect()) connect #5 00000020:00000080:2.0:1784044328.750389:0:17936:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x89871fc3aba19240 00010000:00080000:2.0:1784044328.750423:0:17936:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9b3944fd3800@lustre-OST0001-osc-MDT0001: add connection 192.168.202.140@tcp at head 00010000:00010000:2.0:1784044328.750698:0:17936:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-7 is initialized 00000040:01000000:2.0:1784044328.750772:0:17936:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1784044328.750797:0:17936:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:3.0:1784044328.755703:0:17936:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1784044328.756115:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:3.0:1784044328.756438:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:1.0:1784044328.766911:0:17943:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1784044328.766921:0:17943:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1784044328.773337:0:17936:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1784044328.773354:0:17936:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1784044328.773400:0:17936:0:(lod_lov.c:129:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1784044328.773419:0:17936:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x89871fc3aba19247 00000100:00080000:2.0:1784044328.773429:0:17936:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1784044328.773434:0:17936:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9b3944fd3800 using connection 192.168.202.140@tcp/0@lo 00000100:00100000:2.0:1784044328.773474:0:17936:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b3975b7d880 x1870705581031424/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1784044328.773504:0:17936:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1784044328.773615:0:17936:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784044328.773619:0:17936:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784044328.773621:0:17936:0:(obd_config.c:1561:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1784044328.773624:0:17936:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784044328.773628:0:17936:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784044328.773630:0:17936:0:(obd_config.c:1561:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:2.0:1784044328.773632:0:17936:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1784044328.773634:0:17936:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1784044328.773636:0:17936:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784044328.773639:0:17936:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784044328.773640:0:17936:0:(obd_config.c:1561:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000020:01000000:2.0:1784044328.773642:0:17936:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784044328.773645:0:17936:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784044328.773646:0:17936:0:(obd_config.c:1561:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1784044328.773650:0:17936:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1784044328.773683:0:17936:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784044328.773687:0:17936:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784044328.773688:0:17936:0:(obd_config.c:1561:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1784044328.773691:0:17936:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 46 count 46 00000020:01000000:2.0:1784044328.773753:0:17932:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-45 (rc=0) 10000000:01000000:2.0:1784044328.773786:0:17932:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1784044328.773803:0:17932:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b394166ae00/0x89871fc3aba191c9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba191d0 expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044328.773829:0:17932:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9b394166ae00/0x89871fc3aba191c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba191d0 expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784044328.773837:0:17932:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9b396f25a800 from 1 10000000:01000000:2.0:1784044328.773840:0:17932:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1784044328.773865:0:17932:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b3843798a00/0x89871fc3aba1924e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044328.773873:0:17932:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9b3843798a00/0x89871fc3aba1924e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044328.773884:0:17932:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9b3843798a00/0x89871fc3aba1924e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044328.773907:0:17932:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3975b7f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99a46fb7-9af9-40f1-9c76-329d6781ee81:17932:1870705581031552:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1784044328.773981:0:17932:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1784044328.774103:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1784044328.774108:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1784044328.774111:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1784044328.774121:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1784044328.774155:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581031552 00000100:00100000:1.0:1784044328.774162:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581031552 00000100:00100000:1.0:1784044328.774231:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1784044328.774241:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38437a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99a46fb7-9af9-40f1-9c76-329d6781ee81+15:17932:x1870705581031552:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1784044328.774265:0:17194:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784044328.774278:0:17194:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b38426fcc00/0x89871fc3aba19255 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x89871fc3aba1924e expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044328.774302:0:17194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b38426fcc00/0x89871fc3aba19255 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x89871fc3aba1924e expref: 16 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044328.774313:0:17194:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b38426fcc00/0x89871fc3aba19255 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x89871fc3aba1924e expref: 16 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044328.774322:0:17194:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b38426fcc00, rc 0) 00000100:00100000:3.0:1784044328.774447:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3975b7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1870705581031424:0@lo:8:llog_process_th.0 00000100:00100000:1.0:1784044328.777554:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38437a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99a46fb7-9af9-40f1-9c76-329d6781ee81+16:17932:x1870705581031552:12345-0@lo:101:mount.lustre.0 Request processed in 3304us (3562us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044328.777570:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1784044328.778874:0:17932:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b39455d9240 going to sleep for 11 seconds 00000100:00100000:2.0:1784044328.778913:0:17932:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3975b7f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99a46fb7-9af9-40f1-9c76-329d6781ee81:17932:1870705581031552:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1784044328.779086:0:17932:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9b3843798a00/0x89871fc3aba1924e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba19255 expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044328.779166:0:17932:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9b3843798a00/0x89871fc3aba1924e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x89871fc3aba19255 expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044328.780377:0:17932:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3975b7f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99a46fb7-9af9-40f1-9c76-329d6781ee81:17932:1870705581031680:0@lo:256:mount.lustre.0 00000100:00100000:2.0:1784044328.780454:0:17932:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044328.780506:0:17932:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b39455d9240 going to sleep for 11 seconds 00000100:00100000:0.0:1784044328.780588:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581031680 00000100:00100000:0.0:1784044328.780596:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581031680 00000100:00100000:0.0:1784044328.780659:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1784044328.780669:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38437a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99a46fb7-9af9-40f1-9c76-329d6781ee81+16:17932:x1870705581031680:12345-0@lo:256:mount.lustre.0 20000000:01000000:0.0:1784044328.780693:0:17193:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1784044328.780715:0:17193:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1784044328.780718:0:17193:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:0.0:1784044328.780818:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38437a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99a46fb7-9af9-40f1-9c76-329d6781ee81+16:17932:x1870705581031680:12345-0@lo:256:mount.lustre.0 Request processed in 150us (363us total) trans 0 rc 0/0 00000400:00000100:3.0:1784044328.780825:0:3637:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1870705581031424 offset 0 length 520: 4 00000100:00100000:0.0:1784044328.780825:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1784044328.780868:0:17932:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3975b7f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99a46fb7-9af9-40f1-9c76-329d6781ee81:17932:1870705581031680:0@lo:256:mount.lustre.0 10000000:01000000:0.0:1784044328.781445:0:17932:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1784044328.781468:0:17932:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b3843798a00/0x89871fc3aba1924e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba19255 expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044328.781479:0:17932:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9b3843798a00/0x89871fc3aba1924e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba19255 expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784044328.781498:0:17932:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9b396f25a800 from 1 10000000:01000000:0.0:1784044328.781501:0:17932:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1784044328.781532:0:17932:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b38410b7c00/0x89871fc3aba1925c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044328.781541:0:17932:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9b38410b7c00/0x89871fc3aba1925c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044328.781550:0:17932:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9b38410b7c00/0x89871fc3aba1925c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044328.781566:0:17932:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3947ee9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99a46fb7-9af9-40f1-9c76-329d6781ee81:17932:1870705581031808:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1784044328.781602:0:17932:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044328.781628:0:17932:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b39741b1f00 going to sleep for 11 seconds 00000100:00100000:1.0:1784044328.781843:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581031808 00000100:00100000:1.0:1784044328.781848:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581031808 00000100:00100000:1.0:1784044328.781892:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1784044328.781900:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38437a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99a46fb7-9af9-40f1-9c76-329d6781ee81+16:17932:x1870705581031808:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1784044328.781909:0:17194:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784044328.781922:0:17194:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b38426fd400/0x89871fc3aba19263 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x89871fc3aba1925c expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044328.781943:0:17194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b38426fd400/0x89871fc3aba19263 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x89871fc3aba1925c expref: 17 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044328.781961:0:17194:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b38426fd400/0x89871fc3aba19263 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x89871fc3aba1925c expref: 17 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044328.781970:0:17194:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b38426fd400, rc 0) 00000100:00100000:1.0:1784044328.782012:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38437a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99a46fb7-9af9-40f1-9c76-329d6781ee81+17:17932:x1870705581031808:12345-0@lo:101:mount.lustre.0 Request processed in 113us (410us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044328.782019:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1784044328.783990:0:17932:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3947ee9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99a46fb7-9af9-40f1-9c76-329d6781ee81:17932:1870705581031808:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1784044328.784032:0:17932:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9b38410b7c00/0x89871fc3aba1925c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba19263 expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044328.784044:0:17932:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9b38410b7c00/0x89871fc3aba1925c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x89871fc3aba19263 expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1784044328.784233:0:17932:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1784044328.784287:0:17932:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3947ee9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99a46fb7-9af9-40f1-9c76-329d6781ee81:17932:1870705581031936:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1784044328.784372:0:17932:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044328.784407:0:17932:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b39741b1d80 going to sleep for 11 seconds 00000100:00100000:1.0:1784044328.784629:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581031936 00000100:00100000:1.0:1784044328.784637:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581031936 00000100:00100000:1.0:1784044328.784691:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1784044328.784702:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38437a7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99a46fb7-9af9-40f1-9c76-329d6781ee81+17:17932:x1870705581031936:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1784044328.784815:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38437a7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99a46fb7-9af9-40f1-9c76-329d6781ee81+17:17932:x1870705581031936:12345-0@lo:501:mount.lustre.0 Request processed in 114us (441us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044328.784823:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1784044328.787058:0:17932:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3947ee9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99a46fb7-9af9-40f1-9c76-329d6781ee81:17932:1870705581031936:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1784044328.787126:0:17932:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3947ee9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99a46fb7-9af9-40f1-9c76-329d6781ee81:17932:1870705581032064:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1784044328.787279:0:17932:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044328.787337:0:17932:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b39741b1d80 going to sleep for 11 seconds 00000100:00100000:3.0:1784044328.787429:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581032064 00000100:00100000:3.0:1784044328.787437:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581032064 00000100:00100000:3.0:1784044328.787518:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1784044328.787527:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38437a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99a46fb7-9af9-40f1-9c76-329d6781ee81+17:17932:x1870705581032064:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1784044328.787677:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38437a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99a46fb7-9af9-40f1-9c76-329d6781ee81+17:17932:x1870705581032064:12345-0@lo:503:mount.lustre.0 Request processed in 150us (397us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044328.787685:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1784044328.787883:0:17932:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3947ee9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99a46fb7-9af9-40f1-9c76-329d6781ee81:17932:1870705581032064:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1784044328.788362:0:17932:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1784044328.788460:0:17932:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843735880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99a46fb7-9af9-40f1-9c76-329d6781ee81:17932:1870705581032192:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1784044328.788501:0:17932:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044328.788621:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581032192 00000100:00100000:2.0:1784044328.788626:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581032192 00000100:00100000:2.0:1784044328.788657:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1784044328.788665:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38437a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99a46fb7-9af9-40f1-9c76-329d6781ee81+17:17932:x1870705581032192:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1784044328.788765:0:17932:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3843150600 going to sleep for 11 seconds 00000100:00100000:2.0:1784044328.790344:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38437a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99a46fb7-9af9-40f1-9c76-329d6781ee81+17:17932:x1870705581032192:12345-0@lo:502:mount.lustre.0 Request processed in 1668us (1830us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044328.790359:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1784044328.790665:0:17932:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843735880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99a46fb7-9af9-40f1-9c76-329d6781ee81:17932:1870705581032192:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1784044328.790986:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:1.0:1784044328.791088:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 112 off8528 00000040:00080000:1.0:1784044328.791106:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 224 off8752 00000040:00080000:1.0:1784044328.791120:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8976 00000040:00080000:1.0:1784044328.791134:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 112 off9088 00000040:00080000:1.0:1784044328.791158:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 224 off9312 00000040:00080000:1.0:1784044328.791270:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9536 00000040:00080000:1.0:1784044328.791292:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 128 off9664 00000040:00080000:1.0:1784044328.791305:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:1.0:1784044328.791317:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off10112 00000040:00080000:1.0:1784044328.791328:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 128 off10240 00000100:00100000:1.0:1784044328.791363:0:17932:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843735880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99a46fb7-9af9-40f1-9c76-329d6781ee81:17932:1870705581032320:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1784044328.791416:0:17932:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044328.791451:0:17932:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3843150600 going to sleep for 11 seconds 00000100:00100000:0.0:1784044328.792079:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581032320 00000100:00100000:0.0:1784044328.792088:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581032320 00000100:00100000:0.0:1784044328.792161:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1784044328.792170:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38437a7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99a46fb7-9af9-40f1-9c76-329d6781ee81+17:17932:x1870705581032320:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1784044328.792351:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38437a7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99a46fb7-9af9-40f1-9c76-329d6781ee81+17:17932:x1870705581032320:12345-0@lo:502:mount.lustre.0 Request processed in 181us (933us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044328.792358:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1784044328.792365:0:17932:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843735880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99a46fb7-9af9-40f1-9c76-329d6781ee81:17932:1870705581032320:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1784044328.792423:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10464 00000040:00080000:1.0:1784044328.792435:0:17932:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:3.0:1784044328.794742:0:17945:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784044328.794756:0:17945:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784044328.794758:0:17945:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1784044328.794768:0:17945:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9b396f25a800 00000020:00000080:3.0:1784044328.794771:0:17945:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1784044328.794779:0:17945:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784044328.794782:0:17945:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784044328.794783:0:17945:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1784044328.794785:0:17945:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784044328.794788:0:17945:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784044328.794789:0:17945:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1784044328.794792:0:17945:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9b396f25a800 00000020:00000080:3.0:1784044328.794795:0:17945:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1784044328.794872:0:17945:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784044328.794876:0:17945:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784044328.794878:0:17945:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1784044328.794880:0:17945:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784044328.794883:0:17945:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784044328.794884:0:17945:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1784044328.794887:0:17945:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9b396f25a800 00000020:00000080:3.0:1784044328.794890:0:17945:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1784044328.794909:0:17945:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784044328.794912:0:17945:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784044328.794913:0:17945:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1784044328.794916:0:17945:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784044328.794918:0:17945:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784044328.794919:0:17945:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1784044328.794922:0:17945:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9b396f25a800 00000020:00000080:3.0:1784044328.794923:0:17945:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1784044328.795082:0:17945:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784044328.795085:0:17945:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784044328.795087:0:17945:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1784044328.795096:0:17945:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 13 count 13 00000020:01000000:1.0:1784044328.799792:0:17932:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:1.0:1784044328.799866:0:17932:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1784044328.799893:0:17932:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b38410b7c00/0x89871fc3aba1925c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba19263 expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044328.799909:0:17932:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9b38410b7c00/0x89871fc3aba1925c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba19263 expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784044328.800005:0:17932:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1784044328.800009:0:17932:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9b396f25a800 10000000:01000000:1.0:1784044328.800013:0:17932:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9b396f25a800 10000000:01000000:1.0:1784044328.800018:0:17932:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1784044328.800025:0:17932:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9b396f25a800 from 1 10000000:01000000:1.0:1784044328.800028:0:17932:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1784044328.800068:0:17932:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b38426fca00/0x89871fc3aba1926a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044328.800077:0:17932:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9b38426fca00/0x89871fc3aba1926a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044328.800095:0:17932:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9b38426fca00/0x89871fc3aba1926a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044328.800125:0:17932:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843735880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99a46fb7-9af9-40f1-9c76-329d6781ee81:17932:1870705581032448:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1784044328.800223:0:17932:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044328.800277:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581032448 00000100:00100000:1.0:1784044328.800285:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581032448 00000100:00100000:1.0:1784044328.800336:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1784044328.800345:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843df9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99a46fb7-9af9-40f1-9c76-329d6781ee81+17:17932:x1870705581032448:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1784044328.800359:0:17194:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784044328.800372:0:17194:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b38426fdc00/0x89871fc3aba19271 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x89871fc3aba1926a expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044328.800397:0:17194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b38426fdc00/0x89871fc3aba19271 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x89871fc3aba1926a expref: 18 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044328.800410:0:17194:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b38426fdc00/0x89871fc3aba19271 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x89871fc3aba1926a expref: 18 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044328.800419:0:17194:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b38426fdc00, rc 0) 00000100:00100000:1.0:1784044328.800458:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843df9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99a46fb7-9af9-40f1-9c76-329d6781ee81+18:17932:x1870705581032448:12345-0@lo:101:mount.lustre.0 Request processed in 113us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044328.800465:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1784044328.800512:0:17932:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3843150480 going to sleep for 11 seconds 00000100:00100000:1.0:1784044328.800552:0:17932:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843735880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99a46fb7-9af9-40f1-9c76-329d6781ee81:17932:1870705581032448:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1784044328.800568:0:17932:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9b38426fca00/0x89871fc3aba1926a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba19271 expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044328.800583:0:17932:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9b38426fca00/0x89871fc3aba1926a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x89871fc3aba19271 expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1784044328.812359:0:17932:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:1.0:1784044328.812681:0:17932:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1784044328.812862:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:1.0:1784044328.812885:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 120 off8536 00000040:00080000:1.0:1784044328.812897:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 168 off8704 00000040:00080000:1.0:1784044328.812909:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8928 00000040:00080000:1.0:1784044328.812921:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9152 00000040:00080000:1.0:1784044328.812932:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 120 off9272 00000040:00080000:1.0:1784044328.812966:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 168 off9440 00000040:00080000:1.0:1784044328.812983:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9664 00000040:00080000:1.0:1784044328.814550:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 224 off9888 00000040:00080000:1.0:1784044328.814586:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 120 off10008 00000040:00080000:1.0:1784044328.814602:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10232 00000040:00080000:1.0:1784044328.814618:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 224 off10456 00000040:00080000:1.0:1784044328.814630:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 88 off10544 00000040:00080000:1.0:1784044328.814641:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].14, 128 off10672 00000040:00080000:1.0:1784044328.814654:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].15, 144 off10816 00000040:00080000:1.0:1784044328.814667:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].16, 160 off10976 00000040:00080000:1.0:1784044328.814682:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].17, 224 off11200 00000040:00080000:1.0:1784044328.814697:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].18, 224 off11424 00000040:00080000:1.0:1784044328.814710:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].19, 80 off11504 00000040:00080000:1.0:1784044328.814723:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].20, 224 off11728 00000040:00080000:1.0:1784044328.814735:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].21, 224 off11952 00000040:00080000:1.0:1784044328.814747:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].22, 88 off12040 00000040:00080000:1.0:1784044328.814784:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].23, 128 off12168 00000040:00080000:1.0:1784044328.814802:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].24, 144 off12312 00000040:00080000:1.0:1784044328.814815:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].25, 160 off12472 00000040:00080000:1.0:1784044328.814828:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].26, 224 off12696 00000040:00080000:1.0:1784044328.814853:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].27, 224 off12920 00000040:00080000:1.0:1784044328.814867:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].28, 80 off13000 00000040:00080000:1.0:1784044328.814894:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].29, 224 off13224 00000040:00080000:1.0:1784044328.814901:0:17932:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:1.0:1784044328.815039:0:17932:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843735880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99a46fb7-9af9-40f1-9c76-329d6781ee81:17932:1870705581032576:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1784044328.815121:0:17932:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044328.815680:0:17932:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b395829f180 going to sleep for 11 seconds 00000100:00100000:0.0:1784044328.816086:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581032576 00000100:00100000:0.0:1784044328.816095:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581032576 00000100:00100000:0.0:1784044328.816154:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1784044328.816165:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843dfb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99a46fb7-9af9-40f1-9c76-329d6781ee81+18:17932:x1870705581032576:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1784044328.816360:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843dfb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99a46fb7-9af9-40f1-9c76-329d6781ee81+18:17932:x1870705581032576:12345-0@lo:501:mount.lustre.0 Request processed in 196us (1239us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044328.816368:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1784044328.816429:0:17932:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843735880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99a46fb7-9af9-40f1-9c76-329d6781ee81:17932:1870705581032576:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1784044328.816471:0:17932:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3947ee9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99a46fb7-9af9-40f1-9c76-329d6781ee81:17932:1870705581032704:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1784044328.816514:0:17932:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044328.816553:0:17932:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b397a881f00 going to sleep for 11 seconds 00000100:00100000:3.0:1784044328.817869:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581032704 00000100:00100000:3.0:1784044328.817883:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581032704 00000100:00100000:3.0:1784044328.818081:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1784044328.818092:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397d65dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99a46fb7-9af9-40f1-9c76-329d6781ee81+18:17932:x1870705581032704:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1784044328.818270:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397d65dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99a46fb7-9af9-40f1-9c76-329d6781ee81+18:17932:x1870705581032704:12345-0@lo:503:mount.lustre.0 Request processed in 180us (1755us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044328.818278:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1784044328.819014:0:17932:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3947ee9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99a46fb7-9af9-40f1-9c76-329d6781ee81:17932:1870705581032704:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1784044328.819564:0:17932:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1784044328.819666:0:17932:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3947ee9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99a46fb7-9af9-40f1-9c76-329d6781ee81:17932:1870705581032832:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1784044328.819723:0:17932:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044328.819757:0:17932:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3975ba9f00 going to sleep for 11 seconds 00000100:00100000:0.0:1784044328.819779:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581032832 00000100:00100000:0.0:1784044328.819784:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581032832 00000100:00100000:0.0:1784044328.819823:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1784044328.819831:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397d65c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99a46fb7-9af9-40f1-9c76-329d6781ee81+18:17932:x1870705581032832:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1784044328.819931:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397d65c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99a46fb7-9af9-40f1-9c76-329d6781ee81+18:17932:x1870705581032832:12345-0@lo:502:mount.lustre.0 Request processed in 100us (207us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044328.819939:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1784044328.819987:0:17932:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3947ee9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99a46fb7-9af9-40f1-9c76-329d6781ee81:17932:1870705581032832:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1784044328.820158:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:0.0:1784044328.820211:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 120 off8536 00000040:00080000:0.0:1784044328.820226:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 168 off8704 00000040:00080000:0.0:1784044328.820264:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8928 00000040:00080000:0.0:1784044328.820284:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9152 00000040:00080000:0.0:1784044328.820298:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 120 off9272 00000040:00080000:0.0:1784044328.820312:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 168 off9440 00000040:00080000:0.0:1784044328.820325:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9664 00000040:00080000:0.0:1784044328.820337:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 224 off9888 00000040:00080000:0.0:1784044328.820348:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 120 off10008 00000040:00080000:0.0:1784044328.820359:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10232 00000040:00080000:0.0:1784044328.820370:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 224 off10456 00000040:00080000:0.0:1784044328.820381:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 88 off10544 00000040:00080000:0.0:1784044328.820392:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].14, 128 off10672 00000040:00080000:0.0:1784044328.820404:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].15, 144 off10816 00000040:00080000:0.0:1784044328.820415:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].16, 160 off10976 00000040:00080000:0.0:1784044328.820427:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].17, 224 off11200 00000040:00080000:0.0:1784044328.820440:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].18, 224 off11424 00000040:00080000:0.0:1784044328.820452:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].19, 80 off11504 00000040:00080000:0.0:1784044328.820474:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].20, 224 off11728 00000040:00080000:0.0:1784044328.820488:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].21, 224 off11952 00000040:00080000:0.0:1784044328.820500:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].22, 88 off12040 00000040:00080000:0.0:1784044328.820522:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].23, 128 off12168 00000040:00080000:0.0:1784044328.820536:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].24, 144 off12312 00000040:00080000:0.0:1784044328.820548:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].25, 160 off12472 00000040:00080000:0.0:1784044328.820561:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].26, 224 off12696 00000040:00080000:0.0:1784044328.820574:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].27, 224 off12920 00000040:00080000:0.0:1784044328.820586:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].28, 80 off13000 00000040:00080000:0.0:1784044328.820598:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].29, 224 off13224 00000040:00080000:0.0:1784044328.820611:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].30, 224 off13448 00000040:00080000:0.0:1784044328.820625:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].31, 88 off13536 00000040:00080000:0.0:1784044328.820638:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].32, 128 off13664 00000040:00080000:0.0:1784044328.820650:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].33, 144 off13808 00000040:00080000:0.0:1784044328.820662:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].34, 128 off13936 00000040:00080000:0.0:1784044328.820676:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].35, 224 off14160 00000040:00080000:0.0:1784044328.820703:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].36, 224 off14384 00000040:00080000:0.0:1784044328.820716:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].37, 80 off14464 00000040:00080000:0.0:1784044328.820727:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].38, 224 off14688 00000040:00080000:0.0:1784044328.820738:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].39, 224 off14912 00000040:00080000:0.0:1784044328.820751:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].40, 88 off15000 00000040:00080000:0.0:1784044328.820765:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].41, 128 off15128 00000040:00080000:0.0:1784044328.820778:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].42, 144 off15272 00000040:00080000:0.0:1784044328.820792:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].43, 128 off15400 00000040:00080000:0.0:1784044328.820804:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].44, 224 off15624 00000040:00080000:0.0:1784044328.820817:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].45, 224 off15848 00000040:00080000:0.0:1784044328.820828:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].46, 80 off15928 00000040:00080000:0.0:1784044328.820842:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].47, 224 off16152 00000040:00080000:0.0:1784044328.820856:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].48, 232 off16384 00000100:00100000:0.0:1784044328.820896:0:17932:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3947ee9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99a46fb7-9af9-40f1-9c76-329d6781ee81:17932:1870705581032960:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1784044328.820942:0:17932:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044328.820980:0:17932:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3975ba9f00 going to sleep for 11 seconds 00000100:00100000:2.0:1784044328.821227:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581032960 00000100:00100000:2.0:1784044328.821233:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581032960 00000100:00100000:2.0:1784044328.821286:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1784044328.821295:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397d65f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99a46fb7-9af9-40f1-9c76-329d6781ee81+18:17932:x1870705581032960:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1784044328.821404:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397d65f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99a46fb7-9af9-40f1-9c76-329d6781ee81+18:17932:x1870705581032960:12345-0@lo:502:mount.lustre.0 Request processed in 110us (461us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044328.821411:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1784044328.824370:0:17932:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3947ee9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99a46fb7-9af9-40f1-9c76-329d6781ee81:17932:1870705581032960:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1784044328.824634:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].49, 224 off16608 00000040:00080000:0.0:1784044328.824669:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].50, 120 off16728 00000100:00100000:0.0:1784044328.824728:0:17932:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3947ee9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99a46fb7-9af9-40f1-9c76-329d6781ee81:17932:1870705581033088:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1784044328.824812:0:17932:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044328.824864:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581033088 00000100:00100000:0.0:1784044328.824873:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581033088 00000100:00100000:0.0:1784044328.824930:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1784044328.824939:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397d65e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99a46fb7-9af9-40f1-9c76-329d6781ee81+18:17932:x1870705581033088:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1784044328.826651:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397d65e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99a46fb7-9af9-40f1-9c76-329d6781ee81+18:17932:x1870705581033088:12345-0@lo:502:mount.lustre.0 Request processed in 1702us (1828us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044328.826665:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1784044328.826727:0:17932:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3975ba9f00 going to sleep for 11 seconds 00000100:00100000:0.0:1784044328.826747:0:17932:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3947ee9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99a46fb7-9af9-40f1-9c76-329d6781ee81:17932:1870705581033088:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1784044328.826815:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].51, 224 off16952 00000040:00080000:0.0:1784044328.826828:0:17932:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:2.0:1784044328.837788:0:17951:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:2.0:1784044328.837827:0:17951:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (ffff9b3947bc99c0) 00000020:00000080:2.0:1784044328.837855:0:17951:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:2.0:1784044328.840236:0:17951:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9b396f25a800 from lustre-MDT0001, refs=3 00000020:01000004:2.0:1784044328.840245:0:17951:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9b396f25a800 from lustre-MDT0001, refs=3 00000020:01000004:2.0:1784044328.840248:0:17951:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9b396f25a800 3 00010000:00080000:2.0:1784044328.840293:0:17951:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9b3974dae800@lustre-MDT0000-lwp-MDT0001: add connection 192.168.202.140@tcp at head 00010000:00010000:0.0:1784044328.851926:0:17951:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-8 is initialized 00000020:00000080:0.0:1784044328.854705:0:17951:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:0.0:1784044328.854755:0:17951:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1784044328.854770:0:17951:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0x89871fc3aba1927f 00000100:00080000:0.0:1784044328.854781:0:17951:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1784044328.854787:0:17951:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9b3974dae800 using connection 192.168.202.140@tcp/0@lo 00000100:00100000:0.0:1784044328.854827:0:17951:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b3947ee9c00 x1870705581033216/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1784044328.854863:0:17951:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1784044328.855032:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3947ee9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3637:1870705581033216:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1784044328.855108:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1784044328.855113:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1784044328.855117:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1784044328.855120:0:37:0:(import.c:65:import_set_state_nolock()) ffff9b3974dac800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784044328.855125:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9b3974dac800 using connection 192.168.202.140@tcp/0@lo 00000100:00100000:1.0:1784044328.855138:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b3843737800 x1870705581033472/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1784044328.855147:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1784044328.855150:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1784044328.855152:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00100000:2.0:1784044328.855154:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843737800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1870705581033472:0@lo:38:kworker.0 00000100:00080000:1.0:1784044328.855155:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1784044328.855202:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044328.855237:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581033216 00000100:00100000:2.0:1784044328.855243:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581033216 00000100:00080000:1.0:1784044328.855277:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1784044328.855281:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1784044328.855284:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1784044328.855286:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1784044328.855294:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1784044328.855301:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3975b7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3637:x1870705581033216:12345-0@lo:38:llog_process_th.0 00000100:00100000:1.0:1784044328.855302:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843735f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3639:1870705581033600:0@lo:400:kworker.0 00010000:00080000:2.0:1784044328.855322:0:17201:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 522 last 0 00000100:00100000:1.0:1784044328.855328:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:2.0:1784044328.855351:0:17201:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x89871fc3aba19286 00000100:00100000:1.0:1784044328.855352:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1784044328.855357:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843734700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:99a46fb7-9af9-40f1-9c76-329d6781ee81:3639:1870705581033344:0@lo:400:kworker.0 00000004:00100000:2.0:1784044328.855364:0:17201:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:1.0:1784044328.855380:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1784044328.855393:0:17201:0:(import.c:65:import_set_state_nolock()) ffff9b397f9eb800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1784044328.855402:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843735c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1870705581033728:0@lo:400:kworker.0 00000100:00100000:1.0:1784044328.855427:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044328.855437:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3975b7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1870705581033216:12345-0@lo:38:llog_process_th.0 Request processed in 135us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044328.855444:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1784044328.855452:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581033472 00000100:00100000:2.0:1784044328.855456:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581033600 00000100:00100000:1.0:1784044328.855456:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581033472 00000100:00100000:2.0:1784044328.855458:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581033600 00000100:00100000:1.0:1784044328.855467:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581033728 00000100:00100000:1.0:1784044328.855469:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581033728 00000100:00100000:2.0:1784044328.855475:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1784044328.855480:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843734e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1870705581033600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044328.855482:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1784044328.855486:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3975b7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3637:x1870705581033472:12345-0@lo:38:kworker.0 00000100:00100000:2.0:1784044328.855515:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843734e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1870705581033600:12345-0@lo:400:kworker.0 Request processed in 34us (185us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044328.855515:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3975b7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3637:x1870705581033472:12345-0@lo:38:kworker.0 Request processed in 26us (312us total) trans 0 rc -11/-11 00000100:00100000:2.0:1784044328.855522:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:2.0:1784044328.855557:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9b3974dac800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1784044328.855563:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1784044328.855566:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843737800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1870705581033472:0@lo:38:kworker.0 00010000:00080000:2.0:1784044328.855579:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9b3947ee9c00 x1870705581033216/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784044338 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784044328.855588:0:3637:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1784044328.855594:0:3637:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 2 00000100:00080000:2.0:1784044328.855603:0:3637:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1784044328.855607:0:3637:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1784044328.855609:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9b3974dae800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1784044328.855622:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3947ee9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3637:1870705581033216:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1784044328.855622:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1784044328.855637:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1784044328.855643:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843735880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3640:x1870705581033728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044328.855687:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843735880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3640:x1870705581033728:12345-0@lo:400:kworker.0 Request processed in 44us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044328.855693:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1784044328.855722:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581033344 00000100:00100000:1.0:1784044328.855726:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581033344 00000100:00100000:1.0:1784044328.855750:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1784044328.855756:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397d65c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99a46fb7-9af9-40f1-9c76-329d6781ee81+18:3639:x1870705581033344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044328.855783:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397d65c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99a46fb7-9af9-40f1-9c76-329d6781ee81+18:3639:x1870705581033344:12345-0@lo:400:kworker.0 Request processed in 27us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044328.855789:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1784044328.855826:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843734700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:99a46fb7-9af9-40f1-9c76-329d6781ee81:3639:1870705581033344:0@lo:400:kworker.0 00010000:00080000:1.0:1784044328.855846:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9b3843735f80 x1870705581033600/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044344 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784044328.855855:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843735f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3639:1870705581033600:0@lo:400:kworker.0 00000100:00100000:2.0:1784044328.858677:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843735c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1870705581033728:0@lo:400:kworker.0 00000040:00080000:1.0:1784044328.860581:0:17951:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 52 count 51 00000020:01000000:0.0:1784044328.860692:0:17932:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1784044328.860729:0:17932:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1784044328.860752:0:17932:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b38426fca00/0x89871fc3aba1926a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba19271 expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044328.860778:0:17932:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9b38426fca00/0x89871fc3aba1926a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba19271 expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1784044328.860835:0:17932:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1784044328.860838:0:17932:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1784044328.860839:0:17932:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784044328.860841:0:17932:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1784044328.860842:0:17932:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784044328.860843:0:17932:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784044328.860845:0:17932:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1784044328.860846:0:17932:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784044328.860847:0:17932:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1784044328.860851:0:17932:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020001 00000020:01000004:0.0:1784044328.860853:0:17932:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1784044328.860855:0:17932:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1784044328.860856:0:17932:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784044328.860857:0:17932:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1784044328.860858:0:17932:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784044328.860859:0:17932:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784044328.860859:0:17932:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1784044328.860860:0:17932:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784044328.860861:0:17932:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1784044328.860895:0:17932:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:0.0:1784044328.860918:0:17932:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3947ee8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99a46fb7-9af9-40f1-9c76-329d6781ee81:17932:1870705581033856:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1784044328.861015:0:17932:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044328.861056:0:17932:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3975ba9180 going to sleep for 11 seconds 00000100:00100000:0.0:1784044328.861081:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581033856 00000100:00100000:0.0:1784044328.861086:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581033856 00000100:00100000:0.0:1784044328.861126:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1784044328.861135:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397d65ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99a46fb7-9af9-40f1-9c76-329d6781ee81+18:17932:x1870705581033856:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1784044328.861162:0:17194:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1784044328.861199:0:17194:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:1.0:1784044328.864447:0:17179:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:3.0:1784044328.864511:0:17194:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1784044328.864573:0:17194:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:3.0:1784044328.864865:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397d65ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99a46fb7-9af9-40f1-9c76-329d6781ee81+18:17932:x1870705581033856:12345-0@lo:253:mount.lustre.0 Request processed in 3726us (3845us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044328.864876:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1784044328.864970:0:17932:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3947ee8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99a46fb7-9af9-40f1-9c76-329d6781ee81:17932:1870705581033856:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1784044328.864986:0:17932:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:3.0:1784044328.864989:0:17932:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1784044328.864991:0:17932:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1784044328.864992:0:17932:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1784044328.864993:0:17932:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1784044328.864994:0:17932:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1784044328.864995:0:17932:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1784044328.864995:0:17932:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1784044328.864997:0:17932:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1784044328.864998:0:17932:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1784044328.865010:0:17932:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:1.0:1784044328.867906:0:17216:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1784044328.867915:0:17216:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1784044328.867939:0:17216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b38426fc000/0x89871fc3aba1928d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044328.867958:0:17216:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b38426fc800/0x89871fc3aba19191 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x89871fc3aba1918a expref: 17 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044328.868055:0:17216:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b38426fcc00/0x89871fc3aba19255 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x89871fc3aba1924e expref: 17 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044328.868064:0:17216:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b38426fc000/0x89871fc3aba1928d lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044328.868109:0:17216:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b38426fcc00/0x89871fc3aba19255 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x89871fc3aba1924e expref: 17 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044328.868128:0:17216:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b38426fcc00/0x89871fc3aba19255 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x89871fc3aba1924e expref: 17 pid: 17194 timeout: 622 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044328.868145:0:17216:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843735f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17216:1870705581033984:0@lo:104: 00000100:00100000:1.0:1784044328.868730:0:17216:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1784044328.868790:0:17216:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b38426fc800/0x89871fc3aba19191 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x89871fc3aba1918a expref: 17 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044328.868806:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581033984 00000100:00100000:0.0:1784044328.868815:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581033984 00010000:00010000:1.0:1784044328.868819:0:17216:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b38426fc800/0x89871fc3aba19191 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x89871fc3aba1918a expref: 17 pid: 17194 timeout: 622 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044328.868831:0:17216:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843735500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17216:1870705581034112:0@lo:104: 00000100:00100000:1.0:1784044328.868859:0:17216:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044328.868871:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581034112 00000100:00100000:1.0:1784044328.868873:0:17216:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3951e2b540 going to sleep for 11 seconds 00000100:00100000:0.0:1784044328.868877:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581034112 00000100:00100000:0.0:1784044328.868899:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1784044328.868908:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843734700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:99a46fb7-9af9-40f1-9c76-329d6781ee81+4:17216:x1870705581033984:12345-0@lo:104: 00010000:00010000:0.0:1784044328.868923:0:17182:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.140@tcp lock: ffff9b3843798a00/0x89871fc3aba1924e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x89871fc3aba19255 expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044328.869002:0:17182:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1784044328.869008:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843734700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:99a46fb7-9af9-40f1-9c76-329d6781ee81+4:17216:x1870705581033984:12345-0@lo:104: Request processed in 102us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044328.869015:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1784044328.869033:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1784044328.869039:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843736680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:99a46fb7-9af9-40f1-9c76-329d6781ee81+3:17216:x1870705581034112:12345-0@lo:104: 00010000:00010000:0.0:1784044328.869047:0:17182:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.140@tcp lock: ffff9b38410b6400/0x89871fc3aba1918a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x89871fc3aba19191 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044328.869078:0:17182:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1784044328.869084:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843736680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:99a46fb7-9af9-40f1-9c76-329d6781ee81+3:17216:x1870705581034112:12345-0@lo:104: Request processed in 46us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044328.869090:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:0.0:1784044328.869107:0:17187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1784044328.869113:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: ffff9b3843798a00/0x89871fc3aba1924e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x89871fc3aba19255 expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044328.869121:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3843798a00 already unused, calling callback (ffffffffc113cc20) 10000000:00010000:0.0:1784044328.869125:0:17187:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: ffff9b3843798a00/0x89871fc3aba1924e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x89871fc3aba19255 expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044328.869153:0:17187:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9b3843798a00/0x89871fc3aba1924e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x89871fc3aba19255 expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784044328.869161:0:17187:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9b3843798a00/0x89871fc3aba1924e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x89871fc3aba19255 expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784044328.869167:0:17187:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1784044328.869211:0:17187:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.140@tcp lock: ffff9b3843798a00/0x89871fc3aba1924e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x89871fc3aba19255 expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044328.869219:0:17187:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784044328.869240:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: ffff9b3843798a00/0x89871fc3aba1924e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x89871fc3aba19255 expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044328.869247:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9b3843798a00/0x89871fc3aba1924e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x89871fc3aba19255 expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044328.869267:0:17187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784044328.869271:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: ffff9b38410b6400/0x89871fc3aba1918a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x89871fc3aba19191 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044328.869276:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38410b6400 already unused, calling callback (ffffffffc113cc20) 10000000:00010000:0.0:1784044328.869278:0:17187:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: ffff9b38410b6400/0x89871fc3aba1918a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x89871fc3aba19191 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044328.869284:0:17187:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9b38410b6400/0x89871fc3aba1918a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x89871fc3aba19191 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784044328.869290:0:17187:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9b38410b6400/0x89871fc3aba1918a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x89871fc3aba19191 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784044328.869301:0:17187:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1784044328.869315:0:17187:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.140@tcp lock: ffff9b38410b6400/0x89871fc3aba1918a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x89871fc3aba19191 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044328.869321:0:17187:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784044328.869335:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: ffff9b38410b6400/0x89871fc3aba1918a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x89871fc3aba19191 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044328.869339:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9b38410b6400/0x89871fc3aba1918a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x89871fc3aba19191 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044328.869348:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784044328.869349:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784044328.869350:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784044328.869356:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784044328.869364:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3947ee8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:99a46fb7-9af9-40f1-9c76-329d6781ee81:3640:1870705581034240:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784044328.869386:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044328.869404:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1784044328.869417:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3947ee9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:99a46fb7-9af9-40f1-9c76-329d6781ee81:3639:1870705581034368:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784044328.869450:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044328.869502:0:17216:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843735f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17216:1870705581033984:0@lo:104: 00000100:00100000:1.0:1784044328.869512:0:17216:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843735500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17216:1870705581034112:0@lo:104: 00010000:00010000:1.0:1784044328.869529:0:17216:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b38426fc000/0x89871fc3aba1928d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044328.871309:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784044328.871333:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581034240 00000100:00100000:3.0:1784044328.871342:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581034240 00010000:00010000:3.0:1784044328.871455:0:17184:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b38426fcc00/0x89871fc3aba19255 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x89871fc3aba1924e expref: 18 pid: 17194 timeout: 622 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044328.871895:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581034368 00000100:00100000:3.0:1784044328.871901:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581034368 00010000:00010000:3.0:1784044328.871919:0:17184:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b38426fc800/0x89871fc3aba19191 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x89871fc3aba1918a expref: 19 pid: 17194 timeout: 622 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044328.871937:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1784044328.871947:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3947ee9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:99a46fb7-9af9-40f1-9c76-329d6781ee81+19:3640:x1870705581034240:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784044328.872027:0:17184:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784044328.872035:0:17184:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b38426fcc00/0x89871fc3aba19255 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x89871fc3aba1924e expref: 19 pid: 17194 timeout: 622 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044328.872047:0:17184:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b38426fcc00/0x89871fc3aba19255 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x89871fc3aba1924e expref: 19 pid: 17194 timeout: 622 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044328.872064:0:17184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b38426fcc00/0x89871fc3aba19255 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x89871fc3aba1924e expref: 19 pid: 17194 timeout: 622 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044328.872078:0:17184:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784044328.872154:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3947ee9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:99a46fb7-9af9-40f1-9c76-329d6781ee81+18:3640:x1870705581034240:12345-0@lo:103:ldlm_bl.0 Request processed in 208us (2764us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044328.872165:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1784044328.872226:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1784044328.872235:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843735180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:99a46fb7-9af9-40f1-9c76-329d6781ee81+17:3639:x1870705581034368:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784044328.872244:0:17184:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784044328.872248:0:17184:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b38426fc800/0x89871fc3aba19191 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x89871fc3aba1918a expref: 17 pid: 17194 timeout: 622 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044328.872280:0:17184:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b38426fc800/0x89871fc3aba19191 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x89871fc3aba1918a expref: 17 pid: 17194 timeout: 622 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044328.872292:0:17184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b38426fc800/0x89871fc3aba19191 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x89871fc3aba1918a expref: 17 pid: 17194 timeout: 622 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044328.872306:0:17184:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b38426fc000/0x89871fc3aba1928d lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044328.872306:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3947ee8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:99a46fb7-9af9-40f1-9c76-329d6781ee81:3640:1870705581034240:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784044328.872321:0:17184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b38426fc000/0x89871fc3aba1928d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1784044328.872338:0:17184:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.025288238s 00010000:00010000:3.0:1784044328.872343:0:17184:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b38426fc000/0x89871fc3aba1928d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044328.872350:0:17184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b38426fc000/0x89871fc3aba1928d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044328.872421:0:17184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b38426fc000/0x89871fc3aba1928d lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044328.872428:0:17184:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b38426fc000/0x89871fc3aba1928d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044328.872433:0:17184:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38426fc000 already unused, calling callback (ffffffffc0b56230) 00010000:00010000:3.0:1784044328.872438:0:17184:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b38426fc000/0x89871fc3aba1928d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044328.872444:0:17184:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b38426fc000/0x89871fc3aba1928d lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044328.872542:0:17216:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b38426fc000/0x89871fc3aba1928d lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044328.872549:0:17216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b38426fc000/0x89871fc3aba1928d lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044328.872576:0:17184:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b38426fc000/0x89871fc3aba1928d lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044328.872585:0:17184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b38426fc000/0x89871fc3aba1928d lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044328.872598:0:17184:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784044328.872724:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843735180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:99a46fb7-9af9-40f1-9c76-329d6781ee81+16:3639:x1870705581034368:12345-0@lo:103:ldlm_bl.0 Request processed in 491us (3274us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044328.872732:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1784044328.874109:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3947ee9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:99a46fb7-9af9-40f1-9c76-329d6781ee81:3639:1870705581034368:0@lo:103:ldlm_bl.0 00000040:01000000:2.0:1784044328.877261:0:17932:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000020:00080000:1.0:1784044328.877304:0:17956:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:1.0:1784044328.877309:0:17956:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:1.0:1784044328.877766:0:17957:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1784044328.877822:0:17932:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000040:00080000:3.0:1784044328.878206:0:17957:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1784044328.878297:0:17958:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843735500 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17958:1870705581034496:0@lo:1000:lod0001_rec0000.0 00000040:01000000:2.0:1784044328.878358:0:17932:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000100:00100000:1.0:1784044328.878366:0:17958:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044328.878398:0:17958:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3951e2b3c0 going to sleep for 11 seconds 00000040:00080000:2.0:1784044328.878406:0:17932:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1784044328.878472:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581034496 00000100:00100000:0.0:1784044328.878479:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581034496 00000100:00100000:0.0:1784044328.878513:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1784044328.878519:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843735f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17958:x1870705581034496:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1784044328.878621:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843735f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17958:x1870705581034496:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 101us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044328.878629:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1784044328.878740:0:17958:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843735500 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17958:1870705581034496:0@lo:1000:lod0001_rec0000.0 00000040:01000000:1.0:1784044328.878763:0:17958:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:1.0:1784044328.878785:0:17958:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843735500 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17958:1870705581034624:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1784044328.878819:0:17958:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044328.878837:0:17958:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3951e2b3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784044328.879043:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581034624 00000100:00100000:0.0:1784044328.879047:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581034624 00000100:00100000:0.0:1784044328.879070:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1784044328.879076:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843737b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17958:x1870705581034624:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1784044328.879220:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843737b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17958:x1870705581034624:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 143us (399us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044328.879226:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000004:00000080:2.0:1784044328.879283:0:17932:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1784044328.879292:0:17932:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000100:00100000:1.0:1784044328.879292:0:17958:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843735500 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17958:1870705581034624:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1784044328.879343:0:17958:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843735500 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:17958:1870705581034752:0@lo:900:lod0001_rec0000.0 00000040:00080000:2.0:1784044328.879345:0:17932:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1784044328.879374:0:17958:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044328.879396:0:17958:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3951e2bf00 going to sleep for 11 seconds 00000100:00100000:0.0:1784044328.882289:0:17211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581034752 00000100:00100000:0.0:1784044328.882303:0:17211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581034752 00000100:00100000:0.0:1784044328.882624:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1784044328.882636:0:17211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843734380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17958:x1870705581034752:12345-0@lo:900:lod0001_rec0000.0 00000100:00100000:0.0:1784044328.882732:0:17211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843734380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17958:x1870705581034752:12345-0@lo:900:lod0001_rec0000.0 Request processed in 99us (3357us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044328.882740:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1784044328.882762:0:17958:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9b3843735500 x1870705581034752/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1784044344 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784044328.882778:0:17958:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843735500 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:17958:1870705581034752:0@lo:900:lod0001_rec0000.0 00000100:00100000:1.0:1784044328.882844:0:17958:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843735500 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17958:1870705581034880:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1784044328.882878:0:17958:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044328.882906:0:17958:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3951e2b3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784044328.883004:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581034880 00000100:00100000:0.0:1784044328.883009:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581034880 00000100:00100000:0.0:1784044328.883043:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1784044328.883050:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843736d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17958:x1870705581034880:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1784044328.883156:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843736d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17958:x1870705581034880:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 106us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044328.883163:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1784044328.883468:0:17958:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843735500 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17958:1870705581034880:0@lo:1000:lod0001_rec0000.0 00000040:00080000:1.0:1784044328.883516:0:17958:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1784044328.884527:0:17932:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1784044328.886621:0:17932:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1784044328.886683:0:17932:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:2.0:1784044328.886858:0:17932:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:2.0:1784044328.887519:0:17932:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x2f:0x0] (8/32) registered 00000040:00080000:3.0:1784044328.888170:0:17957:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1784044328.888295:0:17957:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000040:00080000:1.0:1784044328.889156:0:17958:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1784044328.889372:0:17958:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1784044328.889377:0:17958:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00000001:00000004:0.0:1784044328.891658:0:17932:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:0.0:1784044328.892797:0:17932:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1784044328.892829:0:17932:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffb73bc192f988 00100000:10000000:0.0:1784044328.892837:0:17932:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:3.0:1784044328.893591:0:17932:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1784044328.893631:0:17932:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.140@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1784044328.893656:0:17932:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:3.0:1784044328.893672:0:17932:0:(super25.c:181:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:3.0:1784044328.894577:0:17932:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1784044328.894787:0:17932:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1784044328.977530:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784044329.421393:0:17242:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b394a323b40 going to sleep for 0 seconds 00000040:00080000:1.0:1784044329.871481:0:17952:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1784044329.998265:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784044330.445389:0:17242:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b394a323b40 going to sleep for 0 seconds 10000000:01000000:1.0:1784044330.701306:0:17196:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1784044330.701319:0:17196:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9b396f25a800 from 8 10000000:01000000:1.0:1784044330.701327:0:17196:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1784044330.701410:0:17196:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b38426fde00/0x89871fc3aba19294 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044330.701426:0:17196:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9b38426fde00/0x89871fc3aba19294 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044330.701469:0:17196:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9b38426fde00/0x89871fc3aba19294 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044330.701506:0:17196:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843735500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99a46fb7-9af9-40f1-9c76-329d6781ee81:17196:1870705581035008:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784044330.701623:0:17196:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044330.701717:0:17196:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3951e2b180 going to sleep for 11 seconds 00000100:00100000:2.0:1784044330.702083:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581035008 00000100:00100000:2.0:1784044330.702094:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581035008 00000100:00100000:2.0:1784044330.702163:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1784044330.702201:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397d65fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99a46fb7-9af9-40f1-9c76-329d6781ee81+16:17196:x1870705581035008:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784044330.702220:0:17192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784044330.702248:0:17192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b3843799200/0x89871fc3aba1929b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x89871fc3aba19294 expref: -99 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044330.702279:0:17192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b3843799200/0x89871fc3aba1929b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x89871fc3aba19294 expref: 17 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044330.702291:0:17192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b3843799200/0x89871fc3aba1929b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x89871fc3aba19294 expref: 17 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044330.702315:0:17192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3843799200, rc 0) 00000100:00100000:2.0:1784044330.702376:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397d65fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99a46fb7-9af9-40f1-9c76-329d6781ee81+17:17196:x1870705581035008:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 203us (755us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044330.702383:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1784044330.702501:0:17196:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843735500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99a46fb7-9af9-40f1-9c76-329d6781ee81:17196:1870705581035008:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784044330.702523:0:17196:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9b38426fde00/0x89871fc3aba19294 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba1929b expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044330.702533:0:17196:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9b38426fde00/0x89871fc3aba19294 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x89871fc3aba1929b expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044330.702605:0:17196:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843ce5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99a46fb7-9af9-40f1-9c76-329d6781ee81:17196:1870705581035136:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1784044330.702650:0:17196:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044330.702671:0:17196:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3942ab03c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784044330.702756:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581035136 00000100:00100000:1.0:1784044330.702762:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581035136 00000100:00100000:1.0:1784044330.702891:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1784044330.702900:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397d65e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99a46fb7-9af9-40f1-9c76-329d6781ee81+17:17196:x1870705581035136:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1784044330.702926:0:17193:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1784044330.702946:0:17193:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1784044330.702949:0:17193:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:1.0:1784044330.703031:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397d65e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99a46fb7-9af9-40f1-9c76-329d6781ee81+17:17196:x1870705581035136:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 132us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044330.703037:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1784044330.703228:0:17196:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843ce5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99a46fb7-9af9-40f1-9c76-329d6781ee81:17196:1870705581035136:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1784044330.703289:0:17196:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1784044330.703298:0:17196:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b38426fde00/0x89871fc3aba19294 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba1929b expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044330.703307:0:17196:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9b38426fde00/0x89871fc3aba19294 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba1929b expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784044330.703318:0:17196:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1784044330.703321:0:17196:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9b397a8e8000 from 8 10000000:01000000:2.0:1784044330.703323:0:17196:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1784044330.703345:0:17196:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b3843799e00/0x89871fc3aba192a2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044330.703353:0:17196:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9b3843799e00/0x89871fc3aba192a2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044330.703362:0:17196:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9b3843799e00/0x89871fc3aba192a2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044330.703375:0:17196:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3975b7ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99a46fb7-9af9-40f1-9c76-329d6781ee81:17196:1870705581035264:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1784044330.703400:0:17196:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044330.703911:0:17196:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b39482cc900 going to sleep for 11 seconds 00000100:00100000:3.0:1784044330.708841:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581035264 00000100:00100000:3.0:1784044330.708865:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581035264 00000100:00100000:3.0:1784044330.708964:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1784044330.708975:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397d65d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99a46fb7-9af9-40f1-9c76-329d6781ee81+17:17196:x1870705581035264:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784044330.709000:0:17192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784044330.709026:0:17192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b394166ac00/0x89871fc3aba192a9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x89871fc3aba192a2 expref: -99 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044330.709065:0:17192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b394166ac00/0x89871fc3aba192a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x89871fc3aba192a2 expref: 18 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044330.709078:0:17192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b394166ac00/0x89871fc3aba192a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x89871fc3aba192a2 expref: 18 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044330.709089:0:17192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b394166ac00, rc 0) 00000100:00100000:3.0:1784044330.709228:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397d65d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99a46fb7-9af9-40f1-9c76-329d6781ee81+18:17196:x1870705581035264:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 254us (5825us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044330.709245:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1784044330.709680:0:17196:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3975b7ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99a46fb7-9af9-40f1-9c76-329d6781ee81:17196:1870705581035264:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784044330.709706:0:17196:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9b3843799e00/0x89871fc3aba192a2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba192a9 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044330.709718:0:17196:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9b3843799e00/0x89871fc3aba192a2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x89871fc3aba192a9 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044330.709827:0:17196:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3975b7ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99a46fb7-9af9-40f1-9c76-329d6781ee81:17196:1870705581035392:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1784044330.709878:0:17196:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044330.710013:0:17196:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b39482cc900 going to sleep for 11 seconds 00000100:00100000:1.0:1784044330.710098:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581035392 00000100:00100000:1.0:1784044330.710106:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581035392 00000100:00100000:2.0:1784044330.710407:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1784044330.710419:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397d65f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99a46fb7-9af9-40f1-9c76-329d6781ee81+18:17196:x1870705581035392:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1784044330.710440:0:17193:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1784044330.710464:0:17193:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1784044330.710467:0:17193:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:2.0:1784044330.710580:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397d65f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99a46fb7-9af9-40f1-9c76-329d6781ee81+18:17196:x1870705581035392:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 161us (701us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044330.710588:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1784044330.710677:0:17196:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3975b7ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99a46fb7-9af9-40f1-9c76-329d6781ee81:17196:1870705581035392:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1784044330.710738:0:17196:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1784044330.710748:0:17196:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b3843799e00/0x89871fc3aba192a2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba192a9 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044330.710759:0:17196:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9b3843799e00/0x89871fc3aba192a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba192a9 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1784044330.894034:0:17952:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1784044331.031589:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784044331.474207:0:17242:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b394a323b40 going to sleep for 0 seconds 00010000:00010000:1.0:1784044332.045990:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784044332.496207:0:17242:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b394a323b40 going to sleep for 0 seconds 00010000:00010000:3.0:1784044333.070365:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784044333.530413:0:17242:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b394a323b40 going to sleep for 0 seconds 00010000:00010000:3.0:1784044334.097072:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784044334.160754:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3947ee9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1870705581035520:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1784044334.160841:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1784044334.161508:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1784044334.161513:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1784044334.161517:0:37:0:(import.c:65:import_set_state_nolock()) ffff9b3974dac800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784044334.161527:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9b3974dac800 using connection 192.168.202.140@tcp/0@lo 00000100:00100000:2.0:1784044334.161551:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b3975b7c380 x1870705581035776/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1784044334.161570:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1784044334.161574:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1784044334.161581:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1784044334.161584:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1784044334.161597:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1784044334.161600:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1784044334.161603:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1784044334.161606:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1784044334.161634:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3975b7d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:99a46fb7-9af9-40f1-9c76-329d6781ee81:3640:1870705581035648:0@lo:400:kworker.0 00000100:00100000:2.0:1784044334.161672:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044334.161700:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784044334.161706:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3975b7ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1870705581035904:0@lo:400:kworker.0 00000100:00100000:2.0:1784044334.161733:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044334.161767:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581035648 00000100:00100000:2.0:1784044334.161787:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581035648 00000100:00100000:2.0:1784044334.161830:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1784044334.161840:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397d65e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99a46fb7-9af9-40f1-9c76-329d6781ee81+18:3640:x1870705581035648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784044334.161888:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397d65e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99a46fb7-9af9-40f1-9c76-329d6781ee81+18:3640:x1870705581035648:12345-0@lo:400:kworker.0 Request processed in 50us (215us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044334.161897:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1784044334.161957:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581035904 00000100:00100000:2.0:1784044334.161961:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581035904 00000100:00100000:2.0:1784044334.161991:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1784044334.161997:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3975b7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1870705581035904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784044334.162031:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3975b7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1870705581035904:12345-0@lo:400:kworker.0 Request processed in 34us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044334.162045:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1784044334.162081:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b3975b7ce00 x1870705581035904/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044350 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784044334.162095:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3975b7ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1870705581035904:0@lo:400:kworker.0 00000100:00100000:2.0:1784044334.162105:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3975b7d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:99a46fb7-9af9-40f1-9c76-329d6781ee81:3640:1870705581035648:0@lo:400:kworker.0 00000100:00100000:2.0:1784044334.162130:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3975b7f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1870705581036032:0@lo:400:kworker.0 00000100:00100000:2.0:1784044334.162153:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044334.162216:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581036032 00000100:00100000:2.0:1784044334.162219:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581036032 00000100:00100000:2.0:1784044334.162241:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1784044334.162247:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3975b7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1870705581036032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784044334.162282:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3975b7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1870705581036032:12345-0@lo:400:kworker.0 Request processed in 35us (127us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044334.162288:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1784044334.162309:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b3975b7f480 x1870705581036032/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044350 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784044334.162318:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3975b7f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1870705581036032:0@lo:400:kworker.0 00000100:00100000:0.0:1784044334.164553:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581035520 00000100:00100000:0.0:1784044334.164569:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581035520 00000100:00100000:0.0:1784044334.164627:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1784044334.164637:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3947ee8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1870705581035520:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1784044334.164674:0:17206:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1784044334.164751:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3947ee8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1870705581035520:12345-0@lo:41:osp-pre-0-1.0 Request processed in 116us (3909us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044334.164759:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1784044334.165333:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3947ee9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1870705581035520:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1784044334.165439:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3975b7c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1870705581035776:0@lo:38:kworker.0 00000100:00100000:3.0:1784044334.165489:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044334.165538:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581035776 00000100:00100000:3.0:1784044334.165542:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581035776 00000100:00100000:3.0:1784044334.165571:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1784044334.165587:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843ce7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3637:x1870705581035776:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1784044334.165613:0:17206:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 527 last 0 00000020:00000080:3.0:1784044334.165650:0:17206:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x89871fc3aba192b0 00000004:00100000:3.0:1784044334.165666:0:17206:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:3.0:1784044334.165673:0:17206:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:1.0:1784044334.182064:0:17206:0:(import.c:65:import_set_state_nolock()) ffff9b395820f800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1784044334.182287:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843ce7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3637:x1870705581035776:12345-0@lo:38:kworker.0 Request processed in 16696us (16795us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044334.182298:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:3.0:1784044334.184292:0:3637:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1784044334.184309:0:3637:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:3.0:1784044334.184315:0:3637:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1784044334.184319:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9b3974dac800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:3.0:1784044334.184349:0:3637:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 0000000012535f10): req@ffff9b3843ce4700 x1870705581027840/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784044334.184373:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3975b7c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1870705581035776:0@lo:38:kworker.0 00000100:00100000:3.0:1784044334.184487:0:17242:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044334.184536:0:17242:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b394a323b40 going to sleep for 11 seconds 00000100:00100000:3.0:1784044334.184559:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581027840 00000100:00100000:3.0:1784044334.184566:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581027840 00000100:00100000:3.0:1784044334.184618:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1784044334.184628:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843ce6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17242:x1870705581027840:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1784044334.184707:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843ce6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17242:x1870705581027840:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 80us (221us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044334.184714:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1784044334.184744:0:17242:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843ce4700 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17242:1870705581027840:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1784044334.185008:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784044334.185022:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3947eea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1870705581036160:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1784044334.185060:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044334.185091:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581036160 00000100:00100000:0.0:1784044334.185096:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581036160 00000100:00100000:0.0:1784044334.185113:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1784044334.185118:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3947ee8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3638:x1870705581036160:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1784044334.185145:0:17205:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1784044334.185196:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3947ee8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3638:x1870705581036160:12345-0@lo:41:osp-pre-1-0.0 Request processed in 76us (135us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044334.185213:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1784044334.185242:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3947eea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1870705581036160:0@lo:41:osp-pre-1-0.0 00000040:01000000:3.0:1784044334.185374:0:17242:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:3.0:1784044334.185425:0:17242:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843ce4700 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17242:1870705581036288:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1784044334.185461:0:17242:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044334.185504:0:17242:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3942ab0240 going to sleep for 11 seconds 00000100:00100000:3.0:1784044334.185521:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581036288 00000100:00100000:3.0:1784044334.185526:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581036288 00000100:00100000:3.0:1784044334.185547:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1784044334.185554:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843ce7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17242:x1870705581036288:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1784044334.185682:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843ce7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17242:x1870705581036288:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 129us (220us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044334.185688:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1784044334.185710:0:17242:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843ce4700 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17242:1870705581036288:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1784044334.185778:0:17242:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843ce4700 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17242:1870705581036416:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1784044334.185804:0:17242:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044334.185813:0:17242:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b395205a180 going to sleep for 11 seconds 00000100:00100000:3.0:1784044334.185825:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581036416 00000100:00100000:3.0:1784044334.185828:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581036416 00000100:00100000:3.0:1784044334.185845:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1784044334.185849:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843ce4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17242:x1870705581036416:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1784044334.185890:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843ce4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17242:x1870705581036416:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 40us (85us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044334.185896:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1784044334.185914:0:17242:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843ce4700 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17242:1870705581036416:0@lo:1000:lod0000_rec0001.0 00000040:00080000:3.0:1784044334.186160:0:17242:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1784044334.190603:0:17242:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1784044334.190695:0:17242:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 21, retries 0 00000004:00080000:3.0:1784044334.190699:0:17242:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000001:02000400:1.0:1784044334.219786:0:18200:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg240-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1784044335.117664:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1784044335.122004:0:18253:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1784044335.122790:0:18253:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000040:00080000:3.0:1784044335.502706:0:17236:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:00000004:2.0:1784044336.075716:0:18304:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1784044336.075996:0:18304:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1784044336.150790:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784044337.165551:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784044337.236553:0:3637:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1784044322/real 1784044322] req@ffff9b3947ee8000 x1870705581028992/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1784044337 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784044337.236601:0:3637:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9b3947ee8000 x1870705581028992/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1784044337 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784044337.236613:0:3637:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1784044322/real 1784044322] req@ffff9b3947eebb80 x1870705581028864/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1784044337 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784044337.236626:0:3637:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9b3947eebb80 x1870705581028864/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1784044337 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1784044337.236729:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9b397b804800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1784044337.236767:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1784044337.236772:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3947ee8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1870705581028992:0@lo:8:kworker.0 00000100:00080000:3.0:1784044337.236778:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9b396f25c000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1784044337.236785:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1784044337.236788:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3947eebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1870705581028864:0@lo:8:kworker.0 00000100:00080000:1.0:1784044337.237003:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1784044337.237008:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1784044337.237011:0:37:0:(import.c:65:import_set_state_nolock()) ffff9b396f25c000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784044337.237017:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 515 00000100:00080000:1.0:1784044337.237024:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1784044337.237033:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9b396f25c000 using connection 192.168.202.140@tcp/0@lo 00000100:00100000:1.0:1784044337.237060:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b3843736a00 x1870705581036800/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1784044337.237073:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1784044337.237076:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1784044337.237078:0:37:0:(import.c:65:import_set_state_nolock()) ffff9b397b804800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784044337.237081:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 515 00000100:00080000:1.0:1784044337.237084:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1784044337.237088:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9b397b804800 using connection 192.168.202.140@tcp/0@lo 00000100:00100000:1.0:1784044337.237101:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b3843735500 x1870705581036928/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1784044337.237137:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1784044337.237141:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1784044337.237155:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1784044337.237158:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1784044337.237227:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843735c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1870705581037056:0@lo:400:kworker.0 00000100:00100000:1.0:1784044337.237314:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044337.237358:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784044337.237365:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843737800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1870705581037184:0@lo:400:kworker.0 00000100:00100000:2.0:1784044337.237625:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843737100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:99a46fb7-9af9-40f1-9c76-329d6781ee81:3640:1870705581036544:0@lo:400:kworker.0 00000100:00100000:2.0:1784044337.237690:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044337.237730:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b38436a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1870705581037312:0@lo:400:kworker.0 00000100:00100000:2.0:1784044337.237754:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044337.237775:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784044337.237781:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843737480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1870705581036672:0@lo:400:kworker.0 00000100:00100000:2.0:1784044337.237819:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581036544 00000100:00100000:2.0:1784044337.237829:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581036544 00000100:00100000:2.0:1784044337.237886:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1784044337.237898:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397d65f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99a46fb7-9af9-40f1-9c76-329d6781ee81+18:3640:x1870705581036544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784044337.237982:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397d65f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99a46fb7-9af9-40f1-9c76-329d6781ee81+18:3640:x1870705581036544:12345-0@lo:400:kworker.0 Request processed in 85us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044337.237989:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1784044337.238025:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581037056 00000100:00100000:2.0:1784044337.238029:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581037056 00000100:00100000:2.0:1784044337.238055:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581037312 00000100:00100000:2.0:1784044337.238057:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581037312 00000100:00100000:2.0:1784044337.238069:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1784044337.238074:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38436a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1870705581037056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784044337.238106:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38436a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1870705581037056:12345-0@lo:400:kworker.0 Request processed in 32us (793us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044337.238112:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1784044337.238122:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1784044337.238126:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3975b7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1870705581037312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784044337.238150:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3975b7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1870705581037312:12345-0@lo:400:kworker.0 Request processed in 23us (395us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044337.238155:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1784044337.238522:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843736a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1870705581036800:0@lo:8:kworker.0 00000400:00000100:3.0:1784044337.238559:0:3637:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1870705581036800 offset 0 length 520: 4 00000100:00100000:3.0:1784044337.238580:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843735500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1870705581036928:0@lo:8:kworker.0 00000400:00000100:3.0:1784044337.238603:0:3637:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1870705581036928 offset 0 length 520: 4 00000100:00100000:1.0:1784044337.238719:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1784044337.238790:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b3843735c00 x1870705581037056/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044353 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784044337.238808:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843735c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1870705581037056:0@lo:400:kworker.0 00000100:00100000:2.0:1784044337.240031:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044337.240103:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843737100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:99a46fb7-9af9-40f1-9c76-329d6781ee81:3640:1870705581036544:0@lo:400:kworker.0 00010000:00080000:2.0:1784044337.240124:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b38436a3480 x1870705581037312/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044353 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784044337.240135:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b38436a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1870705581037312:0@lo:400:kworker.0 00000100:00100000:3.0:1784044337.240275:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581037184 00000100:00100000:3.0:1784044337.240285:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581037184 00000100:00100000:3.0:1784044337.240335:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581036672 00000100:00100000:3.0:1784044337.240338:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581036672 00000100:00100000:3.0:1784044337.240380:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1784044337.240388:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38436a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1870705581037184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044337.240484:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38436a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1870705581037184:12345-0@lo:400:kworker.0 Request processed in 96us (1765us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044337.240492:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1784044337.240514:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1784044337.240522:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3975b7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3640:x1870705581036672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044337.240556:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3975b7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3640:x1870705581036672:12345-0@lo:400:kworker.0 Request processed in 35us (532us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044337.240561:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1784044337.240718:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843737800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1870705581037184:0@lo:400:kworker.0 00000100:00100000:2.0:1784044337.240751:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843737480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1870705581036672:0@lo:400:kworker.0 00000020:00000080:0.0:1784044337.682660:0:18352:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe89d4e870 20000000:00000080:0.0:1784044337.682695:0:18352:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9b397029d800 uarg=0000000000000000 20000000:01000000:0.0:1784044337.682777:0:18352:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:0.0:1784044337.682786:0:18352:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:0.0:1784044337.682793:0:18352:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:0.0:1784044337.683743:0:18353:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 13 20000000:00000400:1.0:1784044337.684061:0:18352:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:1.0:1784044337.690114:0:18352:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1784044337.690438:0:18352:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b38426fc200/0x89871fc3aba192b7 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044337.690467:0:18352:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b3843798400/0x89871fc3aba19160 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x89871fc3aba19159 expref: 17 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044337.690476:0:18352:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b38426fd400/0x89871fc3aba19263 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x89871fc3aba1925c expref: 17 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044337.690486:0:18352:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b38426fc200/0x89871fc3aba192b7 lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 18352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044337.690546:0:18352:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b38426fd400/0x89871fc3aba19263 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x89871fc3aba1925c expref: 17 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044337.690561:0:18352:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b38426fd400/0x89871fc3aba19263 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x89871fc3aba1925c expref: 17 pid: 17194 timeout: 630 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044337.690598:0:18352:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b38436a2680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18352:1870705581037440:0@lo:104: 00000100:00100000:1.0:1784044337.690683:0:18352:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1784044337.690757:0:18352:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b3843798400/0x89871fc3aba19160 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x89871fc3aba19159 expref: 17 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044337.690765:0:18352:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b3843798400/0x89871fc3aba19160 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x89871fc3aba19159 expref: 17 pid: 17193 timeout: 630 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044337.690774:0:18352:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b38436a3100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18352:1870705581037568:0@lo:104: 00000100:00100000:1.0:1784044337.690792:0:18352:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044337.690815:0:18352:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3843df7600 going to sleep for 11 seconds 00000100:00100000:0.0:1784044337.690870:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581037440 00000100:00100000:0.0:1784044337.690879:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581037440 00000100:00100000:0.0:1784044337.690935:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581037568 00000100:00100000:0.0:1784044337.690938:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581037568 00000100:00100000:0.0:1784044337.690952:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1784044337.690961:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38436a0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:99a46fb7-9af9-40f1-9c76-329d6781ee81+4:18352:x1870705581037440:12345-0@lo:104: 00010000:00010000:0.0:1784044337.690976:0:17182:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.140@tcp lock: ffff9b38410b7c00/0x89871fc3aba1925c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x89871fc3aba19263 expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044337.691040:0:17182:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1784044337.691046:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38436a0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:99a46fb7-9af9-40f1-9c76-329d6781ee81+4:18352:x1870705581037440:12345-0@lo:104: Request processed in 86us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044337.691053:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1784044337.691070:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1784044337.691075:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38436a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:99a46fb7-9af9-40f1-9c76-329d6781ee81+3:18352:x1870705581037568:12345-0@lo:104: 00010000:00010000:0.0:1784044337.691082:0:17182:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.140@tcp lock: ffff9b38426fc400/0x89871fc3aba19159 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x89871fc3aba19160 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044337.691110:0:17182:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1784044337.691115:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38436a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:99a46fb7-9af9-40f1-9c76-329d6781ee81+3:18352:x1870705581037568:12345-0@lo:104: Request processed in 40us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044337.691120:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1784044337.691257:0:18352:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b38436a2680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18352:1870705581037440:0@lo:104: 00000100:00100000:1.0:1784044337.691266:0:18352:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b38436a3100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18352:1870705581037568:0@lo:104: 00010000:00010000:1.0:1784044337.691290:0:18352:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b38426fc200/0x89871fc3aba192b7 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044337.691629:0:17188:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1784044337.691639:0:17188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: ffff9b38410b7c00/0x89871fc3aba1925c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x89871fc3aba19263 expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044337.691650:0:17188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38410b7c00 already unused, calling callback (ffffffffc113cc20) 10000000:00010000:3.0:1784044337.691658:0:17188:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: ffff9b38410b7c00/0x89871fc3aba1925c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x89871fc3aba19263 expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044337.691667:0:17188:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9b38410b7c00/0x89871fc3aba1925c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x89871fc3aba19263 expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784044337.691675:0:17188:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9b38410b7c00/0x89871fc3aba1925c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x89871fc3aba19263 expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784044337.691681:0:17188:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1784044337.691730:0:17188:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.140@tcp lock: ffff9b38410b7c00/0x89871fc3aba1925c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x89871fc3aba19263 expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044337.691737:0:17188:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784044337.691786:0:17188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: ffff9b38410b7c00/0x89871fc3aba1925c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x89871fc3aba19263 expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044337.691794:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9b38410b7c00/0x89871fc3aba1925c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x89871fc3aba19263 expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044337.691811:0:17188:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784044337.691815:0:17188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: ffff9b38426fc400/0x89871fc3aba19159 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x89871fc3aba19160 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044337.691821:0:17188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38426fc400 already unused, calling callback (ffffffffc113cc20) 10000000:00010000:3.0:1784044337.691824:0:17188:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: ffff9b38426fc400/0x89871fc3aba19159 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x89871fc3aba19160 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044337.691831:0:17188:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9b38426fc400/0x89871fc3aba19159 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x89871fc3aba19160 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784044337.691837:0:17188:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9b38426fc400/0x89871fc3aba19159 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x89871fc3aba19160 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784044337.691843:0:17188:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1784044337.691856:0:17188:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.140@tcp lock: ffff9b38426fc400/0x89871fc3aba19159 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x89871fc3aba19160 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044337.691863:0:17188:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784044337.691880:0:17188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: ffff9b38426fc400/0x89871fc3aba19159 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x89871fc3aba19160 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044337.691888:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9b38426fc400/0x89871fc3aba19159 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x89871fc3aba19160 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044337.691924:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784044337.691926:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784044337.691928:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784044337.691938:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784044337.691954:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843ce4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:99a46fb7-9af9-40f1-9c76-329d6781ee81:3640:1870705581037696:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784044337.692004:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044337.692047:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843ce5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:99a46fb7-9af9-40f1-9c76-329d6781ee81:3638:1870705581037824:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784044337.692068:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044337.692120:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581037696 00000100:00100000:3.0:1784044337.692125:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581037696 00010000:00010000:3.0:1784044337.692153:0:17185:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b38426fd400/0x89871fc3aba19263 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x89871fc3aba1925c expref: 18 pid: 17194 timeout: 630 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044337.692208:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581037824 00000100:00100000:3.0:1784044337.692212:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581037824 00010000:00010000:3.0:1784044337.692232:0:17185:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b3843798400/0x89871fc3aba19160 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x89871fc3aba19159 expref: 19 pid: 17193 timeout: 630 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044337.692248:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1784044337.692256:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843ce5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:99a46fb7-9af9-40f1-9c76-329d6781ee81+19:3640:x1870705581037696:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784044337.692269:0:17185:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784044337.692276:0:17185:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b38426fd400/0x89871fc3aba19263 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x89871fc3aba1925c expref: 19 pid: 17194 timeout: 630 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044337.692287:0:17185:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b38426fd400/0x89871fc3aba19263 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x89871fc3aba1925c expref: 19 pid: 17194 timeout: 630 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044337.692303:0:17185:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b38426fd400/0x89871fc3aba19263 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x89871fc3aba1925c expref: 19 pid: 17194 timeout: 630 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044337.692327:0:17185:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784044337.692360:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843ce5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:99a46fb7-9af9-40f1-9c76-329d6781ee81+18:3640:x1870705581037696:12345-0@lo:103:ldlm_bl.0 Request processed in 104us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044337.692368:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1784044337.692387:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1784044337.692393:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843ce4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:99a46fb7-9af9-40f1-9c76-329d6781ee81+17:3638:x1870705581037824:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784044337.692400:0:17185:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784044337.692404:0:17185:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b3843798400/0x89871fc3aba19160 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x89871fc3aba19159 expref: 17 pid: 17193 timeout: 630 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044337.692414:0:17185:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b3843798400/0x89871fc3aba19160 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x89871fc3aba19159 expref: 17 pid: 17193 timeout: 630 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044337.692424:0:17185:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b3843798400/0x89871fc3aba19160 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x89871fc3aba19159 expref: 17 pid: 17193 timeout: 630 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044337.692437:0:17185:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b38426fc200/0x89871fc3aba192b7 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 18352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044337.692445:0:17185:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b38426fc200/0x89871fc3aba192b7 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 18352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044337.692461:0:17185:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b38426fc200/0x89871fc3aba192b7 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044337.692469:0:17185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b38426fc200/0x89871fc3aba192b7 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044337.692477:0:17185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b38426fc200/0x89871fc3aba192b7 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044337.692488:0:17185:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b38426fc200/0x89871fc3aba192b7 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044337.692494:0:17185:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38426fc200 already unused, calling callback (ffffffffc0b56230) 00010000:00010000:3.0:1784044337.692500:0:17185:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b38426fc200/0x89871fc3aba192b7 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044337.692507:0:17185:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b38426fc200/0x89871fc3aba192b7 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 18352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044337.692520:0:17185:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b38426fc200/0x89871fc3aba192b7 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044337.692530:0:17185:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784044337.692558:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843ce4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:99a46fb7-9af9-40f1-9c76-329d6781ee81+16:3638:x1870705581037824:12345-0@lo:103:ldlm_bl.0 Request processed in 165us (488us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044337.692564:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1784044337.692601:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843ce5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:99a46fb7-9af9-40f1-9c76-329d6781ee81:3638:1870705581037824:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784044337.692622:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843ce4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:99a46fb7-9af9-40f1-9c76-329d6781ee81:3640:1870705581037696:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784044337.692655:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784044337.692783:0:18352:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b38426fc200/0x89871fc3aba192b7 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044337.692792:0:18352:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b38426fc200/0x89871fc3aba192b7 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044337.692799:0:18352:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b38426fc200/0x89871fc3aba192b7 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044338.193445:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784044338.255745:0:3637:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1784044328/real 1784044328] req@ffff9b3975b7d880 x1870705581031424/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1784044338 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784044338.255811:0:3637:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9b3975b7d880 x1870705581031424/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1784044338 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784044338.255823:0:3637:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1784044328/real 1784044328] req@ffff9b3975b7c000 x1870705581031296/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1784044338 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784044338.255835:0:3637:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9b3975b7c000 x1870705581031296/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1784044338 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1784044338.255864:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9b3944fd3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1784044338.258746:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1784044338.258765:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3975b7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1870705581031424:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1784044338.258783:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9b3970ff4800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1784044338.258794:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1784044338.258798:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3975b7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1870705581031296:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1784044338.259203:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1784044338.259209:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1784044338.259232:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1784044338.259235:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1784044338.259255:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1784044338.259259:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1784044338.259262:0:37:0:(import.c:65:import_set_state_nolock()) ffff9b3970ff4800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784044338.259269:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 521 00000100:00080000:1.0:1784044338.259277:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1784044338.259285:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9b3970ff4800 using connection 192.168.202.140@tcp/0@lo 00000100:00100000:1.0:1784044338.259316:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b38436a2300 x1870705581038464/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1784044338.259334:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1784044338.259337:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1784044338.259339:0:37:0:(import.c:65:import_set_state_nolock()) ffff9b3944fd3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784044338.259343:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 521 00000100:00080000:1.0:1784044338.259345:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1784044338.259349:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9b3944fd3800 using connection 192.168.202.140@tcp/0@lo 00000100:00100000:1.0:1784044338.259362:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b38436a0000 x1870705581038592/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1784044338.259502:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b38436a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:99a46fb7-9af9-40f1-9c76-329d6781ee81:3639:1870705581037952:0@lo:400:kworker.0 00000100:00100000:1.0:1784044338.259603:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044338.259668:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b38436a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3639:1870705581038720:0@lo:400:kworker.0 00000100:00100000:1.0:1784044338.259698:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044338.259727:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1784044338.259734:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b38436a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1870705581038336:0@lo:400:kworker.0 00000100:00100000:1.0:1784044338.259771:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044338.259807:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b38436a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1870705581038080:0@lo:400:kworker.0 00000100:00100000:1.0:1784044338.259835:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044338.259855:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784044338.259862:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b38436a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1870705581038208:0@lo:400:kworker.0 00000100:00100000:1.0:1784044338.259888:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044338.259937:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581037952 00000100:00100000:1.0:1784044338.259946:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581037952 00000100:00100000:1.0:1784044338.260007:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1784044338.260018:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397d65d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99a46fb7-9af9-40f1-9c76-329d6781ee81+16:3639:x1870705581037952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044338.260082:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397d65d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99a46fb7-9af9-40f1-9c76-329d6781ee81+16:3639:x1870705581037952:12345-0@lo:400:kworker.0 Request processed in 65us (478us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044338.260090:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1784044338.260130:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581038336 00000100:00100000:1.0:1784044338.260135:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581038336 00000100:00100000:1.0:1784044338.260154:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581038080 00000100:00100000:1.0:1784044338.260157:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581038080 00000100:00100000:1.0:1784044338.260222:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1784044338.260230:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38436a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1870705581038336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044338.260268:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38436a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1870705581038336:12345-0@lo:400:kworker.0 Request processed in 39us (497us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044338.260275:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1784044338.260288:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1784044338.260294:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38436a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3640:x1870705581038080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044338.260329:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38436a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3640:x1870705581038080:12345-0@lo:400:kworker.0 Request processed in 34us (492us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044338.260347:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1784044338.260392:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b38436a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1870705581038080:0@lo:400:kworker.0 00000100:00100000:1.0:1784044338.260422:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b38436a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1870705581038336:0@lo:400:kworker.0 00000100:00100000:1.0:1784044338.260432:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b38436a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:99a46fb7-9af9-40f1-9c76-329d6781ee81:3639:1870705581037952:0@lo:400:kworker.0 00000100:00100000:1.0:1784044338.260451:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b38436a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1870705581038464:0@lo:8:kworker.0 00000400:00000100:1.0:1784044338.260480:0:3637:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1870705581038464 offset 0 length 520: 4 00000100:00100000:1.0:1784044338.260495:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b38436a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1870705581038592:0@lo:8:kworker.0 00000400:00000100:1.0:1784044338.260537:0:3637:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1870705581038592 offset 0 length 520: 4 00000100:00100000:2.0:1784044338.261553:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581038720 00000100:00100000:2.0:1784044338.261566:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581038720 00000100:00100000:2.0:1784044338.261649:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581038208 00000100:00100000:2.0:1784044338.261653:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581038208 00000100:00100000:2.0:1784044338.261674:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1784044338.261684:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38436a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1870705581038720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784044338.261775:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38436a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1870705581038720:12345-0@lo:400:kworker.0 Request processed in 93us (2076us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044338.261782:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1784044338.261799:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1784044338.261805:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38436a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1870705581038208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784044338.261842:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38436a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1870705581038208:12345-0@lo:400:kworker.0 Request processed in 38us (1953us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044338.261848:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:2.0:1784044338.261938:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b38436a3b80 x1870705581038208/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044354 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784044338.261955:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b38436a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1870705581038208:0@lo:400:kworker.0 00010000:00080000:2.0:1784044338.262017:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b38436a1c00 x1870705581038720/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044354 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784044338.262298:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b38436a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3639:1870705581038720:0@lo:400:kworker.0 10000000:01000000:2.0:1784044339.085409:0:17196:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1784044339.085420:0:17196:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9b396f25a800 from 13 10000000:01000000:2.0:1784044339.085427:0:17196:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1784044339.085510:0:17196:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b3843798400/0x89871fc3aba192be lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044339.085526:0:17196:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9b3843798400/0x89871fc3aba192be lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044339.085552:0:17196:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9b3843798400/0x89871fc3aba192be lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044339.085595:0:17196:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3975b7df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99a46fb7-9af9-40f1-9c76-329d6781ee81:17196:1870705581038848:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1784044339.085715:0:17196:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044339.085781:0:17196:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b397a881540 going to sleep for 11 seconds 00000100:00100000:0.0:1784044339.085914:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581038848 00000100:00100000:0.0:1784044339.085927:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581038848 00000100:00100000:0.0:1784044339.086000:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1784044339.086011:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397d65c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99a46fb7-9af9-40f1-9c76-329d6781ee81+16:17196:x1870705581038848:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784044339.086037:0:17193:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784044339.086055:0:17193:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b38410b6200/0x89871fc3aba192c5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x89871fc3aba192be expref: -99 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044339.086085:0:17193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b38410b6200/0x89871fc3aba192c5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x89871fc3aba192be expref: 17 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044339.086098:0:17193:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b38410b6200/0x89871fc3aba192c5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x89871fc3aba192be expref: 17 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044339.086123:0:17193:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b38410b6200, rc 0) 00000100:00100000:0.0:1784044339.086220:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397d65c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99a46fb7-9af9-40f1-9c76-329d6781ee81+17:17196:x1870705581038848:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 210us (505us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044339.086228:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1784044339.086762:0:17196:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3975b7df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99a46fb7-9af9-40f1-9c76-329d6781ee81:17196:1870705581038848:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784044339.086785:0:17196:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9b3843798400/0x89871fc3aba192be lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba192c5 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044339.086797:0:17196:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9b3843798400/0x89871fc3aba192be lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x89871fc3aba192c5 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044339.086893:0:17196:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3975b7df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99a46fb7-9af9-40f1-9c76-329d6781ee81:17196:1870705581038976:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784044339.086947:0:17196:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044339.087002:0:17196:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b397a881540 going to sleep for 11 seconds 00000100:00100000:1.0:1784044339.087242:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581038976 00000100:00100000:1.0:1784044339.087249:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581038976 00000100:00100000:1.0:1784044339.087292:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1784044339.087301:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397d65cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99a46fb7-9af9-40f1-9c76-329d6781ee81+17:17196:x1870705581038976:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784044339.087460:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397d65cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99a46fb7-9af9-40f1-9c76-329d6781ee81+17:17196:x1870705581038976:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 159us (512us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044339.087468:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1784044339.087570:0:17196:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3975b7df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99a46fb7-9af9-40f1-9c76-329d6781ee81:17196:1870705581038976:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784044339.087611:0:17196:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3975b7df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99a46fb7-9af9-40f1-9c76-329d6781ee81:17196:1870705581039104:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784044339.087672:0:17196:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044339.087693:0:17196:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b397a881540 going to sleep for 11 seconds 00000100:00100000:1.0:1784044339.087851:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581039104 00000100:00100000:1.0:1784044339.087857:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581039104 00000100:00100000:1.0:1784044339.087891:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1784044339.087909:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397d65d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99a46fb7-9af9-40f1-9c76-329d6781ee81+17:17196:x1870705581039104:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784044339.088008:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397d65d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99a46fb7-9af9-40f1-9c76-329d6781ee81+17:17196:x1870705581039104:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 109us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044339.088014:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1784044339.090095:0:17196:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3975b7df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99a46fb7-9af9-40f1-9c76-329d6781ee81:17196:1870705581039104:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1784044339.095555:0:18400:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1784044339.095947:0:17196:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1784044339.095978:0:17196:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1784044339.095992:0:17196:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b3843798400/0x89871fc3aba192be lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba192c5 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044339.096007:0:17196:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9b3843798400/0x89871fc3aba192be lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba192c5 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784044339.096042:0:17196:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1784044339.096045:0:17196:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9b397a8e8000 from 13 10000000:01000000:3.0:1784044339.096049:0:17196:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1784044339.096104:0:17196:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b3982055200/0x89871fc3aba192cc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044339.096113:0:17196:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9b3982055200/0x89871fc3aba192cc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044339.096126:0:17196:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9b3982055200/0x89871fc3aba192cc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044339.096170:0:17196:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843ce4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99a46fb7-9af9-40f1-9c76-329d6781ee81:17196:1870705581039232:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784044339.096304:0:17196:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044339.096360:0:17196:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b39455b1780 going to sleep for 11 seconds 00000100:00100000:1.0:1784044339.096754:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581039232 00000100:00100000:1.0:1784044339.096764:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581039232 00000100:00100000:1.0:1784044339.096830:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1784044339.096842:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3942b86850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99a46fb7-9af9-40f1-9c76-329d6781ee81+17:17196:x1870705581039232:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784044339.096859:0:17193:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784044339.096877:0:17193:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b38426fc000/0x89871fc3aba192d3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x89871fc3aba192cc expref: -99 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044339.096908:0:17193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b38426fc000/0x89871fc3aba192d3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x89871fc3aba192cc expref: 18 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044339.096923:0:17193:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b38426fc000/0x89871fc3aba192d3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x89871fc3aba192cc expref: 18 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044339.096935:0:17193:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b38426fc000, rc 0) 00000100:00100000:1.0:1784044339.096996:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3942b86850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99a46fb7-9af9-40f1-9c76-329d6781ee81+18:17196:x1870705581039232:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 156us (693us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044339.097004:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1784044339.097333:0:17196:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843ce4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99a46fb7-9af9-40f1-9c76-329d6781ee81:17196:1870705581039232:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784044339.097352:0:17196:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9b3982055200/0x89871fc3aba192cc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba192d3 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044339.097363:0:17196:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9b3982055200/0x89871fc3aba192cc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x89871fc3aba192d3 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044339.097449:0:17196:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b38436a3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99a46fb7-9af9-40f1-9c76-329d6781ee81:17196:1870705581039360:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784044339.097483:0:17196:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044339.097565:0:17196:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3843df7000 going to sleep for 11 seconds 00000100:00100000:0.0:1784044339.100537:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581039360 00000100:00100000:0.0:1784044339.100564:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581039360 00000100:00100000:0.0:1784044339.100792:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1784044339.100809:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3975b97450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99a46fb7-9af9-40f1-9c76-329d6781ee81+18:17196:x1870705581039360:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784044339.101231:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3975b97450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99a46fb7-9af9-40f1-9c76-329d6781ee81+18:17196:x1870705581039360:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 425us (3743us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044339.101241:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1784044339.104835:0:17196:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b38436a3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99a46fb7-9af9-40f1-9c76-329d6781ee81:17196:1870705581039360:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784044339.105353:0:17196:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b38436a3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99a46fb7-9af9-40f1-9c76-329d6781ee81:17196:1870705581039488:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784044339.105473:0:17196:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044339.106082:0:17196:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3843df7000 going to sleep for 11 seconds 00000100:00100000:1.0:1784044339.106122:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581039488 00000100:00100000:1.0:1784044339.106130:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581039488 00000100:00100000:1.0:1784044339.106446:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1784044339.106457:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3975b94850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99a46fb7-9af9-40f1-9c76-329d6781ee81+18:17196:x1870705581039488:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784044339.106650:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3975b94850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99a46fb7-9af9-40f1-9c76-329d6781ee81+18:17196:x1870705581039488:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 195us (1176us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044339.106660:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1784044339.106735:0:17196:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b38436a3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99a46fb7-9af9-40f1-9c76-329d6781ee81:17196:1870705581039488:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1784044339.107504:0:18402:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1784044339.107585:0:17196:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1784044339.107612:0:17196:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1784044339.107625:0:17196:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b3982055200/0x89871fc3aba192cc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba192d3 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044339.107638:0:17196:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9b3982055200/0x89871fc3aba192cc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba192d3 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044339.221846:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784044339.277908:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b38436a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1870705581039616:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1784044339.278032:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044339.278637:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581039616 00000100:00100000:1.0:1784044339.278651:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581039616 00000100:00100000:1.0:1784044339.278745:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1784044339.278757:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3975b7df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1870705581039616:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1784044339.278808:0:17205:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1784044339.278907:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3975b7df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1870705581039616:12345-0@lo:41:osp-pre-0-1.0 Request processed in 151us (875us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044339.278916:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1784044339.279151:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b38436a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1870705581039616:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1784044339.294353:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784044339.294392:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3975b7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1870705581039744:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1784044339.294507:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044339.295639:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581039744 00000100:00100000:2.0:1784044339.295655:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581039744 00000100:00100000:2.0:1784044339.295758:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1784044339.295772:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3947eea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3640:x1870705581039744:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1784044339.295828:0:17206:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1784044339.296296:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3947eea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3640:x1870705581039744:12345-0@lo:41:osp-pre-1-0.0 Request processed in 526us (1788us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044339.296306:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1784044339.296428:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3975b7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1870705581039744:0@lo:41:osp-pre-1-0.0 00000001:00100000:2.0:1784044339.810411:0:17933:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000040:00080000:0.0:1784044340.109973:0:17952:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1784044340.240800:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784044341.261354:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784044342.287008:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784044343.313562:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1784044343.373356:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1784044343.373364:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1784044343.373367:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1784044343.373370:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1784044343.373397:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1784044343.373400:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1784044343.373402:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1784044343.373405:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1784044343.373437:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b38436a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1870705581040000:0@lo:400:kworker.0 00000100:00100000:1.0:1784044343.373511:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044343.373576:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b38436a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:99a46fb7-9af9-40f1-9c76-329d6781ee81:3638:1870705581039872:0@lo:400:kworker.0 00000100:00100000:1.0:1784044343.373586:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b38436a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1870705581040128:0@lo:400:kworker.0 00000100:00100000:0.0:1784044343.373616:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044343.373619:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044343.373645:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b38436a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1870705581040384:0@lo:400:kworker.0 00000100:00100000:1.0:1784044343.373647:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784044343.373651:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b38436a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1870705581040256:0@lo:400:kworker.0 00000100:00100000:1.0:1784044343.373672:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044343.373672:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044343.373703:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581040000 00000100:00100000:0.0:1784044343.373703:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581039872 00000100:00100000:1.0:1784044343.373712:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581040000 00000100:00100000:0.0:1784044343.373712:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581039872 00000100:00100000:1.0:1784044343.373748:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581040256 00000100:00100000:1.0:1784044343.373750:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581040256 00000100:00100000:0.0:1784044343.373755:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1784044343.373762:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1784044343.373763:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3975b94450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99a46fb7-9af9-40f1-9c76-329d6781ee81+18:3638:x1870705581039872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044343.373767:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38436a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1870705581040000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044343.373812:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38436a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1870705581040000:12345-0@lo:400:kworker.0 Request processed in 43us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044343.373812:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3975b94450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99a46fb7-9af9-40f1-9c76-329d6781ee81+18:3638:x1870705581039872:12345-0@lo:400:kworker.0 Request processed in 48us (193us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044343.373819:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1784044343.373822:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1784044343.373834:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1784044343.373839:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38436a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1870705581040256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784044343.373852:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581040128 00000100:00100000:0.0:1784044343.373856:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581040128 00000100:00100000:1.0:1784044343.373869:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38436a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1870705581040256:12345-0@lo:400:kworker.0 Request processed in 29us (196us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044343.373875:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1784044343.373881:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581040384 00000100:00100000:0.0:1784044343.373884:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581040384 00000100:00100000:1.0:1784044343.373892:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1784044343.373898:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38436a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1870705581040128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044343.373943:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38436a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1870705581040128:12345-0@lo:400:kworker.0 Request processed in 42us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044343.374371:0:17201:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1784044343.374380:0:17201:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:0.0:1784044343.374617:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1784044343.374626:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3947ee9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1870705581040384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784044343.374662:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3947ee9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1870705581040384:12345-0@lo:400:kworker.0 Request processed in 39us (989us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044343.374668:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1784044343.374712:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b38436a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:99a46fb7-9af9-40f1-9c76-329d6781ee81:3638:1870705581039872:0@lo:400:kworker.0 00010000:00080000:0.0:1784044343.374726:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b38436a3100 x1870705581040384/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044359 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784044343.374737:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b38436a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1870705581040384:0@lo:400:kworker.0 00000100:00100000:0.0:1784044343.374792:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b38436a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1870705581040000:0@lo:400:kworker.0 00000100:00100000:0.0:1784044343.374819:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b38436a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1870705581040256:0@lo:400:kworker.0 00010000:00080000:0.0:1784044343.374831:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b38436a1880 x1870705581040128/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044359 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784044343.374839:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b38436a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1870705581040128:0@lo:400:kworker.0 00000100:00100000:1.0:1784044343.376217:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:0.0:1784044344.333388:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784044344.398555:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3947eeb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1870705581040512:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1784044344.398802:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044344.398953:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581040512 00000100:00100000:1.0:1784044344.398963:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581040512 00000100:00100000:1.0:1784044344.399027:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1784044344.399039:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3947ee9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1870705581040512:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1784044344.399086:0:17205:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1784044344.399144:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3947ee9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1870705581040512:12345-0@lo:41:osp-pre-0-1.0 Request processed in 107us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044344.399151:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1784044344.399497:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3947eeb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1870705581040512:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1784044344.400752:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3947eeb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1870705581040640:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1784044344.400807:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044344.411537:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581040640 00000100:00100000:0.0:1784044344.411553:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581040640 00000100:00100000:1.0:1784044344.413303:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1784044344.413317:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3975b7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1870705581040640:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1784044344.413358:0:17206:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1784044344.415121:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3975b7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1870705581040640:12345-0@lo:41:osp-pre-1-0.0 Request processed in 1787us (14293us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044344.415144:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1784044344.433020:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3947eeb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1870705581040640:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1784044345.357393:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1784044345.748916:0:17236:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1784044346.382328:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1784044346.593221:0:18701:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1784044346.593225:0:18701:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:0.0:1784044346.593227:0:18701:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:0.0:1784044346.593354:0:18701:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9b3843fd5000 00000020:01000004:0.0:1784044346.593370:0:18701:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:0.0:1784044346.593385:0:18701:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1784044346.593398:0:18701:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9b3842114d40) 00000020:00000080:0.0:1784044346.593420:0:18701:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1784044346.708489:0:18701:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:1.0:1784044346.709440:0:18701:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:1.0:1784044346.710273:0:18701:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:1.0:1784044346.710653:0:18701:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:1.0:1784044346.711205:0:18701:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:1.0:1784044346.711729:0:18701:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:1.0:1784044346.711950:0:18701:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:01000000:1.0:1784044346.717445:0:18701:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1784044346.717783:0:18701:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:1.0:1784044346.717796:0:18701:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:1.0:1784044346.717808:0:18701:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x89871fc3aba192e1 00000020:01000004:1.0:1784044346.717814:0:18701:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:1.0:1784044346.717894:0:18701:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.140@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1784044346.717898:0:18701:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.140@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1784044346.717905:0:18701:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:1.0:1784044346.717910:0:18701:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:1.0:1784044346.717923:0:18701:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9b3974da0000) 00000020:00000080:1.0:1784044346.717934:0:18701:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type ost with refcount 2 00000100:00100000:1.0:1784044346.720435:0:18701:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1784044346.720625:0:18701:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:1.0:1784044346.720632:0:18701:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1784044346.737144:0:18701:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1784044346.737158:0:18701:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1784044346.737791:0:18701:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1784044346.737798:0:18701:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1784044346.745822:0:18701:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1784044346.746799:0:18701:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1784044346.746805:0:18701:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1784044346.750002:0:18701:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1784044346.750017:0:18701:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:2.0:1784044346.783716:0:18701:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1784044346.783962:0:18701:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1784044346.783979:0:18701:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1784044346.789056:0:18701:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1784044346.789073:0:18701:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1784044346.790254:0:18701:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1784044346.790265:0:18701:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1784044346.793392:0:18701:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1784044346.793993:0:18701:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1784044346.794002:0:18701:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1784044346.797542:0:18701:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1784044346.797572:0:18701:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:0.0:1784044346.860682:0:18701:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1784044346.860998:0:18701:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:0.0:1784044346.861005:0:18701:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:0.0:1784044346.871585:0:18701:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:0.0:1784044346.871605:0:18701:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:0.0:1784044346.872777:0:18701:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:0.0:1784044346.872813:0:18701:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:0.0:1784044346.872821:0:18701:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.140@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:3.0:1784044346.902145:0:18701:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.140@tcp ctxt 0 is initialized 00000020:01000004:3.0:1784044346.902999:0:18701:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.202.140@tcp, index=0000, flags=0x20002 00000020:01000004:3.0:1784044346.903005:0:18701:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1784044346.903007:0:18701:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1784044346.903009:0:18701:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1784044346.903010:0:18701:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1784044346.903011:0:18701:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1784044346.903012:0:18701:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1784044346.903013:0:18701:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1784044346.903015:0:18701:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1784044346.903016:0:18701:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1784044346.903021:0:18701:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:3.0:1784044346.903023:0:18701:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1784044346.903024:0:18701:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1784044346.903026:0:18701:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1784044346.903027:0:18701:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1784044346.903028:0:18701:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1784044346.903029:0:18701:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1784044346.903030:0:18701:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1784044346.903031:0:18701:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1784044346.903032:0:18701:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1784044346.903064:0:18701:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1784044346.903086:0:18701:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843ce5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99a46fb7-9af9-40f1-9c76-329d6781ee81:18701:1870705581040768:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1784044346.904452:0:18701:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044346.904567:0:18701:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b396f229e40 going to sleep for 11 seconds 00000100:00100000:2.0:1784044346.910133:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581040768 00000100:00100000:2.0:1784044346.910148:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581040768 00000100:00100000:2.0:1784044346.910242:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1784044346.910253:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3975b95050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99a46fb7-9af9-40f1-9c76-329d6781ee81+18:18701:x1870705581040768:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1784044346.910317:0:17194:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1784044346.910321:0:17194:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:2.0:1784044346.910326:0:17194:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1784044346.910770:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3975b95050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99a46fb7-9af9-40f1-9c76-329d6781ee81+18:18701:x1870705581040768:12345-0@lo:253:mount.lustre.0 Request processed in 519us (6322us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044346.910780:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1784044346.910891:0:18701:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843ce5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99a46fb7-9af9-40f1-9c76-329d6781ee81:18701:1870705581040768:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1784044346.910905:0:18701:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1784044346.910908:0:18701:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1784044346.910916:0:18701:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1784044346.910918:0:18701:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1784044346.910919:0:18701:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1784044346.910920:0:18701:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1784044346.910922:0:18701:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1784044346.910923:0:18701:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1784044346.910925:0:18701:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1784044346.910927:0:18701:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1784044346.910956:0:18701:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9b3843fd5000 from lustre-OST0000 10000000:01000000:3.0:1784044346.910984:0:18701:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:3.0:1784044346.910988:0:18701:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1784044346.910996:0:18701:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9b3842450000 local copy 00010000:00010000:3.0:1784044346.911007:0:18701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b38410b7000/0x89871fc3aba1909c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba190a3 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044346.911147:0:18701:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843ce5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99a46fb7-9af9-40f1-9c76-329d6781ee81:18701:1870705581040896:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1784044346.911228:0:18701:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044346.911256:0:18701:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b396f229540 going to sleep for 11 seconds 00000100:00100000:2.0:1784044346.911391:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581040896 00000100:00100000:2.0:1784044346.911397:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581040896 00000100:00100000:2.0:1784044346.911436:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1784044346.911444:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3975b95850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99a46fb7-9af9-40f1-9c76-329d6781ee81+18:18701:x1870705581040896:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784044346.911510:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3975b95850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99a46fb7-9af9-40f1-9c76-329d6781ee81+18:18701:x1870705581040896:12345-0@lo:501:mount.lustre.0 Request processed in 66us (283us total) trans 0 rc -2/-2 00000100:00100000:2.0:1784044346.911516:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1784044346.912151:0:18701:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843ce5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99a46fb7-9af9-40f1-9c76-329d6781ee81:18701:1870705581040896:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1784044346.912170:0:18701:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.140@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1784044346.912236:0:18701:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.140@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1784044346.912243:0:18701:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b38410b7000/0x89871fc3aba1909c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba190a3 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044346.912253:0:18701:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9b38410b7000/0x89871fc3aba1909c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba190a3 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784044346.912284:0:18701:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9b3843fd5000 10000000:01000000:3.0:1784044346.912289:0:18701:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1784044346.912294:0:18701:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1784044346.912297:0:18701:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1784044346.912311:0:18701:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1784044346.912314:0:18701:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1784044346.912342:0:18701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b3982055600/0x89871fc3aba192ef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044346.912351:0:18701:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9b3982055600/0x89871fc3aba192ef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044346.912360:0:18701:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9b3982055600/0x89871fc3aba192ef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044346.912374:0:18701:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843ce5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99a46fb7-9af9-40f1-9c76-329d6781ee81:18701:1870705581041024:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1784044346.912406:0:18701:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044346.912436:0:18701:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b396f229540 going to sleep for 11 seconds 00000100:00100000:2.0:1784044346.912501:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581041024 00000100:00100000:2.0:1784044346.912505:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581041024 00000100:00100000:2.0:1784044346.912556:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1784044346.912564:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3975b97850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99a46fb7-9af9-40f1-9c76-329d6781ee81+18:18701:x1870705581041024:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1784044346.912574:0:17192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784044346.912586:0:17192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b3843798200/0x89871fc3aba192f6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x89871fc3aba192ef expref: -99 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044346.912607:0:17192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b3843798200/0x89871fc3aba192f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x89871fc3aba192ef expref: 19 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044346.912630:0:17192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b3843798200/0x89871fc3aba192f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x89871fc3aba192ef expref: 19 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044346.912638:0:17192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3843798200, rc 0) 00000100:00100000:2.0:1784044346.912679:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3975b97850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99a46fb7-9af9-40f1-9c76-329d6781ee81+19:18701:x1870705581041024:12345-0@lo:101:mount.lustre.0 Request processed in 116us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044346.912685:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1784044346.912959:0:18701:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843ce5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99a46fb7-9af9-40f1-9c76-329d6781ee81:18701:1870705581041024:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1784044346.912972:0:18701:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9b3982055600/0x89871fc3aba192ef lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba192f6 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044346.912981:0:18701:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9b3982055600/0x89871fc3aba192ef lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x89871fc3aba192f6 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1784044346.914315:0:18701:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:3.0:1784044346.915043:0:18701:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1784044346.918018:0:18701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:3.0:1784044346.918075:0:18701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:3.0:1784044346.918104:0:18701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:3.0:1784044346.918121:0:18701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:3.0:1784044346.918135:0:18701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:3.0:1784044346.918149:0:18701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:3.0:1784044346.918266:0:18701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:3.0:1784044346.918280:0:18701:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:3.0:1784044346.918382:0:18701:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843ce5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99a46fb7-9af9-40f1-9c76-329d6781ee81:18701:1870705581041152:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1784044346.918450:0:18701:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044346.918563:0:18701:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b396f229f00 going to sleep for 11 seconds 00000100:00100000:2.0:1784044346.924995:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581041152 00000100:00100000:2.0:1784044346.925014:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581041152 00000100:00100000:0.0:1784044346.925238:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1784044346.925250:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3975b96050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99a46fb7-9af9-40f1-9c76-329d6781ee81+19:18701:x1870705581041152:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1784044346.925460:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3975b96050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99a46fb7-9af9-40f1-9c76-329d6781ee81+19:18701:x1870705581041152:12345-0@lo:501:mount.lustre.0 Request processed in 212us (7007us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044346.925468:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1784044346.925609:0:18701:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843ce5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99a46fb7-9af9-40f1-9c76-329d6781ee81:18701:1870705581041152:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1784044346.925662:0:18701:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843ce5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99a46fb7-9af9-40f1-9c76-329d6781ee81:18701:1870705581041280:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1784044346.925710:0:18701:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044346.925736:0:18701:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b396f229f00 going to sleep for 11 seconds 00000100:00100000:2.0:1784044346.926111:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581041280 00000100:00100000:2.0:1784044346.926117:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581041280 00000100:00100000:2.0:1784044346.926162:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1784044346.926170:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3975b96c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99a46fb7-9af9-40f1-9c76-329d6781ee81+19:18701:x1870705581041280:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1784044346.927203:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3975b96c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99a46fb7-9af9-40f1-9c76-329d6781ee81+19:18701:x1870705581041280:12345-0@lo:503:mount.lustre.0 Request processed in 1026us (1486us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044346.927216:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1784044346.927384:0:18701:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843ce5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99a46fb7-9af9-40f1-9c76-329d6781ee81:18701:1870705581041280:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1784044346.927850:0:18701:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1784044346.928497:0:18701:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843ce5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99a46fb7-9af9-40f1-9c76-329d6781ee81:18701:1870705581041408:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1784044346.928583:0:18701:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044346.928621:0:18701:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b396f229540 going to sleep for 11 seconds 00000100:00100000:0.0:1784044346.928737:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581041408 00000100:00100000:0.0:1784044346.928745:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581041408 00000100:00100000:0.0:1784044346.928797:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1784044346.928806:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3975b97050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99a46fb7-9af9-40f1-9c76-329d6781ee81+19:18701:x1870705581041408:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1784044346.929951:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3975b97050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99a46fb7-9af9-40f1-9c76-329d6781ee81+19:18701:x1870705581041408:12345-0@lo:502:mount.lustre.0 Request processed in 1140us (1362us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044346.929970:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1784044346.930168:0:18701:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843ce5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99a46fb7-9af9-40f1-9c76-329d6781ee81:18701:1870705581041408:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1784044346.930431:0:18701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:3.0:1784044346.930463:0:18701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:3.0:1784044346.930498:0:18701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:3.0:1784044346.930515:0:18701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:3.0:1784044346.930529:0:18701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:3.0:1784044346.930544:0:18701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:3.0:1784044346.930576:0:18701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:3.0:1784044346.930590:0:18701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:3.0:1784044346.930604:0:18701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:3.0:1784044346.930616:0:18701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:3.0:1784044346.930630:0:18701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:3.0:1784044346.930643:0:18701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:3.0:1784044346.930680:0:18701:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843ce5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99a46fb7-9af9-40f1-9c76-329d6781ee81:18701:1870705581041536:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1784044346.930733:0:18701:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044346.930887:0:18701:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b396f229540 going to sleep for 11 seconds 00000100:00100000:2.0:1784044346.931739:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581041536 00000100:00100000:2.0:1784044346.931747:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581041536 00000100:00100000:0.0:1784044346.934383:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1784044346.934396:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3975b94c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99a46fb7-9af9-40f1-9c76-329d6781ee81+19:18701:x1870705581041536:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1784044346.935063:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3975b94c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99a46fb7-9af9-40f1-9c76-329d6781ee81+19:18701:x1870705581041536:12345-0@lo:502:mount.lustre.0 Request processed in 667us (4327us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044346.935073:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1784044346.946521:0:18701:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843ce5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99a46fb7-9af9-40f1-9c76-329d6781ee81:18701:1870705581041536:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1784044346.946684:0:18701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:3.0:1784044346.946701:0:18701:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:1.0:1784044346.949790:0:18718:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1784044346.949805:0:18718:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:1.0:1784044346.949814:0:18718:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784044346.949817:0:18718:0:(obd_config.c:1561:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:1.0:1784044346.949901:0:18718:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1784044346.949921:0:18718:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9b3974da4d40) 00000020:00000080:1.0:1784044346.950027:0:18718:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type obdfilter with refcount 2 00000020:00000080:1.0:1784044346.950043:0:18718:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1784044346.950371:0:18718:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9b3843fd5000 from lustre-OST0000, refs=2 00080000:01000000:1.0:1784044346.950380:0:18718:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:1.0:1784044346.950389:0:18718:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x89871fc3aba19304 00010000:00010000:1.0:1784044346.967487:0:18718:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:00000004:1.0:1784044346.969722:0:18718:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967325 00080000:10000000:1.0:1784044346.975999:0:18718:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0000: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000080:2.0:1784044346.977710:0:18718:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:2.0:1784044346.977723:0:18718:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784044346.977729:0:18718:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784044346.977731:0:18718:0:(obd_config.c:1561:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:2.0:1784044346.977736:0:18718:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1784044346.977739:0:18718:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #26 00000020:01000000:2.0:1784044346.977740:0:18718:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1784044346.977742:0:18718:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1784044346.977744:0:18718:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1784044346.977746:0:18718:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784044346.977748:0:18718:0:(obd_config.c:1561:class_process_config()) marker 26 (0x6) lustre sys.timeout 00000020:01000000:2.0:1784044346.977756:0:18718:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784044346.977759:0:18718:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784044346.977760:0:18718:0:(obd_config.c:1561:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:2.0:1784044346.977763:0:18718:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1784044346.977764:0:18718:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1784044346.977766:0:18718:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784044346.977768:0:18718:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784044346.977769:0:18718:0:(obd_config.c:1561:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000020:01000000:2.0:1784044346.977771:0:18718:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784044346.977773:0:18718:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784044346.977774:0:18718:0:(obd_config.c:1561:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1784044346.977777:0:18718:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1784044346.977805:0:18718:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784044346.977807:0:18718:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784044346.977809:0:18718:0:(obd_config.c:1561:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1784044346.977812:0:18718:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:3.0:1784044346.984299:0:18701:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:3.0:1784044346.984353:0:18701:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1784044346.984374:0:18701:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b3982055600/0x89871fc3aba192ef lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba192f6 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044346.984388:0:18701:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9b3982055600/0x89871fc3aba192ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba192f6 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784044346.984396:0:18701:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9b3843fd5000 from 1 10000000:01000000:3.0:1784044346.984399:0:18701:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1784044346.984446:0:18701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b3982055000/0x89871fc3aba1930b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044346.984453:0:18701:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9b3982055000/0x89871fc3aba1930b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044346.984463:0:18701:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9b3982055000/0x89871fc3aba1930b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044346.984491:0:18701:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843ce5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99a46fb7-9af9-40f1-9c76-329d6781ee81:18701:1870705581041664:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1784044346.984572:0:18701:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044347.002376:0:18701:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b396f229f00 going to sleep for 10 seconds 00000100:00100000:0.0:1784044347.006758:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581041664 00000100:00100000:0.0:1784044347.006780:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581041664 00000100:00100000:0.0:1784044347.006851:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1784044347.006862:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3975b95c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99a46fb7-9af9-40f1-9c76-329d6781ee81+19:18701:x1870705581041664:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1784044347.006881:0:17194:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784044347.006900:0:17194:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b38410b7600/0x89871fc3aba19312 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x89871fc3aba1930b expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044347.006939:0:17194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b38410b7600/0x89871fc3aba19312 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x89871fc3aba1930b expref: 20 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044347.006951:0:17194:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b38410b7600/0x89871fc3aba19312 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x89871fc3aba1930b expref: 20 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044347.006959:0:17194:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b38410b7600, rc 0) 00000100:00100000:0.0:1784044347.007049:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3975b95c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99a46fb7-9af9-40f1-9c76-329d6781ee81+20:18701:x1870705581041664:12345-0@lo:101:mount.lustre.0 Request processed in 189us (22476us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044347.007056:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1784044347.007301:0:18701:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843ce5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99a46fb7-9af9-40f1-9c76-329d6781ee81:18701:1870705581041664:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1784044347.007325:0:18701:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9b3982055000/0x89871fc3aba1930b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba19312 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044347.007335:0:18701:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9b3982055000/0x89871fc3aba1930b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x89871fc3aba19312 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1784044347.008983:0:18701:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:1.0:1784044347.009361:0:18701:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1784044347.009551:0:18701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:1.0:1784044347.009578:0:18701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:1.0:1784044347.009598:0:18701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:1.0:1784044347.009604:0:18701:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:1.0:1784044347.009676:0:18701:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b38436a1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99a46fb7-9af9-40f1-9c76-329d6781ee81:18701:1870705581041792:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1784044347.009741:0:18701:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044347.009779:0:18701:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3842748780 going to sleep for 11 seconds 00000100:00100000:0.0:1784044347.009940:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581041792 00000100:00100000:0.0:1784044347.009948:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581041792 00000100:00100000:0.0:1784044347.009999:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1784044347.010016:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3975b96450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99a46fb7-9af9-40f1-9c76-329d6781ee81+20:18701:x1870705581041792:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1784044347.010141:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3975b96450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99a46fb7-9af9-40f1-9c76-329d6781ee81+20:18701:x1870705581041792:12345-0@lo:501:mount.lustre.0 Request processed in 127us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044347.010149:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1784044347.010414:0:18701:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b38436a1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99a46fb7-9af9-40f1-9c76-329d6781ee81:18701:1870705581041792:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1784044347.010446:0:18701:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b38436a1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99a46fb7-9af9-40f1-9c76-329d6781ee81:18701:1870705581041920:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1784044347.010485:0:18701:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044347.010509:0:18701:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3842748780 going to sleep for 11 seconds 00000100:00100000:2.0:1784044347.010878:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581041920 00000100:00100000:2.0:1784044347.010883:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581041920 00000100:00100000:2.0:1784044347.010919:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1784044347.010935:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3975b95450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99a46fb7-9af9-40f1-9c76-329d6781ee81+20:18701:x1870705581041920:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1784044347.011026:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3975b95450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99a46fb7-9af9-40f1-9c76-329d6781ee81+20:18701:x1870705581041920:12345-0@lo:503:mount.lustre.0 Request processed in 100us (540us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044347.011034:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1784044347.011390:0:18701:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b38436a1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99a46fb7-9af9-40f1-9c76-329d6781ee81:18701:1870705581041920:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1784044347.011799:0:18701:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1784044347.011888:0:18701:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b38436a1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99a46fb7-9af9-40f1-9c76-329d6781ee81:18701:1870705581042048:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1784044347.011940:0:18701:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044347.011972:0:18701:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3842748f00 going to sleep for 11 seconds 00000100:00100000:2.0:1784044347.012132:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581042048 00000100:00100000:2.0:1784044347.012137:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581042048 00000100:00100000:2.0:1784044347.012206:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1784044347.012213:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3975b94050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99a46fb7-9af9-40f1-9c76-329d6781ee81+20:18701:x1870705581042048:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1784044347.012296:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3975b94050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99a46fb7-9af9-40f1-9c76-329d6781ee81+20:18701:x1870705581042048:12345-0@lo:502:mount.lustre.0 Request processed in 83us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044347.012303:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1784044347.012797:0:18701:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b38436a1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99a46fb7-9af9-40f1-9c76-329d6781ee81:18701:1870705581042048:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1784044347.015449:0:18701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:2.0:1784044347.015510:0:18701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:2.0:1784044347.015528:0:18701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:2.0:1784044347.015541:0:18701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:2.0:1784044347.015627:0:18701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:2.0:1784044347.015643:0:18701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:2.0:1784044347.015657:0:18701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:2.0:1784044347.015671:0:18701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000040:00080000:2.0:1784044347.015684:0:18701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:2.0:1784044347.015696:0:18701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10112 00000040:00080000:2.0:1784044347.015708:0:18701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10240 00000100:00100000:2.0:1784044347.015759:0:18701:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3975b7c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99a46fb7-9af9-40f1-9c76-329d6781ee81:18701:1870705581042176:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1784044347.016366:0:18701:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044347.016426:0:18701:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3947487e40 going to sleep for 11 seconds 00000100:00100000:0.0:1784044347.016496:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581042176 00000100:00100000:0.0:1784044347.016504:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581042176 00000100:00100000:0.0:1784044347.016573:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1784044347.016584:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3975b97c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99a46fb7-9af9-40f1-9c76-329d6781ee81+20:18701:x1870705581042176:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1784044347.016742:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3975b97c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99a46fb7-9af9-40f1-9c76-329d6781ee81+20:18701:x1870705581042176:12345-0@lo:502:mount.lustre.0 Request processed in 159us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044347.016751:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1784044347.016889:0:18701:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3975b7c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99a46fb7-9af9-40f1-9c76-329d6781ee81:18701:1870705581042176:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1784044347.016966:0:18701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10464 00000040:00080000:3.0:1784044347.016976:0:18701:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:3.0:1784044347.017821:0:18722:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784044347.017831:0:18722:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784044347.017834:0:18722:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1784044347.017841:0:18722:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9b3843fd5000 00000020:00000080:3.0:1784044347.017843:0:18722:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1784044347.017850:0:18722:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784044347.017853:0:18722:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784044347.017854:0:18722:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1784044347.017857:0:18722:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784044347.017859:0:18722:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784044347.017861:0:18722:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1784044347.017864:0:18722:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9b3843fd5000 00000020:00000080:3.0:1784044347.017866:0:18722:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1784044347.017933:0:18722:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784044347.017937:0:18722:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784044347.017939:0:18722:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1784044347.017942:0:18722:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784044347.017945:0:18722:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784044347.017946:0:18722:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1784044347.017949:0:18722:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9b3843fd5000 00000020:00000080:3.0:1784044347.017951:0:18722:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1784044347.017969:0:18722:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784044347.017973:0:18722:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784044347.017974:0:18722:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1784044347.017977:0:18722:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784044347.017979:0:18722:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784044347.017981:0:18722:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1784044347.017984:0:18722:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9b3843fd5000 00000020:00000080:3.0:1784044347.017986:0:18722:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1784044347.018005:0:18722:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784044347.018015:0:18722:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784044347.018017:0:18722:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1784044347.018019:0:18722:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:1.0:1784044347.018155:0:18701:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:1.0:1784044347.018374:0:18701:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1784044347.018396:0:18701:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b3982055000/0x89871fc3aba1930b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba19312 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044347.018407:0:18701:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9b3982055000/0x89871fc3aba1930b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba19312 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784044347.018474:0:18701:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1784044347.018477:0:18701:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9b3843fd5000 10000000:01000000:1.0:1784044347.018480:0:18701:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9b3843fd5000 10000000:01000000:1.0:1784044347.018483:0:18701:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1784044347.018489:0:18701:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9b3843fd5000 from 1 10000000:01000000:1.0:1784044347.018491:0:18701:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1784044347.018524:0:18701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b38426fc200/0x89871fc3aba19319 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044347.018531:0:18701:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9b38426fc200/0x89871fc3aba19319 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044347.018541:0:18701:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9b38426fc200/0x89871fc3aba19319 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044347.018582:0:18701:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b38436a1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99a46fb7-9af9-40f1-9c76-329d6781ee81:18701:1870705581042304:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1784044347.018648:0:18701:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044347.018682:0:18701:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3842748780 going to sleep for 11 seconds 00000100:00100000:0.0:1784044347.018941:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581042304 00000100:00100000:0.0:1784044347.018948:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581042304 00000100:00100000:0.0:1784044347.018999:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1784044347.019007:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397424c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99a46fb7-9af9-40f1-9c76-329d6781ee81+20:18701:x1870705581042304:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1784044347.019019:0:17193:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784044347.019032:0:17193:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b38410b7400/0x89871fc3aba19320 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x89871fc3aba19319 expref: -99 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044347.019054:0:17193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b38410b7400/0x89871fc3aba19320 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x89871fc3aba19319 expref: 21 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044347.019064:0:17193:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b38410b7400/0x89871fc3aba19320 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x89871fc3aba19319 expref: 21 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044347.019072:0:17193:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b38410b7400, rc 0) 00000100:00100000:0.0:1784044347.019123:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397424c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99a46fb7-9af9-40f1-9c76-329d6781ee81+21:18701:x1870705581042304:12345-0@lo:101:mount.lustre.0 Request processed in 116us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044347.019139:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1784044347.019716:0:18701:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b38436a1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99a46fb7-9af9-40f1-9c76-329d6781ee81:18701:1870705581042304:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1784044347.019732:0:18701:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9b38426fc200/0x89871fc3aba19319 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba19320 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044347.019741:0:18701:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9b38426fc200/0x89871fc3aba19319 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x89871fc3aba19320 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1784044347.025400:0:18701:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:2.0:1784044347.025747:0:18701:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1784044347.026126:0:18701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:2.0:1784044347.026153:0:18701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:2.0:1784044347.026169:0:18701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:2.0:1784044347.026259:0:18701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:2.0:1784044347.026275:0:18701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:2.0:1784044347.026288:0:18701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:2.0:1784044347.026301:0:18701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:2.0:1784044347.026316:0:18701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:2.0:1784044347.026329:0:18701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:2.0:1784044347.026344:0:18701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:2.0:1784044347.026359:0:18701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:2.0:1784044347.026390:0:18701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:2.0:1784044347.026407:0:18701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:2.0:1784044347.026423:0:18701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:2.0:1784044347.026438:0:18701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:2.0:1784044347.026452:0:18701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:2.0:1784044347.026479:0:18701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:2.0:1784044347.026495:0:18701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:2.0:1784044347.026508:0:18701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:2.0:1784044347.026521:0:18701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:2.0:1784044347.026535:0:18701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:2.0:1784044347.026563:0:18701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:2.0:1784044347.026580:0:18701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:2.0:1784044347.026596:0:18701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:2.0:1784044347.026609:0:18701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:2.0:1784044347.026622:0:18701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:2.0:1784044347.026636:0:18701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:2.0:1784044347.026664:0:18701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:2.0:1784044347.026679:0:18701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:2.0:1784044347.026693:0:18701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:2.0:1784044347.026704:0:18701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:2.0:1784044347.026715:0:18701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:2.0:1784044347.026728:0:18701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:2.0:1784044347.026741:0:18701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:2.0:1784044347.026754:0:18701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:2.0:1784044347.026767:0:18701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:2.0:1784044347.026780:0:18701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:2.0:1784044347.026800:0:18701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:2.0:1784044347.026806:0:18701:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:2.0:1784044347.026890:0:18701:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3975b7c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99a46fb7-9af9-40f1-9c76-329d6781ee81:18701:1870705581042432:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784044347.028666:0:18701:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044347.028760:0:18701:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3947487c00 going to sleep for 11 seconds 00000100:00100000:3.0:1784044347.038586:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581042432 00000100:00100000:3.0:1784044347.038605:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581042432 00000100:00100000:2.0:1784044347.039453:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1784044347.039464:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397424dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99a46fb7-9af9-40f1-9c76-329d6781ee81+21:18701:x1870705581042432:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784044347.039657:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397424dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99a46fb7-9af9-40f1-9c76-329d6781ee81+21:18701:x1870705581042432:12345-0@lo:501:mount.lustre.0 Request processed in 195us (10995us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044347.039674:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1784044347.039733:0:18701:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3975b7c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99a46fb7-9af9-40f1-9c76-329d6781ee81:18701:1870705581042432:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784044347.039781:0:18701:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3975b7c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99a46fb7-9af9-40f1-9c76-329d6781ee81:18701:1870705581042560:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1784044347.039823:0:18701:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044347.039846:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581042560 00000100:00100000:2.0:1784044347.039850:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581042560 00000100:00100000:2.0:1784044347.039872:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1784044347.039877:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397424c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99a46fb7-9af9-40f1-9c76-329d6781ee81+21:18701:x1870705581042560:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1784044347.039950:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397424c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99a46fb7-9af9-40f1-9c76-329d6781ee81+21:18701:x1870705581042560:12345-0@lo:503:mount.lustre.0 Request processed in 72us (126us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044347.039956:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1784044347.039995:0:18701:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3947487c00 going to sleep for 11 seconds 00000100:00100000:2.0:1784044347.040005:0:18701:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3975b7c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99a46fb7-9af9-40f1-9c76-329d6781ee81:18701:1870705581042560:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1784044347.040444:0:18701:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1784044347.040503:0:18701:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3975b7c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99a46fb7-9af9-40f1-9c76-329d6781ee81:18701:1870705581042688:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1784044347.040535:0:18701:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044347.040555:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581042688 00000100:00100000:2.0:1784044347.040558:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581042688 00000100:00100000:2.0:1784044347.040577:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1784044347.040582:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397424f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99a46fb7-9af9-40f1-9c76-329d6781ee81+21:18701:x1870705581042688:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1784044347.040649:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397424f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99a46fb7-9af9-40f1-9c76-329d6781ee81+21:18701:x1870705581042688:12345-0@lo:502:mount.lustre.0 Request processed in 66us (113us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044347.040655:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1784044347.040681:0:18701:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3947487c00 going to sleep for 11 seconds 00000100:00100000:2.0:1784044347.040695:0:18701:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3975b7c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99a46fb7-9af9-40f1-9c76-329d6781ee81:18701:1870705581042688:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1784044347.040832:0:18701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:2.0:1784044347.040853:0:18701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:2.0:1784044347.040865:0:18701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:2.0:1784044347.040875:0:18701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:2.0:1784044347.040886:0:18701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:2.0:1784044347.040896:0:18701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:2.0:1784044347.040907:0:18701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:2.0:1784044347.040917:0:18701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:2.0:1784044347.040927:0:18701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:2.0:1784044347.040938:0:18701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:2.0:1784044347.040948:0:18701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:2.0:1784044347.040959:0:18701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:2.0:1784044347.040970:0:18701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:2.0:1784044347.040980:0:18701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:2.0:1784044347.040991:0:18701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:2.0:1784044347.041001:0:18701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:2.0:1784044347.041012:0:18701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:2.0:1784044347.041022:0:18701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:2.0:1784044347.041043:0:18701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:2.0:1784044347.041055:0:18701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:2.0:1784044347.041065:0:18701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:2.0:1784044347.041076:0:18701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:2.0:1784044347.041101:0:18701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:2.0:1784044347.041116:0:18701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:2.0:1784044347.041127:0:18701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:2.0:1784044347.041138:0:18701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:2.0:1784044347.041149:0:18701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:2.0:1784044347.041159:0:18701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:2.0:1784044347.041170:0:18701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:2.0:1784044347.041202:0:18701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:2.0:1784044347.041213:0:18701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:2.0:1784044347.041232:0:18701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:2.0:1784044347.041243:0:18701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:2.0:1784044347.041254:0:18701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:2.0:1784044347.041274:0:18701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:2.0:1784044347.041286:0:18701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:2.0:1784044347.041296:0:18701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:2.0:1784044347.041307:0:18701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:2.0:1784044347.041317:0:18701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:2.0:1784044347.041328:0:18701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:2.0:1784044347.041339:0:18701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:2.0:1784044347.041349:0:18701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:2.0:1784044347.041359:0:18701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:2.0:1784044347.041369:0:18701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:2.0:1784044347.041380:0:18701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:2.0:1784044347.041390:0:18701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:2.0:1784044347.041401:0:18701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:2.0:1784044347.041411:0:18701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:2.0:1784044347.041439:0:18701:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3975b7c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99a46fb7-9af9-40f1-9c76-329d6781ee81:18701:1870705581042816:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1784044347.041472:0:18701:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044347.041495:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581042816 00000100:00100000:2.0:1784044347.041498:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581042816 00000100:00100000:2.0:1784044347.041527:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1784044347.041533:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397424d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99a46fb7-9af9-40f1-9c76-329d6781ee81+21:18701:x1870705581042816:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1784044347.041587:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397424d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99a46fb7-9af9-40f1-9c76-329d6781ee81+21:18701:x1870705581042816:12345-0@lo:502:mount.lustre.0 Request processed in 54us (114us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044347.041593:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1784044347.041619:0:18701:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3947487c00 going to sleep for 11 seconds 00000100:00100000:2.0:1784044347.041632:0:18701:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3975b7c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99a46fb7-9af9-40f1-9c76-329d6781ee81:18701:1870705581042816:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1784044347.041735:0:18701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:2.0:1784044347.041757:0:18701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:2.0:1784044347.041775:0:18701:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3975b7c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99a46fb7-9af9-40f1-9c76-329d6781ee81:18701:1870705581042944:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1784044347.041803:0:18701:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044347.041819:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581042944 00000100:00100000:2.0:1784044347.041822:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581042944 00000100:00100000:2.0:1784044347.041838:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1784044347.041843:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397424c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99a46fb7-9af9-40f1-9c76-329d6781ee81+21:18701:x1870705581042944:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1784044347.041889:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397424c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99a46fb7-9af9-40f1-9c76-329d6781ee81+21:18701:x1870705581042944:12345-0@lo:502:mount.lustre.0 Request processed in 45us (85us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044347.041895:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1784044347.041918:0:18701:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3947487c00 going to sleep for 11 seconds 00000100:00100000:2.0:1784044347.041928:0:18701:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3975b7c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99a46fb7-9af9-40f1-9c76-329d6781ee81:18701:1870705581042944:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1784044347.041955:0:18701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:2.0:1784044347.041961:0:18701:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:0.0:1784044347.052676:0:18725:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1784044347.052696:0:18725:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9b3842110000) 00000020:00000080:0.0:1784044347.052723:0:18725:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type lwp with refcount 2 00000020:01000004:0.0:1784044347.052939:0:18725:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9b3843fd5000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1784044347.052943:0:18725:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9b3843fd5000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1784044347.052946:0:18725:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9b3843fd5000 3 00010000:00080000:0.0:1784044347.052985:0:18725:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9b38423e1800@lustre-MDT0000-lwp-OST0000: add connection 192.168.202.140@tcp at head 00010000:00010000:0.0:1784044347.054657:0:18725:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-9 is initialized 00000020:00000080:0.0:1784044347.054767:0:18725:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:0.0:1784044347.054812:0:18725:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1784044347.054827:0:18725:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x89871fc3aba1932e 00000100:00080000:0.0:1784044347.054840:0:18725:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1784044347.054847:0:18725:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9b38423e1800 using connection 192.168.202.140@tcp/0@lo 00000100:00100000:0.0:1784044347.054889:0:18725:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b3947ee8700 x1870705581043072/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1784044347.054945:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3947ee8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3637:1870705581043072:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1784044347.055015:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044347.055074:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581043072 00000100:00100000:0.0:1784044347.055079:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581043072 00000100:00100000:0.0:1784044347.055125:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1784044347.055131:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3947eeb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3637:x1870705581043072:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1784044347.055154:0:17201:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 540 last 0 00000020:00000080:0.0:1784044347.055209:0:17201:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x89871fc3aba19335 00000004:00100000:0.0:1784044347.055226:0:17201:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1784044347.055257:0:17201:0:(import.c:65:import_set_state_nolock()) ffff9b38423e2000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1784044347.055316:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3947eeb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1870705581043072:12345-0@lo:38:llog_process_th.0 Request processed in 183us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044347.055323:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1784044347.055361:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b3947ee8700 x1870705581043072/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784044357 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784044347.055372:0:3637:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1784044347.055378:0:3637:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:0.0:1784044347.055385:0:3637:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1784044347.055388:0:3637:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1784044347.055390:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9b38423e1800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1784044347.055396:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3947ee8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3637:1870705581043072:0@lo:38:llog_process_th.0 00000100:00080000:0.0:1784044347.055413:0:18725:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1784044347.055458:0:14129:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1784044347.055461:0:14129:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1784044347.055464:0:14129:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1784044347.055467:0:14129:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1784044347.055484:0:14129:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1784044347.055487:0:14129:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1784044347.055490:0:14129:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1784044347.055493:0:14129:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1784044347.055513:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3947ee8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1870705581043200:0@lo:400:kworker.0 00000100:00100000:0.0:1784044347.055541:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044347.055560:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784044347.055573:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3947eead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3641:1870705581043584:0@lo:400:kworker.0 00000100:00100000:0.0:1784044347.055596:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044347.055638:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3947eea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1870705581043328:0@lo:400:kworker.0 00000100:00100000:0.0:1784044347.055695:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044347.055713:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784044347.055719:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3947ee9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1870705581043456:0@lo:400:kworker.0 00000100:00100000:0.0:1784044347.055741:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044347.055774:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581043200 00000100:00100000:0.0:1784044347.055778:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581043200 00000100:00100000:0.0:1784044347.055798:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581043456 00000100:00100000:0.0:1784044347.055801:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581043456 00000100:00100000:0.0:1784044347.055814:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1784044347.055820:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3947eeb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1870705581043200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784044347.055859:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3947eeb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1870705581043200:12345-0@lo:400:kworker.0 Request processed in 39us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044347.055865:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1784044347.055877:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1784044347.055882:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3947eebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1870705581043456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784044347.055911:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3947eebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1870705581043456:12345-0@lo:400:kworker.0 Request processed in 29us (169us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044347.055917:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1784044347.056407:0:18572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581043584 00000100:00100000:3.0:1784044347.056412:0:18572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581043584 00000100:00100000:3.0:1784044347.056443:0:18572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581043328 00000100:00100000:3.0:1784044347.056447:0:18572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581043328 00000100:00100000:3.0:1784044347.056466:0:18572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1784044347.056472:0:18572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3947eeaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1870705581043584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044347.056510:0:18572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3947eeaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1870705581043584:12345-0@lo:400:kworker.0 Request processed in 38us (913us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044347.056518:0:18572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1784044347.056530:0:18572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1784044347.056536:0:18572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3947eeb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1870705581043328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044347.059122:0:18572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3947eeb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1870705581043328:12345-0@lo:400:kworker.0 Request processed in 2577us (3418us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044347.059138:0:18572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:1.0:1784044347.062311:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b3947eead80 x1870705581043584/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044363 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784044347.062333:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3947eead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3641:1870705581043584:0@lo:400:kworker.0 00000100:00100000:1.0:1784044347.062347:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3947ee8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1870705581043200:0@lo:400:kworker.0 00000100:00100000:1.0:1784044347.062392:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3947ee9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1870705581043456:0@lo:400:kworker.0 00010000:00080000:1.0:1784044347.062403:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b3947eea680 x1870705581043328/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044363 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784044347.062413:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3947eea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1870705581043328:0@lo:400:kworker.0 00000020:01000004:3.0:1784044347.091486:0:18725:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1784044347.091506:0:18725:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff9b39459bb380) 00000020:00000080:3.0:1784044347.091539:0:18725:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type lwp with refcount 2 00000020:01000004:3.0:1784044347.092870:0:18725:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9b3843fd5000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1784044347.092878:0:18725:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9b3843fd5000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1784044347.092881:0:18725:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9b3843fd5000 3 00010000:00080000:3.0:1784044347.092912:0:18725:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9b384242f800@lustre-MDT0001-lwp-OST0000: add connection 192.168.202.140@tcp at head 00010000:00010000:3.0:1784044347.094610:0:18725:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-10 is initialized 00000020:00000080:3.0:1784044347.094715:0:18725:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:3.0:1784044347.094761:0:18725:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1784044347.094784:0:18725:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0x89871fc3aba19343 00000100:00080000:3.0:1784044347.094794:0:18725:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1784044347.094799:0:18725:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff9b384242f800 using connection 192.168.202.140@tcp/0@lo 00000100:00100000:3.0:1784044347.094836:0:18725:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b3843ce6680 x1870705581043712/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1784044347.094875:0:18725:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00100000:0.0:1784044347.101692:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843ce6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3637:1870705581043712:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1784044347.101774:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1784044347.101848:0:14129:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1784044347.101853:0:14129:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1784044347.101856:0:14129:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1784044347.101865:0:14129:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1784044347.101869:0:14129:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1784044347.101872:0:14129:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1784044347.101875:0:14129:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1784044347.101878:0:14129:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:2.0:1784044347.108337:0:18725:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000020:01000000:0.0:1784044347.108581:0:18701:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1784044347.108611:0:18701:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1784044347.108636:0:18701:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b38426fc200/0x89871fc3aba19319 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba19320 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044347.108648:0:18701:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9b38426fc200/0x89871fc3aba19319 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba19320 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1784044347.108699:0:18701:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1784044347.108702:0:18701:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1784044347.108703:0:18701:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784044347.108704:0:18701:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1784044347.108705:0:18701:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784044347.108706:0:18701:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784044347.108707:0:18701:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1784044347.108709:0:18701:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784044347.108710:0:18701:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1784044347.108714:0:18701:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:0.0:1784044347.108716:0:18701:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1784044347.108717:0:18701:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1784044347.108719:0:18701:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784044347.108720:0:18701:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1784044347.108721:0:18701:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784044347.108722:0:18701:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784044347.108723:0:18701:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1784044347.108724:0:18701:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784044347.108725:0:18701:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1784044347.108755:0:18701:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1784044347.108777:0:18701:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3947ee9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99a46fb7-9af9-40f1-9c76-329d6781ee81:18701:1870705581043840:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1784044347.108846:0:18701:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044347.108879:0:18701:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3942e1aa80 going to sleep for 11 seconds 00000100:00100000:2.0:1784044347.109495:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581043840 00000100:00100000:2.0:1784044347.109503:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581043840 00000100:00100000:2.0:1784044347.109570:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1784044347.109582:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397424e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99a46fb7-9af9-40f1-9c76-329d6781ee81+21:18701:x1870705581043840:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1784044347.109612:0:17194:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1784044347.109626:0:17194:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1784044347.111903:0:17194:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1784044347.111922:0:17194:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1784044347.112018:0:17216:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1784044347.112024:0:17216:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1784044347.112048:0:17216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b38410b7a00/0x89871fc3aba1934a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044347.112070:0:17216:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b3843799200/0x89871fc3aba1929b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x89871fc3aba19294 expref: 21 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044347.112118:0:17216:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b394166ac00/0x89871fc3aba192a9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x89871fc3aba192a2 expref: 21 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044347.112126:0:17216:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b38410b7a00/0x89871fc3aba1934a lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044347.112220:0:17216:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b394166ac00/0x89871fc3aba192a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x89871fc3aba192a2 expref: 21 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044347.112236:0:17216:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b394166ac00/0x89871fc3aba192a9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x89871fc3aba192a2 expref: 21 pid: 17192 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044347.112249:0:17216:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3947ee8e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17216:1870705581043968:0@lo:104: 00000100:00100000:0.0:1784044347.112314:0:17216:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1784044347.112364:0:17216:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b3843799200/0x89871fc3aba1929b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x89871fc3aba19294 expref: 21 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044347.112374:0:17216:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b3843799200/0x89871fc3aba1929b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x89871fc3aba19294 expref: 21 pid: 17192 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044347.112401:0:17216:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3947ee9500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17216:1870705581044096:0@lo:104: 00000100:00100000:0.0:1784044347.112429:0:17216:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044347.112445:0:17216:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3942e1a6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784044347.112472:0:17182:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1784044347.112491:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581043968 00000100:00100000:0.0:1784044347.112496:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581043968 00000100:00100000:0.0:1784044347.112532:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581044096 00000100:00100000:0.0:1784044347.112535:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581044096 00000100:00100000:0.0:1784044347.112746:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1784044347.112757:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3947eea680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:99a46fb7-9af9-40f1-9c76-329d6781ee81+4:17216:x1870705581043968:12345-0@lo:104: 00010000:00010000:0.0:1784044347.112770:0:17182:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.140@tcp lock: ffff9b3843799e00/0x89871fc3aba192a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x89871fc3aba192a9 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044347.112872:0:17182:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1784044347.112879:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3947eea680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:99a46fb7-9af9-40f1-9c76-329d6781ee81+4:17216:x1870705581043968:12345-0@lo:104: Request processed in 124us (565us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044347.112887:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1784044347.112908:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1784044347.112915:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397f9f3050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:99a46fb7-9af9-40f1-9c76-329d6781ee81+3:17216:x1870705581044096:12345-0@lo:104: 00010000:00010000:0.0:1784044347.112924:0:17182:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.140@tcp lock: ffff9b38426fde00/0x89871fc3aba19294 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x89871fc3aba1929b expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044347.112957:0:17182:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1784044347.112964:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397f9f3050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:99a46fb7-9af9-40f1-9c76-329d6781ee81+3:17216:x1870705581044096:12345-0@lo:104: Request processed in 49us (534us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044347.112970:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:0.0:1784044347.113013:0:17187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1784044347.113030:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: ffff9b3843799e00/0x89871fc3aba192a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x89871fc3aba192a9 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044347.113039:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3843799e00 already unused, calling callback (ffffffffc113cc20) 10000000:00010000:0.0:1784044347.113044:0:17187:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: ffff9b3843799e00/0x89871fc3aba192a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x89871fc3aba192a9 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044347.113053:0:17187:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9b3843799e00/0x89871fc3aba192a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x89871fc3aba192a9 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784044347.113061:0:17187:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9b3843799e00/0x89871fc3aba192a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x89871fc3aba192a9 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784044347.113069:0:17187:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1784044347.113117:0:17187:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.140@tcp lock: ffff9b3843799e00/0x89871fc3aba192a2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x89871fc3aba192a9 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044347.113125:0:17187:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784044347.113147:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: ffff9b3843799e00/0x89871fc3aba192a2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x89871fc3aba192a9 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044347.113167:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9b3843799e00/0x89871fc3aba192a2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x89871fc3aba192a9 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044347.113210:0:17187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784044347.113213:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: ffff9b38426fde00/0x89871fc3aba19294 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x89871fc3aba1929b expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044347.113219:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38426fde00 already unused, calling callback (ffffffffc113cc20) 10000000:00010000:0.0:1784044347.113222:0:17187:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: ffff9b38426fde00/0x89871fc3aba19294 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x89871fc3aba1929b expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044347.113239:0:17187:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9b38426fde00/0x89871fc3aba19294 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x89871fc3aba1929b expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784044347.113246:0:17187:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9b38426fde00/0x89871fc3aba19294 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x89871fc3aba1929b expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784044347.113251:0:17187:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1784044347.113266:0:17187:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.140@tcp lock: ffff9b38426fde00/0x89871fc3aba19294 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x89871fc3aba1929b expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044347.113272:0:17187:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784044347.113288:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: ffff9b38426fde00/0x89871fc3aba19294 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x89871fc3aba1929b expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044347.113295:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9b38426fde00/0x89871fc3aba19294 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x89871fc3aba1929b expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044347.113308:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784044347.113310:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784044347.113312:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784044347.113318:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784044347.113331:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3947eea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:99a46fb7-9af9-40f1-9c76-329d6781ee81:3641:1870705581044224:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784044347.113361:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044347.113408:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3947ee8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:99a46fb7-9af9-40f1-9c76-329d6781ee81:3638:1870705581044352:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784044347.113433:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044347.113468:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581044224 00000100:00100000:0.0:1784044347.113473:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581044224 00010000:00010000:0.0:1784044347.113492:0:17186:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b394166ac00/0x89871fc3aba192a9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x89871fc3aba192a2 expref: 22 pid: 17192 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044347.113520:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581044352 00000100:00100000:0.0:1784044347.113523:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581044352 00010000:00010000:0.0:1784044347.113534:0:17186:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b3843799200/0x89871fc3aba1929b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x89871fc3aba19294 expref: 23 pid: 17192 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044347.113558:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1784044347.113564:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3947eead80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:99a46fb7-9af9-40f1-9c76-329d6781ee81+23:3641:x1870705581044224:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784044347.113574:0:17186:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784044347.113579:0:17186:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b394166ac00/0x89871fc3aba192a9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x89871fc3aba192a2 expref: 23 pid: 17192 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044347.113589:0:17186:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b394166ac00/0x89871fc3aba192a9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x89871fc3aba192a2 expref: 23 pid: 17192 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044347.113603:0:17186:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784044347.113630:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3947eead80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:99a46fb7-9af9-40f1-9c76-329d6781ee81+23:3641:x1870705581044224:12345-0@lo:103:ldlm_bl.0 Request processed in 66us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044347.113637:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1784044347.113650:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1784044347.113656:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397b96e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:99a46fb7-9af9-40f1-9c76-329d6781ee81+22:3638:x1870705581044352:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784044347.113664:0:17186:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784044347.113669:0:17186:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b3843799200/0x89871fc3aba1929b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x89871fc3aba19294 expref: 22 pid: 17192 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044347.113678:0:17186:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b3843799200/0x89871fc3aba1929b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x89871fc3aba19294 expref: 22 pid: 17192 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044347.113690:0:17186:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b38410b7a00/0x89871fc3aba1934a lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044347.113704:0:17186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b38410b7a00/0x89871fc3aba1934a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1784044347.113717:0:17186:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.025288238s 00010000:00010000:0.0:1784044347.113722:0:17186:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b38410b7a00/0x89871fc3aba1934a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044347.113729:0:17186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b38410b7a00/0x89871fc3aba1934a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044347.113735:0:17186:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b38410b7a00/0x89871fc3aba1934a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044347.113742:0:17186:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b38410b7a00/0x89871fc3aba1934a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044347.113747:0:17186:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38410b7a00 already unused, calling callback (ffffffffc0b56230) 00010000:00010000:0.0:1784044347.113751:0:17186:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b38410b7a00/0x89871fc3aba1934a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044347.113758:0:17186:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b38410b7a00/0x89871fc3aba1934a lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044347.113766:0:17186:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b38410b7a00/0x89871fc3aba1934a lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044347.113776:0:17186:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784044347.113804:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397b96e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:99a46fb7-9af9-40f1-9c76-329d6781ee81+22:3638:x1870705581044352:12345-0@lo:103:ldlm_bl.0 Request processed in 148us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044347.113811:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1784044347.113873:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3947eea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:99a46fb7-9af9-40f1-9c76-329d6781ee81:3641:1870705581044224:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784044347.113896:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3947ee8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:99a46fb7-9af9-40f1-9c76-329d6781ee81:3638:1870705581044352:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784044347.114390:0:18572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581043712 00000100:00100000:3.0:1784044347.114397:0:18572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581043712 00000100:00100000:3.0:1784044347.114429:0:18572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1784044347.114435:0:18572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3947ee8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3637:x1870705581043712:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1784044347.114462:0:18572:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 540 last 0 00000020:00000080:3.0:1784044347.114513:0:18572:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0x89871fc3aba19351 00000004:00100000:3.0:1784044347.114530:0:18572:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1784044347.114572:0:18572:0:(import.c:65:import_set_state_nolock()) ffff9b3842428800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1784044347.114623:0:18572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3947ee8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1870705581043712:12345-0@lo:38:llog_process_th.0 Request processed in 187us (12849us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044347.114629:0:18572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1784044347.116535:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b3843ce6680 x1870705581043712/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784044357 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784044347.116560:0:3637:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1784044347.116569:0:3637:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 2 00000100:00080000:0.0:1784044347.116578:0:3637:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1784044347.116584:0:3637:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1784044347.116587:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9b384242f800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1784044347.116594:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843ce6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3637:1870705581043712:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1784044347.116918:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397424e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99a46fb7-9af9-40f1-9c76-329d6781ee81+21:18701:x1870705581043840:12345-0@lo:253:mount.lustre.0 Request processed in 7337us (8069us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044347.116928:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1784044347.117282:0:18701:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3947ee9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99a46fb7-9af9-40f1-9c76-329d6781ee81:18701:1870705581043840:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1784044347.117295:0:18701:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1784044347.117299:0:18701:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1784044347.117300:0:18701:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1784044347.117302:0:18701:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784044347.117303:0:18701:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1784044347.117304:0:18701:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784044347.117306:0:18701:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784044347.117307:0:18701:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1784044347.117309:0:18701:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784044347.117311:0:18701:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1784044347.117323:0:18701:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:1.0:1784044347.125815:0:17216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b394166ac00/0x89871fc3aba192a9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x89871fc3aba192a2 expref: 20 pid: 17192 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044347.125850:0:17216:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3947ee8e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17216:1870705581043968:0@lo:104: 00010000:00010000:1.0:1784044347.125865:0:17216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b3843799200/0x89871fc3aba1929b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x89871fc3aba19294 expref: 19 pid: 17192 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044347.125875:0:17216:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3947ee9500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17216:1870705581044096:0@lo:104: 00010000:00010000:1.0:1784044347.125909:0:17216:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b38410b7a00/0x89871fc3aba1934a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044347.125920:0:17216:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b38410b7a00/0x89871fc3aba1934a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044347.125926:0:17216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b38410b7a00/0x89871fc3aba1934a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044347.125931:0:17216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b38410b7a00/0x89871fc3aba1934a lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00000004:0.0:1784044347.143978:0:18701:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:3.0:1784044347.160489:0:18701:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:3.0:1784044347.160500:0:18701:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:3.0:1784044347.160541:0:18701:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1784044347.160593:0:18701:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.140@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1784044347.160619:0:18701:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1784044347.160649:0:18701:0:(super25.c:181:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:3.0:1784044347.161496:0:18701:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1784044347.161721:0:18701:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1784044347.407374:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1784044348.174318:0:17196:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1784044348.174328:0:17196:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9b396f25a800 from 9 10000000:01000000:0.0:1784044348.174333:0:17196:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1784044348.174396:0:17196:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b38410b6e00/0x89871fc3aba19358 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044348.174423:0:17196:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9b38410b6e00/0x89871fc3aba19358 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044348.174434:0:17196:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9b38410b6e00/0x89871fc3aba19358 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044348.174463:0:17196:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3947ee9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99a46fb7-9af9-40f1-9c76-329d6781ee81:17196:1870705581044480:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1784044348.174531:0:17196:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044348.174572:0:17196:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3965ee7f00 going to sleep for 11 seconds 00000100:00100000:0.0:1784044348.174592:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581044480 00000100:00100000:0.0:1784044348.174598:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581044480 00000100:00100000:0.0:1784044348.174646:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1784044348.174654:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397424e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99a46fb7-9af9-40f1-9c76-329d6781ee81+19:17196:x1870705581044480:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784044348.174669:0:17192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784044348.174681:0:17192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b38410b7200/0x89871fc3aba1935f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x89871fc3aba19358 expref: -99 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044348.174703:0:17192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b38410b7200/0x89871fc3aba1935f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x89871fc3aba19358 expref: 20 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044348.174711:0:17192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b38410b7200/0x89871fc3aba1935f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x89871fc3aba19358 expref: 20 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044348.174720:0:17192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b38410b7200, rc 0) 00000100:00100000:0.0:1784044348.174757:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397424e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99a46fb7-9af9-40f1-9c76-329d6781ee81+20:17196:x1870705581044480:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 104us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044348.174764:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1784044348.174816:0:17196:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3947ee9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99a46fb7-9af9-40f1-9c76-329d6781ee81:17196:1870705581044480:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784044348.174830:0:17196:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9b38410b6e00/0x89871fc3aba19358 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba1935f expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044348.174839:0:17196:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9b38410b6e00/0x89871fc3aba19358 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x89871fc3aba1935f expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044348.174882:0:17196:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3947ee9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99a46fb7-9af9-40f1-9c76-329d6781ee81:17196:1870705581044608:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1784044348.174910:0:17196:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044348.174926:0:17196:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3965ee7f00 going to sleep for 11 seconds 00000100:00100000:0.0:1784044348.174939:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581044608 00000100:00100000:0.0:1784044348.174942:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581044608 00000100:00100000:0.0:1784044348.174963:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1784044348.174969:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397424cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99a46fb7-9af9-40f1-9c76-329d6781ee81+20:17196:x1870705581044608:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1784044348.174982:0:17194:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1784044348.174997:0:17194:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1784044348.175000:0:17194:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:0.0:1784044348.175071:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397424cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99a46fb7-9af9-40f1-9c76-329d6781ee81+20:17196:x1870705581044608:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 102us (159us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044348.175092:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1784044348.175123:0:17196:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3947ee9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99a46fb7-9af9-40f1-9c76-329d6781ee81:17196:1870705581044608:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1784044348.175201:0:17196:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1784044348.175208:0:17196:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b38410b6e00/0x89871fc3aba19358 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba1935f expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044348.175216:0:17196:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9b38410b6e00/0x89871fc3aba19358 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba1935f expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784044348.175236:0:17196:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1784044348.175237:0:17196:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9b397a8e8000 from 9 10000000:01000000:0.0:1784044348.175239:0:17196:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1784044348.175254:0:17196:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b38410b7e00/0x89871fc3aba19366 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044348.175261:0:17196:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9b38410b7e00/0x89871fc3aba19366 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044348.175268:0:17196:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9b38410b7e00/0x89871fc3aba19366 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044348.175280:0:17196:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3947ee9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99a46fb7-9af9-40f1-9c76-329d6781ee81:17196:1870705581044736:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1784044348.175306:0:17196:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044348.175320:0:17196:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3965ee7f00 going to sleep for 11 seconds 00000100:00100000:0.0:1784044348.175331:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581044736 00000100:00100000:0.0:1784044348.175334:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581044736 00000100:00100000:0.0:1784044348.175356:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1784044348.175362:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397424d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99a46fb7-9af9-40f1-9c76-329d6781ee81+20:17196:x1870705581044736:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784044348.175369:0:17193:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784044348.175378:0:17193:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b38410b6c00/0x89871fc3aba1936d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x89871fc3aba19366 expref: -99 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044348.175390:0:17193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b38410b6c00/0x89871fc3aba1936d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x89871fc3aba19366 expref: 21 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044348.175398:0:17193:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b38410b6c00/0x89871fc3aba1936d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x89871fc3aba19366 expref: 21 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044348.175415:0:17193:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b38410b6c00, rc 0) 00000100:00100000:0.0:1784044348.175441:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397424d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99a46fb7-9af9-40f1-9c76-329d6781ee81+21:17196:x1870705581044736:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 79us (134us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044348.175446:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1784044348.175473:0:17196:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3947ee9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99a46fb7-9af9-40f1-9c76-329d6781ee81:17196:1870705581044736:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784044348.175483:0:17196:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9b38410b7e00/0x89871fc3aba19366 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba1936d expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044348.175490:0:17196:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9b38410b7e00/0x89871fc3aba19366 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x89871fc3aba1936d expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044348.175524:0:17196:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3947ee9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99a46fb7-9af9-40f1-9c76-329d6781ee81:17196:1870705581044864:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1784044348.175551:0:17196:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044348.175563:0:17196:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3965ee7f00 going to sleep for 11 seconds 00000100:00100000:0.0:1784044348.175573:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581044864 00000100:00100000:0.0:1784044348.175576:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581044864 00000100:00100000:0.0:1784044348.175593:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1784044348.175599:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397424f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99a46fb7-9af9-40f1-9c76-329d6781ee81+21:17196:x1870705581044864:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1784044348.175608:0:17192:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1784044348.175618:0:17192:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1784044348.175621:0:17192:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:0.0:1784044348.175677:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397424f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99a46fb7-9af9-40f1-9c76-329d6781ee81+21:17196:x1870705581044864:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 77us (124us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044348.175682:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1784044348.175709:0:17196:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3947ee9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99a46fb7-9af9-40f1-9c76-329d6781ee81:17196:1870705581044864:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1784044348.175751:0:17196:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1784044348.175757:0:17196:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b38410b7e00/0x89871fc3aba19366 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba1936d expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044348.175764:0:17196:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9b38410b7e00/0x89871fc3aba19366 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba1936d expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044348.431526:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1784044348.628393:0:18782:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1784044348.628706:0:18782:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1784044349.455496:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784044349.518323:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3947ee9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1870705581044992:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1784044349.518404:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044349.518702:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1784044349.518712:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b38436a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1870705581045120:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1784044349.518739:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044349.518774:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581044992 00000100:00100000:1.0:1784044349.518783:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581044992 00000100:00100000:1.0:1784044349.518818:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581045120 00000100:00100000:1.0:1784044349.518820:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581045120 00000100:00100000:1.0:1784044349.518834:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1784044349.518842:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38436a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1870705581044992:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1784044349.518878:0:17205:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1784044349.518930:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38436a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1870705581044992:12345-0@lo:41:osp-pre-0-1.0 Request processed in 87us (525us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044349.518937:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1784044349.518964:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1784044349.518971:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38436a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1870705581045120:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1784044349.518996:0:17205:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1784044349.519029:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38436a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1870705581045120:12345-0@lo:41:osp-pre-1-0.0 Request processed in 58us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044349.519035:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1784044349.519093:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b38436a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1870705581045120:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1784044349.519123:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3947ee9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1870705581044992:0@lo:41:osp-pre-0-1.0 00000040:00080000:0.0:1784044350.360041:0:17952:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1784044350.482652:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784044351.518274:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784044352.526569:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1784044352.591372:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1784044352.591389:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1784044352.591392:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1784044352.591395:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1784044352.591412:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1784044352.591415:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1784044352.591417:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1784044352.591421:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1784044352.591636:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843ce4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:99a46fb7-9af9-40f1-9c76-329d6781ee81:3641:1870705581045248:0@lo:400:kworker.0 00000100:00100000:2.0:1784044352.591715:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044352.591758:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843ce4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3641:1870705581045760:0@lo:400:kworker.0 00000100:00100000:2.0:1784044352.591846:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044352.591879:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1784044352.591885:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843ce5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1870705581045632:0@lo:400:kworker.0 00000100:00100000:2.0:1784044352.591907:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044352.591932:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843ce5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1870705581045376:0@lo:400:kworker.0 00000100:00100000:2.0:1784044352.591952:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044352.591967:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843ce5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1870705581045888:0@lo:400:kworker.0 00000100:00100000:2.0:1784044352.591989:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044352.592017:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581045248 00000100:00100000:2.0:1784044352.592022:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581045248 00000100:00100000:2.0:1784044352.592078:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1784044352.592088:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397424e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99a46fb7-9af9-40f1-9c76-329d6781ee81+21:3641:x1870705581045248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784044352.592131:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397424e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99a46fb7-9af9-40f1-9c76-329d6781ee81+21:3641:x1870705581045248:12345-0@lo:400:kworker.0 Request processed in 43us (415us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044352.592139:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1784044352.592167:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581045632 00000100:00100000:2.0:1784044352.592170:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581045632 00000100:00100000:3.0:1784044352.592597:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843ce6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3639:1870705581045504:0@lo:400:kworker.0 00000100:00100000:3.0:1784044352.592625:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044352.592649:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843ce4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3639:1870705581046016:0@lo:400:kworker.0 00000100:00100000:3.0:1784044352.592670:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044352.592722:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581045376 00000100:00100000:2.0:1784044352.592725:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581045376 00000100:00100000:2.0:1784044352.592738:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1784044352.592744:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3975b7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1870705581045632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784044352.592854:0:18572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581045760 00000100:00100000:0.0:1784044352.592858:0:18572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581045760 00000100:00100000:0.0:1784044352.592876:0:18572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581045888 00000100:00100000:0.0:1784044352.592878:0:18572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581045888 00000100:00100000:0.0:1784044352.592930:0:18572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581045504 00000100:00100000:0.0:1784044352.592933:0:18572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581045504 00000100:00100000:0.0:1784044352.592942:0:18572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581046016 00000100:00100000:0.0:1784044352.592943:0:18572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581046016 00000100:00100000:2.0:1784044352.592961:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3975b7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1870705581045632:12345-0@lo:400:kworker.0 Request processed in 32us (867us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044352.592968:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1784044352.592988:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1784044352.592994:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3975b7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1870705581045376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784044352.593027:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3975b7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1870705581045376:12345-0@lo:400:kworker.0 Request processed in 33us (1073us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044352.593033:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1784044352.593083:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843ce5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1870705581045376:0@lo:400:kworker.0 00000100:00100000:2.0:1784044352.593107:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843ce5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1870705581045632:0@lo:400:kworker.0 00000100:00100000:2.0:1784044352.593115:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843ce4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:99a46fb7-9af9-40f1-9c76-329d6781ee81:3641:1870705581045248:0@lo:400:kworker.0 00000100:00100000:1.0:1784044352.593238:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1784044352.593247:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3975b7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1870705581045760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044352.593279:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3975b7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1870705581045760:12345-0@lo:400:kworker.0 Request processed in 34us (1433us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044352.593285:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1784044352.593296:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1784044352.593301:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39759b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1870705581045888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044352.593324:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39759b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1870705581045888:12345-0@lo:400:kworker.0 Request processed in 22us (1334us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044352.593330:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1784044352.593338:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1784044352.593343:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843ce5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1870705581045504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044352.593368:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843ce5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1870705581045504:12345-0@lo:400:kworker.0 Request processed in 25us (742us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044352.593374:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:2.0:1784044352.594156:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b3843ce5c00 x1870705581045888/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044368 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784044352.594170:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843ce5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1870705581045888:0@lo:400:kworker.0 00010000:00080000:2.0:1784044352.594223:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b3843ce4380 x1870705581045760/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044368 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784044352.594233:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843ce4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3641:1870705581045760:0@lo:400:kworker.0 00000100:00080000:3.0:1784044352.594893:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1784044352.594897:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1784044352.594921:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b3843ce6680 x1870705581045504/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044368 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784044352.594931:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843ce6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3639:1870705581045504:0@lo:400:kworker.0 00000100:00100000:0.0:1784044352.595066:0:18572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1784044352.595075:0:18572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843ce7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1870705581046016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784044352.595139:0:18572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843ce7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1870705581046016:12345-0@lo:400:kworker.0 Request processed in 66us (2467us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044352.595144:0:18572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:2.0:1784044352.595309:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b3843ce4700 x1870705581046016/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044368 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784044352.595318:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843ce4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3639:1870705581046016:0@lo:400:kworker.0 00000100:00100000:1.0:1784044353.231599:0:3637:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1784044338/real 1784044338] req@ffff9b38436a2300 x1870705581038464/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1784044353 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784044353.231652:0:3637:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9b38436a2300 x1870705581038464/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1784044353 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784044353.231663:0:3637:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1784044338/real 1784044338] req@ffff9b38436a0000 x1870705581038592/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1784044353 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784044353.231673:0:3637:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9b38436a0000 x1870705581038592/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1784044353 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1784044353.231695:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9b3970ff4800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1784044353.231724:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1784044353.231728:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b38436a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1870705581038464:0@lo:8:kworker.0 00000100:00080000:1.0:1784044353.231734:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9b3944fd3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1784044353.231738:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1784044353.231742:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b38436a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1870705581038592:0@lo:8:kworker.0 00000100:00080000:0.0:1784044353.231872:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1784044353.231877:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1784044353.231879:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1784044353.231882:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1784044353.231906:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1784044353.231914:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1784044353.231917:0:36:0:(import.c:65:import_set_state_nolock()) ffff9b3970ff4800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1784044353.231922:0:36:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 531 00000100:00080000:0.0:1784044353.231927:0:36:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1784044353.231933:0:36:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9b3970ff4800 using connection 192.168.202.140@tcp/0@lo 00000100:00100000:0.0:1784044353.231952:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b3947ee9c00 x1870705581046656/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1784044353.231962:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1784044353.231965:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1784044353.231966:0:36:0:(import.c:65:import_set_state_nolock()) ffff9b3944fd3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1784044353.231969:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 531 00000100:00080000:0.0:1784044353.231971:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1784044353.231973:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9b3944fd3800 using connection 192.168.202.140@tcp/0@lo 00000100:00100000:0.0:1784044353.231982:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b3947ee9500 x1870705581046784/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1784044353.232018:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3947ee9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1870705581046400:0@lo:400:kworker.0 00000100:00100000:0.0:1784044353.232098:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044353.232126:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3945933b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1870705581047168:0@lo:400:kworker.0 00000100:00100000:0.0:1784044353.232143:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044353.232157:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784044353.232162:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3947eead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1870705581046528:0@lo:400:kworker.0 00000100:00100000:0.0:1784044353.232199:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044353.232228:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581046528 00000100:00100000:0.0:1784044353.232235:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581046528 00000100:00100000:0.0:1784044353.232275:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1784044353.232289:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3945933800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1870705581046528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784044353.232335:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3945933800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1870705581046528:12345-0@lo:400:kworker.0 Request processed in 47us (134us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044353.232342:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1784044353.232378:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3947eead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1870705581046528:0@lo:400:kworker.0 00000100:00100000:1.0:1784044353.232635:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3947eea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1870705581046272:0@lo:400:kworker.0 00000100:00100000:1.0:1784044353.232662:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044353.232685:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3945933100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3641:1870705581047040:0@lo:400:kworker.0 00000100:00100000:1.0:1784044353.232707:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044353.232722:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1784044353.232726:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3947ee8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:99a46fb7-9af9-40f1-9c76-329d6781ee81:3641:1870705581046144:0@lo:400:kworker.0 00000100:00100000:1.0:1784044353.232749:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044353.232773:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3947ee8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3641:1870705581046912:0@lo:400:kworker.0 00000100:00100000:1.0:1784044353.232807:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044353.232831:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3947ee9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1870705581046656:0@lo:8:kworker.0 00000100:00100000:1.0:1784044353.232861:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044353.232874:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3947ee9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1870705581046784:0@lo:8:kworker.0 00000100:00100000:1.0:1784044353.232889:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044353.232919:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581046400 00000100:00100000:1.0:1784044353.232923:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581046400 00000100:00100000:1.0:1784044353.232943:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581047168 00000100:00100000:1.0:1784044353.232945:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581047168 00000100:00100000:1.0:1784044353.232955:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581047040 00000100:00100000:1.0:1784044353.232957:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581047040 00000100:00100000:1.0:1784044353.232964:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581046912 00000100:00100000:1.0:1784044353.232966:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581046912 00000100:00100000:1.0:1784044353.232977:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1784044353.232982:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3945930e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1870705581046400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044353.233013:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3945930e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1870705581046400:12345-0@lo:400:kworker.0 Request processed in 30us (915us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044353.233019:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1784044353.233050:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1784044353.233056:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3945930380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1870705581047168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044353.233080:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3945930380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1870705581047168:12345-0@lo:400:kworker.0 Request processed in 25us (936us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044353.233086:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1784044353.233096:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1784044353.233101:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38436a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1870705581047040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044353.233124:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38436a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1870705581047040:12345-0@lo:400:kworker.0 Request processed in 24us (417us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044353.233130:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1784044353.233139:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1784044353.233149:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38436a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1870705581046912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044353.233190:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38436a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1870705581046912:12345-0@lo:400:kworker.0 Request processed in 24us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044353.233197:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1784044353.233216:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581046144 00000100:00100000:1.0:1784044353.233219:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581046144 00000100:00100000:1.0:1784044353.233239:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1784044353.233244:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397424f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99a46fb7-9af9-40f1-9c76-329d6781ee81+21:3641:x1870705581046144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044353.233268:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397424f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99a46fb7-9af9-40f1-9c76-329d6781ee81+21:3641:x1870705581046144:12345-0@lo:400:kworker.0 Request processed in 23us (518us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044353.233273:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1784044353.233304:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3947ee8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:99a46fb7-9af9-40f1-9c76-329d6781ee81:3641:1870705581046144:0@lo:400:kworker.0 00010000:00080000:1.0:1784044353.233314:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b3947ee8e00 x1870705581046912/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044369 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784044353.233323:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3947ee8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3641:1870705581046912:0@lo:400:kworker.0 00010000:00080000:1.0:1784044353.233331:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b3945933100 x1870705581047040/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044369 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784044353.233352:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3945933100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3641:1870705581047040:0@lo:400:kworker.0 00010000:00080000:1.0:1784044353.233383:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b3947ee9880 x1870705581046400/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044369 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784044353.233390:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3947ee9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1870705581046400:0@lo:400:kworker.0 00010000:00080000:1.0:1784044353.233402:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b3945933b80 x1870705581047168/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044369 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784044353.233420:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3945933b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1870705581047168:0@lo:400:kworker.0 00000100:00100000:1.0:1784044353.233459:0:18707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581046656 00000100:00100000:1.0:1784044353.233462:0:18707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581046656 00000100:00100000:1.0:1784044353.233474:0:18707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581046784 00000100:00100000:1.0:1784044353.233476:0:18707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581046784 00000100:00100000:1.0:1784044353.233484:0:18707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1784044353.233488:0:18707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38436a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3637:x1870705581046656:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1784044353.233512:0:18707:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 546 last 0 00000020:00000080:1.0:1784044353.233537:0:18707:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x89871fc3aba19374 00002000:00100000:1.0:1784044353.233550:0:18707:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff9b3842443800 ocd_connect_flags: 0xa044401443000026 ocd_version: 21136a2 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:1.0:1784044353.233555:0:18707:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:1.0:1784044353.233558:0:18707:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1784044353.233734:0:18707:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:1.0:1784044353.233757:0:18707:0:(import.c:65:import_set_state_nolock()) ffff9b3842441000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1784044353.233794:0:18707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38436a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3637:x1870705581046656:12345-0@lo:8:kworker.0 Request processed in 304us (932us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044353.233801:0:18707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1784044353.233813:0:18707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1784044353.233817:0:18707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38436a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3637:x1870705581046784:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1784044353.233828:0:18707:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1784044353.235370:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581046272 00000100:00100000:0.0:1784044353.235379:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581046272 00000100:00100000:0.0:1784044353.235424:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1784044353.235431:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38436a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1870705581046272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784044353.235501:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38436a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1870705581046272:12345-0@lo:400:kworker.0 Request processed in 71us (2838us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044353.235508:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:0.0:1784044353.235565:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b3947ee9c00 x1870705581046656/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1784044373 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784044353.235575:0:3637:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1784044353.235584:0:3637:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 2 00000100:00080000:0.0:1784044353.235591:0:3637:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1784044353.235595:0:3637:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1784044353.235598:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9b3970ff4800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1784044353.235610:0:3637:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1784044353.235615:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3947ee9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1870705581046656:0@lo:8:kworker.0 00000100:00100000:0.0:1784044353.235653:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3947eea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1870705581046272:0@lo:400:kworker.0 00000004:00080000:0.0:1784044353.235704:0:17942:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:0.0:1784044353.235722:0:17942:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3945930a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17942:1870705581047424:0@lo:7:osp-pre-0-1.0 00000100:00100000:0.0:1784044353.235751:0:17942:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044353.235776:0:17942:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3965ee7cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1784044353.235788:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3945933480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1870705581047296:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1784044353.235812:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044353.236383:0:18706:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1784044353.236394:0:18706:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:2.0:1784044353.236409:0:18708:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1784044353.236418:0:18708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581047424 00000100:00100000:2.0:1784044353.236422:0:18708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581047424 00000004:00080000:2.0:1784044353.236457:0:17941:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1784044353.236548:0:17941:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 546407372820ns, next at 0ns, rc = 0 00080000:00080000:2.0:1784044353.236561:0:17941:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:2.0:1784044353.236588:0:18709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581047296 00000100:00100000:2.0:1784044353.236591:0:18709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581047296 00000100:00100000:2.0:1784044353.236613:0:18709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1784044353.236619:0:18709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3945932300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3639:x1870705581047296:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1784044353.236640:0:18709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1784044353.236692:0:18709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3945932300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3639:x1870705581047296:12345-0@lo:13:osp-pre-0-1.0 Request processed in 72us (879us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044353.236699:0:18709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:2.0:1784044353.236714:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1784044353.236894:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b3945933480 x1870705581047296/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784044369 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784044353.236909:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3945933480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1870705581047296:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1784044353.242159:0:18933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1784044353.242216:0:18933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3945931500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17942:x1870705581047424:12345-0@lo:7:osp-pre-0-1.0 00002000:00080000:0.0:1784044353.254211:0:18933:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:0.0:1784044353.254224:0:18933:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x21:0x0] 00000100:00100000:0.0:1784044353.254349:0:18933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3945931500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17942:x1870705581047424:12345-0@lo:7:osp-pre-0-1.0 Request processed in 12156us (18574us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044353.254362:0:18933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1784044353.254427:0:17942:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b3945930a80 x1870705581047424/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1784044369 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784044353.254441:0:17942:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3945930a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17942:1870705581047424:0@lo:7:osp-pre-0-1.0 00000004:00080000:0.0:1784044353.254454:0:17942:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x21:0x0] 00000100:00100000:0.0:1784044353.254497:0:17942:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3945930a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17942:1870705581047552:0@lo:5:osp-pre-0-1.0 00000100:00100000:0.0:1784044353.254528:0:17942:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044353.254559:0:17942:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3842748c00 going to sleep for 11 seconds 00000100:00100000:0.0:1784044353.254576:0:18933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581047552 00000100:00100000:0.0:1784044353.254582:0:18933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581047552 00000100:00100000:0.0:1784044353.254621:0:18933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1784044353.254630:0:18933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3945932680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17942:x1870705581047552:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:0.0:1784044353.254654:0:18933:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:0.0:1784044353.254678:0:18933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3945932680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17942:x1870705581047552:12345-0@lo:5:osp-pre-0-1.0 Request processed in 49us (150us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044353.254684:0:18933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1784044353.254702:0:17942:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b3945930a80 x1870705581047552/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1784044369 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784044353.254723:0:17942:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3945930a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17942:1870705581047552:0@lo:5:osp-pre-0-1.0 00000004:00080000:0.0:1784044353.254730:0:17942:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x21:0x0] 00000100:00100000:0.0:1784044353.254765:0:17942:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3945930a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17942:1870705581047680:0@lo:5:osp-pre-0-1.0 00000100:00100000:0.0:1784044353.254793:0:17942:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044353.254802:0:17942:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3842748c00 going to sleep for 11 seconds 00000100:00100000:0.0:1784044353.254814:0:18933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581047680 00000100:00100000:0.0:1784044353.254817:0:18933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581047680 00000100:00100000:0.0:1784044353.254832:0:18933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1784044353.254836:0:18933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3945931c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17942:x1870705581047680:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:0.0:1784044353.254865:0:18933:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 34 00000004:00080000:2.0:1784044353.258577:0:17933:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00000100:00100000:1.0:1784044353.268531:0:18707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38436a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3637:x1870705581046784:12345-0@lo:8:kworker.0 Request processed in 34706us (35635us total) trans 0 rc -19/-19 00000100:00100000:1.0:1784044353.268546:0:18707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:3.0:1784044353.285161:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9b3944fd3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1784044353.285186:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1784044353.285191:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3947ee9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1870705581046784:0@lo:8:kworker.0 00000001:00080000:3.0:1784044353.307142:0:18702:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:3.0:1784044353.307159:0:18702:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:1.0:1784044353.314129:0:18933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3945931c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:17942:x1870705581047680:12345-0@lo:5:osp-pre-0-1.0 Request processed in 59280us (59323us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1784044353.314156:0:18933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1784044353.314786:0:17942:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b3945930a80 x1870705581047680/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1784044369 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784044353.314798:0:17942:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 2 00000100:00100000:0.0:1784044353.314805:0:17942:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3945930a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17942:1870705581047680:0@lo:5:osp-pre-0-1.0 00000004:00080000:0.0:1784044353.314821:0:17942:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00000100:00100000:0.0:1784044353.314871:0:17942:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3945930a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17942:1870705581047808:0@lo:900:osp-pre-0-1.0 00000100:00100000:0.0:1784044353.314908:0:17942:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044353.314930:0:17942:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3842748c00 going to sleep for 11 seconds 00000100:00100000:1.0:1784044353.315057:0:17211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581047808 00000100:00100000:1.0:1784044353.315064:0:17211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581047808 00000100:00100000:1.0:1784044353.315109:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1784044353.315117:0:17211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3945931f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17942:x1870705581047808:12345-0@lo:900:osp-pre-0-1.0 00000100:00100000:1.0:1784044353.315193:0:17211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3945931f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17942:x1870705581047808:12345-0@lo:900:osp-pre-0-1.0 Request processed in 58us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044353.315201:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1784044353.315267:0:17942:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b3945930a80 x1870705581047808/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1784044369 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784044353.315294:0:17942:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3945930a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17942:1870705581047808:0@lo:900:osp-pre-0-1.0 00010000:00010000:2.0:1784044353.556270:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784044354.578579:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784044354.639893:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784044354.639919:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3945931180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1870705581047936:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1784044354.639989:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044354.640055:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581047936 00000100:00100000:0.0:1784044354.640064:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581047936 00000100:00100000:0.0:1784044354.640140:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1784044354.640149:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3945931880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1870705581047936:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1784044354.640214:0:17205:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1784044354.640263:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3945931880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1870705581047936:12345-0@lo:41:osp-pre-0-1.0 Request processed in 114us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044354.640270:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1784044354.640317:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3945931180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1870705581047936:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1784044354.649094:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39759b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1870705581048064:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1784044354.649194:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044354.649263:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581048064 00000100:00100000:2.0:1784044354.649270:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581048064 00000100:00100000:2.0:1784044354.649325:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1784044354.649335:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39759b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1870705581048064:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1784044354.649378:0:17205:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1784044354.649426:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39759b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1870705581048064:12345-0@lo:41:osp-pre-1-0.0 Request processed in 92us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044354.649434:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1784044354.649986:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39759b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1870705581048064:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1784044355.598933:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1784044355.981876:0:17236:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1784044356.622398:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1784044356.681552:0:19073:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg240-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:0.0:1784044357.325277:0:3637:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1784044337/real 1784044337] req@ffff9b3843736a00 x1870705581036800/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1784044357 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784044357.325310:0:3637:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9b3843736a00 x1870705581036800/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1784044357 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784044357.325320:0:3637:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1784044337/real 1784044337] req@ffff9b3843735500 x1870705581036928/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1784044357 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784044357.325331:0:3637:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9b3843735500 x1870705581036928/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1784044357 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1784044357.325349:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9b396f25c000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1784044357.325903:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1784044357.325909:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843736a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1870705581036800:0@lo:8:kworker.0 00000100:00080000:0.0:1784044357.325917:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9b397b804800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1784044357.328588:0:14129:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1784044357.328595:0:14129:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1784044357.328599:0:14129:0:(import.c:65:import_set_state_nolock()) ffff9b396f25c000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784044357.328607:0:14129:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 530 00000100:00080000:1.0:1784044357.328613:0:14129:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1784044357.328622:0:14129:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9b396f25c000 using connection 192.168.202.140@tcp/0@lo 00000100:00100000:1.0:1784044357.328645:0:14129:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b3843734a80 x1870705581048448/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1784044357.328656:0:14129:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1784044357.328660:0:14129:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1784044357.328661:0:14129:0:(import.c:65:import_set_state_nolock()) ffff9b397b804800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784044357.328665:0:14129:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 530 00000100:00080000:1.0:1784044357.328667:0:14129:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1784044357.328671:0:14129:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9b397b804800 using connection 192.168.202.140@tcp/0@lo 00000100:00100000:1.0:1784044357.328681:0:14129:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b3843735180 x1870705581048576/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1784044357.328734:0:14129:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1784044357.328737:0:14129:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1784044357.328739:0:14129:0:(import.c:65:import_set_state_nolock()) ffff9b3944fd3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784044357.328742:0:14129:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 546 00000100:00080000:1.0:1784044357.328745:0:14129:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1784044357.328749:0:14129:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9b3944fd3800 using connection 192.168.202.140@tcp/0@lo 00000100:00100000:1.0:1784044357.328759:0:14129:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b3843737800 x1870705581049088/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1784044357.328809:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b38436a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:99a46fb7-9af9-40f1-9c76-329d6781ee81:3638:1870705581048192:0@lo:400:kworker.0 00000100:00100000:1.0:1784044357.328879:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044357.328928:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843737480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1870705581048960:0@lo:400:kworker.0 00000100:00100000:1.0:1784044357.328953:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044357.328980:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1784044357.328985:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b38436a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1870705581048320:0@lo:400:kworker.0 00000100:00100000:1.0:1784044357.329023:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044357.329042:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843737100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1870705581049216:0@lo:400:kworker.0 00000100:00100000:1.0:1784044357.329066:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044357.329107:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843734700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1870705581048704:0@lo:400:kworker.0 00000100:00100000:1.0:1784044357.329131:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044357.329146:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843735c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3640:1870705581049344:0@lo:400:kworker.0 00000100:00100000:1.0:1784044357.329165:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044357.329205:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1784044357.329211:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843736680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1870705581048832:0@lo:400:kworker.0 00000100:00100000:1.0:1784044357.329242:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044357.329260:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1870705581049472:0@lo:400:kworker.0 00000100:00100000:1.0:1784044357.329280:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044357.329311:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581048192 00000100:00100000:1.0:1784044357.329318:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581048192 00000100:00100000:1.0:1784044357.329361:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1784044357.329370:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397424ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99a46fb7-9af9-40f1-9c76-329d6781ee81+21:3638:x1870705581048192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044357.329416:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397424ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99a46fb7-9af9-40f1-9c76-329d6781ee81+21:3638:x1870705581048192:12345-0@lo:400:kworker.0 Request processed in 46us (536us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044357.329423:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1784044357.329452:0:18708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581048960 00000100:00100000:1.0:1784044357.329456:0:18708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581048960 00000100:00100000:1.0:1784044357.329490:0:18708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1784044357.329497:0:18708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d4f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1870705581048960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044357.329528:0:18708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d4f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1870705581048960:12345-0@lo:400:kworker.0 Request processed in 32us (574us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044357.329534:0:18708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1784044357.329552:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581048320 00000100:00100000:1.0:1784044357.329555:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581048320 00000100:00100000:1.0:1784044357.329572:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581048832 00000100:00100000:1.0:1784044357.329575:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581048832 00000100:00100000:1.0:1784044357.329589:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1784044357.329595:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1870705581048320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044357.329624:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1870705581048320:12345-0@lo:400:kworker.0 Request processed in 29us (601us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044357.329629:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1784044357.329641:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1784044357.329653:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1870705581048832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044357.329687:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1870705581048832:12345-0@lo:400:kworker.0 Request processed in 34us (443us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044357.329691:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1784044357.329706:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581049216 00000100:00100000:1.0:1784044357.329709:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581049216 00000100:00100000:1.0:1784044357.329724:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581048704 00000100:00100000:1.0:1784044357.329727:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581048704 00000100:00100000:1.0:1784044357.329736:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581049344 00000100:00100000:1.0:1784044357.329738:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581049344 00000100:00100000:1.0:1784044357.329749:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581049472 00000100:00100000:1.0:1784044357.329752:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581049472 00000100:00100000:1.0:1784044357.329766:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1784044357.329771:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1870705581049216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044357.329795:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1870705581049216:12345-0@lo:400:kworker.0 Request processed in 24us (729us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044357.329800:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1784044357.329809:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1784044357.329813:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1870705581048704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044357.329833:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1870705581048704:12345-0@lo:400:kworker.0 Request processed in 20us (702us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044357.329838:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1784044357.329847:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1784044357.329852:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1870705581049344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044357.329874:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1870705581049344:12345-0@lo:400:kworker.0 Request processed in 22us (709us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044357.329878:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1784044357.329896:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1784044357.329901:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1870705581049472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044357.329938:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1870705581049472:12345-0@lo:400:kworker.0 Request processed in 38us (657us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044357.329944:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:1.0:1784044357.329973:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1784044357.329976:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1784044357.329979:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784044357.330017:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843736680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1870705581048832:0@lo:400:kworker.0 00010000:00080000:1.0:1784044357.330030:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b3843d4e300 x1870705581049472/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044373 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784044357.330039:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1870705581049472:0@lo:400:kworker.0 00010000:00080000:1.0:1784044357.330047:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b3843734700 x1870705581048704/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044373 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784044357.330054:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843734700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1870705581048704:0@lo:400:kworker.0 00010000:00080000:1.0:1784044357.330061:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b3843735c00 x1870705581049344/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044373 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784044357.330069:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843735c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3640:1870705581049344:0@lo:400:kworker.0 00000100:00100000:1.0:1784044357.330101:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b38436a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1870705581048320:0@lo:400:kworker.0 00010000:00080000:1.0:1784044357.330110:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b3843737100 x1870705581049216/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044373 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784044357.330117:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843737100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1870705581049216:0@lo:400:kworker.0 00000100:00100000:1.0:1784044357.330124:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b38436a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:99a46fb7-9af9-40f1-9c76-329d6781ee81:3638:1870705581048192:0@lo:400:kworker.0 00010000:00080000:1.0:1784044357.330140:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b3843737480 x1870705581048960/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784044373 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784044357.330148:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843737480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1870705581048960:0@lo:400:kworker.0 00000100:00080000:0.0:1784044357.333218:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1784044357.333230:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843735500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1870705581036928:0@lo:8:kworker.0 00000100:00100000:0.0:1784044357.333274:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843734a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1870705581048448:0@lo:8:kworker.0 00000100:00100000:0.0:1784044357.337301:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044357.337380:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843735180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1870705581048576:0@lo:8:kworker.0 00000100:00100000:0.0:1784044357.337428:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044357.337447:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843737800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1870705581049088:0@lo:8:kworker.0 00000100:00100000:0.0:1784044357.337470:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044357.337563:0:18708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581048448 00000100:00100000:0.0:1784044357.337572:0:18708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581048448 00000100:00100000:0.0:1784044357.337605:0:18708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581048576 00000100:00100000:0.0:1784044357.337608:0:18708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581048576 00000100:00100000:0.0:1784044357.337616:0:18708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581049088 00000100:00100000:0.0:1784044357.337618:0:18708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581049088 00000100:00100000:0.0:1784044357.337631:0:18708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1784044357.337637:0:18708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3945931180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3637:x1870705581048448:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1784044357.337672:0:18708:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 550 last 0 00000020:00000080:0.0:1784044357.337703:0:18708:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x89871fc3aba1937b 00002000:00100000:0.0:1784044357.337717:0:18708:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9b38423e6000 ocd_connect_flags: 0xa044401443000026 ocd_version: 21136a2 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1784044357.337721:0:18708:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:0.0:1784044357.337724:0:18708:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1784044357.337797:0:18708:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1784044357.337822:0:18708:0:(import.c:65:import_set_state_nolock()) ffff9b38423e1000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1784044357.337877:0:18708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3945931180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3637:x1870705581048448:12345-0@lo:8:kworker.0 Request processed in 239us (585us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044357.337885:0:18708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1784044357.337902:0:18708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1784044357.337906:0:18708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3945930000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3637:x1870705581048576:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1784044357.337918:0:18708:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1784044357.337959:0:18708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3945930000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3637:x1870705581048576:12345-0@lo:8:kworker.0 Request processed in 51us (530us total) trans 0 rc -19/-19 00000100:00100000:0.0:1784044357.337966:0:18708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1784044357.337976:0:18708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1784044357.337981:0:18708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3945932a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3637:x1870705581049088:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1784044357.337990:0:18708:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1784044357.397818:0:18708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3945932a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3637:x1870705581049088:12345-0@lo:8:kworker.0 Request processed in 59826us (60337us total) trans 0 rc -19/-19 00000100:00100000:0.0:1784044357.397833:0:18708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1784044357.399034:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b3843734a80 x1870705581048448/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1784044382 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784044357.399047:0:3637:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1784044357.399060:0:3637:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1784044357.399070:0:3637:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1784044357.399076:0:3637:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1784044357.399080:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9b396f25c000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1784044357.399448:0:3637:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1784044357.399456:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843734a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1870705581048448:0@lo:8:kworker.0 00000100:00080000:3.0:1784044357.399477:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9b397b804800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1784044357.399481:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1784044357.399485:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843735180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1870705581048576:0@lo:8:kworker.0 00000100:00080000:3.0:1784044357.399494:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9b3944fd3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1784044357.399497:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1784044357.399500:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843737800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1870705581049088:0@lo:8:kworker.0 00000004:00080000:1.0:1784044357.402578:0:17224:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1784044357.402712:0:17224:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 550573536382ns, next at 0ns, rc = 0 00080000:00080000:1.0:1784044357.402722:0:17224:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:0.0:1784044357.411857:0:17225:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x6:0x0] 00000100:00100000:0.0:1784044357.411887:0:17225:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3945930700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17225:1870705581049728:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1784044357.411961:0:17225:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044357.412018:0:17225:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3965ee7cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1784044357.412040:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784044357.412056:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3945932d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1870705581049600:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784044357.412108:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044357.412289:0:18706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581049728 00000100:00100000:2.0:1784044357.412299:0:18706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581049728 00000100:00100000:2.0:1784044357.414161:0:18709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581049600 00000100:00100000:2.0:1784044357.414190:0:18709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581049600 00000100:00100000:2.0:1784044357.414270:0:18709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1784044357.414282:0:18709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3945933480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3639:x1870705581049600:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1784044357.414322:0:18709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1784044357.414420:0:18709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3945933480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3639:x1870705581049600:12345-0@lo:13:osp-pre-0-0.0 Request processed in 141us (2312us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044357.414428:0:18709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1784044357.414570:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b3945932d80 x1870705581049600/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784044373 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784044357.414592:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3945932d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1870705581049600:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784044357.414631:0:18933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1784044357.414641:0:18933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3945930a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:17225:x1870705581049728:12345-0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1784044357.415574:0:17179:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00080000:0.0:1784044357.415735:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00080000:3.0:1784044357.416319:0:18933:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:3.0:1784044357.416329:0:18933:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:3.0:1784044357.416335:0:18933:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:7 to 0x280000401:33) 00002000:00010000:3.0:1784044357.423249:0:18933:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784044357.423263:0:18933:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000585760e8/0x89871fc3aba19382 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044357.423292:0:18933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=550s v=(0 0) 00010000:00010000:3.0:1784044357.423297:0:18933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784044357.423305:0:18933:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000585760e8/0x89871fc3aba19382 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044357.423324:0:18933:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000585760e8/0x89871fc3aba19382 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044357.423336:0:18933:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000585760e8/0x89871fc3aba19382 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044357.423345:0:18933:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000585760e8/0x89871fc3aba19382 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044357.423375:0:18933:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784044357.423922:0:17187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784044357.423931:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000585760e8/0x89871fc3aba19382 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044357.423942:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3982054c00 already unused, calling callback (ffffffffc0b56230) 00010000:00010000:1.0:1784044357.423947:0:17187:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000585760e8/0x89871fc3aba19382 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044357.423957:0:17187:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000585760e8/0x89871fc3aba19382 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044357.423978:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000585760e8/0x89871fc3aba19382 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044357.423986:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000585760e8/0x89871fc3aba19382 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044357.424035:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784044357.424036:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784044357.424038:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784044357.431128:0:18933:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784044357.431145:0:18933:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000046c1e458/0x89871fc3aba19389 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044357.431165:0:18933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=550s v=(0 0) 00010000:00010000:1.0:1784044357.431170:0:18933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784044357.431225:0:18933:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000046c1e458/0x89871fc3aba19389 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044357.431240:0:18933:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000046c1e458/0x89871fc3aba19389 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044357.431251:0:18933:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000046c1e458/0x89871fc3aba19389 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044357.431259:0:18933:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000046c1e458/0x89871fc3aba19389 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044357.431279:0:18933:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784044357.431291:0:17188:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784044357.431296:0:17188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000046c1e458/0x89871fc3aba19389 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044357.431303:0:17188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38426fd400 already unused, calling callback (ffffffffc0b56230) 00010000:00010000:1.0:1784044357.431308:0:17188:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000046c1e458/0x89871fc3aba19389 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044357.431335:0:17188:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000046c1e458/0x89871fc3aba19389 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044357.431353:0:17188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000046c1e458/0x89871fc3aba19389 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044357.431360:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000046c1e458/0x89871fc3aba19389 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044357.431391:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784044357.431393:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784044357.431395:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784044357.432135:0:18933:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784044357.432144:0:18933:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002424fa9e/0x89871fc3aba19390 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044357.432156:0:18933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=550s v=(0 0) 00010000:00010000:1.0:1784044357.432159:0:18933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784044357.432163:0:18933:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002424fa9e/0x89871fc3aba19390 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044357.432202:0:18933:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002424fa9e/0x89871fc3aba19390 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044357.432212:0:18933:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002424fa9e/0x89871fc3aba19390 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044357.432227:0:18933:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002424fa9e/0x89871fc3aba19390 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044357.432244:0:18933:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784044357.432566:0:17187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784044357.432573:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002424fa9e/0x89871fc3aba19390 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044357.432582:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38426fc400 already unused, calling callback (ffffffffc0b56230) 00010000:00010000:2.0:1784044357.432586:0:17187:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002424fa9e/0x89871fc3aba19390 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044357.432594:0:17187:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002424fa9e/0x89871fc3aba19390 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044357.432616:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002424fa9e/0x89871fc3aba19390 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044357.432624:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002424fa9e/0x89871fc3aba19390 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044357.432642:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784044357.432644:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784044357.432646:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784044357.432870:0:18933:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784044357.432876:0:18933:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dc93ff9c/0x89871fc3aba19397 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044357.432884:0:18933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=550s v=(0 0) 00010000:00010000:1.0:1784044357.432887:0:18933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784044357.432892:0:18933:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dc93ff9c/0x89871fc3aba19397 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044357.432901:0:18933:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dc93ff9c/0x89871fc3aba19397 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044357.432909:0:18933:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dc93ff9c/0x89871fc3aba19397 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044357.432916:0:18933:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dc93ff9c/0x89871fc3aba19397 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044357.433494:0:18933:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1784044357.436637:0:18933:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784044357.436651:0:18933:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009efb7f3c/0x89871fc3aba1939e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044357.436685:0:18933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=550s v=(0 0) 00010000:00010000:0.0:1784044357.436690:0:18933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784044357.436696:0:18933:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009efb7f3c/0x89871fc3aba1939e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044357.436727:0:18933:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009efb7f3c/0x89871fc3aba1939e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044357.436750:0:18933:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009efb7f3c/0x89871fc3aba1939e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044357.436758:0:18933:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009efb7f3c/0x89871fc3aba1939e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044357.442041:0:17188:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1784044357.442058:0:17188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dc93ff9c/0x89871fc3aba19397 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044357.442074:0:17188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38426fde00 already unused, calling callback (ffffffffc0b56230) 00010000:00010000:2.0:1784044357.442080:0:17188:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dc93ff9c/0x89871fc3aba19397 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044357.442091:0:17188:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dc93ff9c/0x89871fc3aba19397 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044357.442114:0:17188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dc93ff9c/0x89871fc3aba19397 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044357.442123:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dc93ff9c/0x89871fc3aba19397 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044357.442284:0:17188:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784044357.442291:0:17188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009efb7f3c/0x89871fc3aba1939e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044357.442299:0:17188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38410b7800 already unused, calling callback (ffffffffc0b56230) 00010000:00010000:3.0:1784044357.442303:0:17188:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009efb7f3c/0x89871fc3aba1939e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044357.442311:0:17188:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009efb7f3c/0x89871fc3aba1939e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044357.442333:0:17188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009efb7f3c/0x89871fc3aba1939e lrc: 2/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044357.442341:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784044357.442343:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784044357.442345:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784044357.443327:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784044357.443743:0:18933:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1784044357.443755:0:18933:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009efb7f3c/0x89871fc3aba1939e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784044357.449641:0:18933:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784044357.449655:0:18933:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003791ae2a/0x89871fc3aba193a5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044357.451309:0:18933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=550s v=(0 0) 00010000:00010000:3.0:1784044357.451315:0:18933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784044357.451326:0:18933:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003791ae2a/0x89871fc3aba193a5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044357.451342:0:18933:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003791ae2a/0x89871fc3aba193a5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044357.451354:0:18933:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003791ae2a/0x89871fc3aba193a5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044357.451361:0:18933:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003791ae2a/0x89871fc3aba193a5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044357.451459:0:18933:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784044357.452673:0:17188:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784044357.452685:0:17188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003791ae2a/0x89871fc3aba193a5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044357.452698:0:17188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3982055a00 already unused, calling callback (ffffffffc0b56230) 00010000:00010000:2.0:1784044357.452703:0:17188:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003791ae2a/0x89871fc3aba193a5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044357.452714:0:17188:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003791ae2a/0x89871fc3aba193a5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044357.452742:0:17188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003791ae2a/0x89871fc3aba193a5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044357.452751:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003791ae2a/0x89871fc3aba193a5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044357.452776:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784044357.452777:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784044357.452779:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784044357.459880:0:18933:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784044357.459897:0:18933:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000046c1e458/0x89871fc3aba193ac lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044357.459925:0:18933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=550s v=(0 0) 00010000:00010000:1.0:1784044357.459931:0:18933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784044357.459938:0:18933:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000046c1e458/0x89871fc3aba193ac lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044357.459954:0:18933:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000046c1e458/0x89871fc3aba193ac lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044357.459964:0:18933:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000046c1e458/0x89871fc3aba193ac lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044357.459971:0:18933:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000046c1e458/0x89871fc3aba193ac lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044357.459989:0:18933:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784044357.462915:0:17187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784044357.462933:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000046c1e458/0x89871fc3aba193ac lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044357.462950:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38426fd400 already unused, calling callback (ffffffffc0b56230) 00010000:00010000:0.0:1784044357.462956:0:17187:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000046c1e458/0x89871fc3aba193ac lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044357.462968:0:17187:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000046c1e458/0x89871fc3aba193ac lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044357.463004:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000046c1e458/0x89871fc3aba193ac lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044357.463028:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000046c1e458/0x89871fc3aba193ac lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044357.463054:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784044357.463056:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784044357.463058:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1784044357.465668:0:18933:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784044357.465687:0:18933:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e170421d/0x89871fc3aba193b3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044357.465705:0:18933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=550s v=(0 0) 00010000:00010000:0.0:1784044357.465709:0:18933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784044357.465716:0:18933:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e170421d/0x89871fc3aba193b3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044357.465744:0:18933:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e170421d/0x89871fc3aba193b3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044357.465754:0:18933:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e170421d/0x89871fc3aba193b3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044357.465763:0:18933:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e170421d/0x89871fc3aba193b3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044357.465784:0:18933:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1784044357.466772:0:18933:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784044357.466792:0:18933:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000095e25fff/0x89871fc3aba193ba lrc: 3/0,1 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044357.466806:0:18933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=550s v=(0 0) 00010000:00010000:0.0:1784044357.466810:0:18933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784044357.466816:0:18933:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000095e25fff/0x89871fc3aba193ba lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044357.466827:0:18933:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000095e25fff/0x89871fc3aba193ba lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044357.466835:0:18933:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000095e25fff/0x89871fc3aba193ba lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044357.466842:0:18933:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000095e25fff/0x89871fc3aba193ba lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044357.466858:0:18933:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1784044357.466868:0:17187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1784044357.466875:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e170421d/0x89871fc3aba193b3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044357.466883:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38410b6800 already unused, calling callback (ffffffffc0b56230) 00010000:00010000:0.0:1784044357.466889:0:17187:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e170421d/0x89871fc3aba193b3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044357.466898:0:17187:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e170421d/0x89871fc3aba193b3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044357.466923:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e170421d/0x89871fc3aba193b3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044357.466930:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e170421d/0x89871fc3aba193b3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044357.466935:0:17188:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784044357.466947:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784044357.466949:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784044357.466951:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1784044357.467594:0:18933:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784044357.467601:0:18933:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a21e3764/0x89871fc3aba193c1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044357.467611:0:18933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=550s v=(0 0) 00010000:00010000:0.0:1784044357.467614:0:18933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784044357.467619:0:18933:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a21e3764/0x89871fc3aba193c1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044357.467629:0:18933:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a21e3764/0x89871fc3aba193c1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044357.467638:0:18933:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a21e3764/0x89871fc3aba193c1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044357.467650:0:18933:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a21e3764/0x89871fc3aba193c1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044357.467691:0:18933:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1784044357.469543:0:18933:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784044357.469943:0:18933:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000024f94990/0x89871fc3aba193c8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044357.469963:0:17187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784044357.469964:0:18933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=550s v=(0 0) 00010000:00010000:0.0:1784044357.469969:0:18933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784044357.469972:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a21e3764/0x89871fc3aba193c1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044357.469977:0:18933:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000024f94990/0x89871fc3aba193c8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044357.469981:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38410b7c00 already unused, calling callback (ffffffffc0b56230) 00010000:00010000:1.0:1784044357.469986:0:17187:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a21e3764/0x89871fc3aba193c1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044357.470002:0:18933:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024f94990/0x89871fc3aba193c8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044357.470009:0:17187:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a21e3764/0x89871fc3aba193c1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044357.470012:0:18933:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000024f94990/0x89871fc3aba193c8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044357.470020:0:18933:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000024f94990/0x89871fc3aba193c8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044357.470032:0:18933:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784044357.470049:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a21e3764/0x89871fc3aba193c1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044357.470056:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a21e3764/0x89871fc3aba193c1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044357.470081:0:17187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784044357.470084:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000024f94990/0x89871fc3aba193c8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044357.470090:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38410b7a00 already unused, calling callback (ffffffffc0b56230) 00010000:00010000:1.0:1784044357.470093:0:17187:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000024f94990/0x89871fc3aba193c8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044357.470100:0:17187:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000024f94990/0x89871fc3aba193c8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044357.470108:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000024f94990/0x89871fc3aba193c8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044357.470115:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024f94990/0x89871fc3aba193c8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044357.470126:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784044357.470128:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784044357.470136:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784044357.471943:0:18933:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784044357.471953:0:18933:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000699267fc/0x89871fc3aba193cf lrc: 3/0,1 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044357.471967:0:18933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=550s v=(0 0) 00010000:00010000:1.0:1784044357.471971:0:18933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784044357.471978:0:18933:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000699267fc/0x89871fc3aba193cf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044357.471988:0:18933:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000699267fc/0x89871fc3aba193cf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044357.472010:0:18933:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000699267fc/0x89871fc3aba193cf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044357.472017:0:18933:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000699267fc/0x89871fc3aba193cf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044357.472035:0:18933:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784044357.472046:0:17187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784044357.472051:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000699267fc/0x89871fc3aba193cf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044357.472058:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38426fd200 already unused, calling callback (ffffffffc0b56230) 00010000:00010000:1.0:1784044357.472062:0:17187:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000699267fc/0x89871fc3aba193cf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044357.472083:0:17187:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000699267fc/0x89871fc3aba193cf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044357.472100:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000699267fc/0x89871fc3aba193cf lrc: 1/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044357.472107:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000699267fc/0x89871fc3aba193cf lrc: 0/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044357.472205:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784044357.472207:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784044357.472209:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784044357.472867:0:19100:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784044357.472871:0:19100:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784044357.472872:0:19100:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784044357.473882:0:17188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000095e25fff/0x89871fc3aba193ba lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044357.473896:0:17188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38410b6400 already unused, calling callback (ffffffffc0b56230) 00010000:00010000:1.0:1784044357.473900:0:17188:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000095e25fff/0x89871fc3aba193ba lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044357.473909:0:17188:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000095e25fff/0x89871fc3aba193ba lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044357.473925:0:17188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000095e25fff/0x89871fc3aba193ba lrc: 1/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044357.473950:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000095e25fff/0x89871fc3aba193ba lrc: 0/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044357.473972:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784044357.473974:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784044357.473976:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784044357.474066:0:18933:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784044357.474073:0:18933:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b8946bf4/0x89871fc3aba193d6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044357.474085:0:18933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=550s v=(0 0) 00010000:00010000:1.0:1784044357.474090:0:18933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784044357.474096:0:18933:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b8946bf4/0x89871fc3aba193d6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044357.474108:0:18933:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b8946bf4/0x89871fc3aba193d6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044357.474117:0:18933:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b8946bf4/0x89871fc3aba193d6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044357.474125:0:18933:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b8946bf4/0x89871fc3aba193d6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044357.474150:0:18933:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1784044357.475030:0:18933:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784044357.475044:0:18933:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ce82376f/0x89871fc3aba193dd lrc: 3/0,1 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044357.475055:0:18933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=550s v=(0 0) 00010000:00010000:1.0:1784044357.475058:0:18933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784044357.475064:0:18933:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ce82376f/0x89871fc3aba193dd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044357.475074:0:18933:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ce82376f/0x89871fc3aba193dd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044357.475082:0:18933:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ce82376f/0x89871fc3aba193dd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044357.475090:0:18933:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ce82376f/0x89871fc3aba193dd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044357.475110:0:18933:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1784044357.477095:0:18933:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784044357.478626:0:17187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1784044357.478642:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b8946bf4/0x89871fc3aba193d6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044357.478682:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38426fd000 already unused, calling callback (ffffffffc0b56230) 00010000:00010000:0.0:1784044357.478688:0:17187:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b8946bf4/0x89871fc3aba193d6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044357.478700:0:17187:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b8946bf4/0x89871fc3aba193d6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044357.478742:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b8946bf4/0x89871fc3aba193d6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044357.478750:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b8946bf4/0x89871fc3aba193d6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044357.478771:0:17187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784044357.478775:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ce82376f/0x89871fc3aba193dd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044357.478782:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38426fd600 already unused, calling callback (ffffffffc0b56230) 00010000:00010000:0.0:1784044357.478785:0:17187:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ce82376f/0x89871fc3aba193dd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044357.478792:0:17187:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ce82376f/0x89871fc3aba193dd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044357.478802:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ce82376f/0x89871fc3aba193dd lrc: 1/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044357.478818:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ce82376f/0x89871fc3aba193dd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044357.478833:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784044357.478834:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784044357.478836:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784044357.479089:0:18933:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000004f972a9/0x89871fc3aba193e4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044357.479104:0:18933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=550s v=(0 0) 00010000:00010000:1.0:1784044357.479109:0:18933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784044357.479511:0:18933:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000004f972a9/0x89871fc3aba193e4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044357.479527:0:18933:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000004f972a9/0x89871fc3aba193e4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044357.479793:0:18933:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000004f972a9/0x89871fc3aba193e4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044357.479804:0:18933:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000004f972a9/0x89871fc3aba193e4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044357.479831:0:18933:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1784044357.483007:0:18933:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784044357.483021:0:18933:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005040606c/0x89871fc3aba193eb lrc: 3/0,1 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044357.483038:0:18933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=550s v=(0 0) 00010000:00010000:1.0:1784044357.483043:0:18933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784044357.483049:0:18933:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005040606c/0x89871fc3aba193eb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044357.483063:0:18933:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005040606c/0x89871fc3aba193eb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044357.483072:0:18933:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005040606c/0x89871fc3aba193eb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044357.483080:0:18933:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005040606c/0x89871fc3aba193eb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044357.483135:0:18933:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1784044357.483153:0:17187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1784044357.483160:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000004f972a9/0x89871fc3aba193e4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044357.483168:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38426fcc00 already unused, calling callback (ffffffffc0b56230) 00010000:00010000:1.0:1784044357.483189:0:17187:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000004f972a9/0x89871fc3aba193e4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044357.483199:0:17187:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000004f972a9/0x89871fc3aba193e4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044357.483216:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000004f972a9/0x89871fc3aba193e4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044357.483224:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000004f972a9/0x89871fc3aba193e4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044357.483243:0:17187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784044357.483246:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005040606c/0x89871fc3aba193eb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044357.483252:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38426fc800 already unused, calling callback (ffffffffc0b56230) 00010000:00010000:1.0:1784044357.483255:0:17187:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005040606c/0x89871fc3aba193eb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044357.483273:0:17187:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005040606c/0x89871fc3aba193eb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044357.483284:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005040606c/0x89871fc3aba193eb lrc: 1/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044357.483291:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005040606c/0x89871fc3aba193eb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044357.483302:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784044357.483304:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784044357.483305:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784044357.483313:0:19100:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784044357.483681:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784044357.490596:0:18933:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784044357.490611:0:18933:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dc93ff9c/0x89871fc3aba193f2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044357.490630:0:18933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=550s v=(0 0) 00010000:00010000:1.0:1784044357.490635:0:18933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784044357.490642:0:18933:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dc93ff9c/0x89871fc3aba193f2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044357.490658:0:18933:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dc93ff9c/0x89871fc3aba193f2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044357.490668:0:18933:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dc93ff9c/0x89871fc3aba193f2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044357.490689:0:18933:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dc93ff9c/0x89871fc3aba193f2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044357.490714:0:18933:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784044357.491315:0:17187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784044357.491324:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dc93ff9c/0x89871fc3aba193f2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044357.491334:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38426fde00 already unused, calling callback (ffffffffc0b56230) 00010000:00010000:0.0:1784044357.491340:0:17187:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dc93ff9c/0x89871fc3aba193f2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044357.491350:0:17187:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dc93ff9c/0x89871fc3aba193f2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044357.491369:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dc93ff9c/0x89871fc3aba193f2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044357.491378:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dc93ff9c/0x89871fc3aba193f2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044357.491401:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784044357.491403:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784044357.491424:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784044357.492524:0:18933:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784044357.492538:0:18933:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002424fa9e/0x89871fc3aba193f9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044357.492564:0:18933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=550s v=(0 0) 00010000:00010000:1.0:1784044357.492569:0:18933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784044357.492575:0:18933:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002424fa9e/0x89871fc3aba193f9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044357.492591:0:18933:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002424fa9e/0x89871fc3aba193f9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044357.492600:0:18933:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002424fa9e/0x89871fc3aba193f9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044357.492606:0:18933:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002424fa9e/0x89871fc3aba193f9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044357.492629:0:18933:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1784044357.495066:0:18933:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784044357.495086:0:18933:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cdf57e91/0x89871fc3aba19400 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044357.495118:0:18933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=550s v=(0 0) 00010000:00010000:1.0:1784044357.495124:0:18933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784044357.495133:0:18933:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cdf57e91/0x89871fc3aba19400 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044357.495149:0:18933:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cdf57e91/0x89871fc3aba19400 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044357.495161:0:18933:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cdf57e91/0x89871fc3aba19400 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044357.495168:0:18933:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cdf57e91/0x89871fc3aba19400 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044357.495240:0:18933:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1784044357.496216:0:19100:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1784044357.496226:0:19100:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002424fa9e/0x89871fc3aba193f9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044357.496237:0:19100:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38426fc400 already unused, calling callback (ffffffffc0b56230) 00010000:00010000:0.0:1784044357.496242:0:19100:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002424fa9e/0x89871fc3aba193f9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044357.496251:0:19100:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002424fa9e/0x89871fc3aba193f9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044357.496273:0:19100:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002424fa9e/0x89871fc3aba193f9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044357.496281:0:19100:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002424fa9e/0x89871fc3aba193f9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044357.496302:0:19100:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784044357.496306:0:19100:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cdf57e91/0x89871fc3aba19400 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044357.496312:0:19100:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b397cb18e00 already unused, calling callback (ffffffffc0b56230) 00010000:00010000:0.0:1784044357.496315:0:19100:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cdf57e91/0x89871fc3aba19400 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044357.496323:0:19100:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cdf57e91/0x89871fc3aba19400 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044357.496350:0:19100:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cdf57e91/0x89871fc3aba19400 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044357.496358:0:19100:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cdf57e91/0x89871fc3aba19400 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044357.496370:0:19100:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784044357.496373:0:19100:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784044357.496375:0:19100:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784044357.496445:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784044357.499266:0:18933:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784044357.499283:0:18933:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000064306f5a/0x89871fc3aba19407 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044357.499303:0:18933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=550s v=(0 0) 00010000:00010000:1.0:1784044357.499307:0:18933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784044357.499315:0:18933:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000064306f5a/0x89871fc3aba19407 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044357.499329:0:18933:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000064306f5a/0x89871fc3aba19407 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044357.499361:0:18933:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000064306f5a/0x89871fc3aba19407 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044357.499369:0:18933:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000064306f5a/0x89871fc3aba19407 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044357.499392:0:18933:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784044357.500198:0:17187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784044357.500208:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000064306f5a/0x89871fc3aba19407 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044357.500219:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b397cb19200 already unused, calling callback (ffffffffc0b56230) 00010000:00010000:0.0:1784044357.500224:0:17187:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000064306f5a/0x89871fc3aba19407 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044357.500234:0:17187:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000064306f5a/0x89871fc3aba19407 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044357.500253:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000064306f5a/0x89871fc3aba19407 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044357.500259:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000064306f5a/0x89871fc3aba19407 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044357.500297:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784044357.500299:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784044357.500300:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784044357.502012:0:18933:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784044357.502025:0:18933:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e981007e/0x89871fc3aba1940e lrc: 3/0,1 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044357.502041:0:18933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=550s v=(0 0) 00010000:00010000:1.0:1784044357.502046:0:18933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784044357.502052:0:18933:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e981007e/0x89871fc3aba1940e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044357.502063:0:18933:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e981007e/0x89871fc3aba1940e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044357.502073:0:18933:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e981007e/0x89871fc3aba1940e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044357.502080:0:18933:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e981007e/0x89871fc3aba1940e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044357.504219:0:18933:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1784044357.510849:0:18933:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784044357.510870:0:18933:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b873b7e/0x89871fc3aba19415 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044357.510892:0:18933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=550s v=(0 0) 00010000:00010000:1.0:1784044357.510898:0:18933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784044357.510906:0:18933:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000b873b7e/0x89871fc3aba19415 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044357.510921:0:18933:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000b873b7e/0x89871fc3aba19415 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044357.510931:0:18933:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b873b7e/0x89871fc3aba19415 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044357.510939:0:18933:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000b873b7e/0x89871fc3aba19415 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044357.520427:0:19100:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1784044357.520442:0:19100:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e981007e/0x89871fc3aba1940e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044357.520456:0:19100:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b397cb18800 already unused, calling callback (ffffffffc0b56230) 00010000:00010000:0.0:1784044357.520461:0:19100:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e981007e/0x89871fc3aba1940e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044357.520474:0:19100:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e981007e/0x89871fc3aba1940e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044357.520495:0:19100:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e981007e/0x89871fc3aba1940e lrc: 1/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044357.520503:0:19100:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e981007e/0x89871fc3aba1940e lrc: 0/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044357.520903:0:19100:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784044357.520909:0:19100:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000b873b7e/0x89871fc3aba19415 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044357.520937:0:19100:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b397cb18000 already unused, calling callback (ffffffffc0b56230) 00010000:00010000:2.0:1784044357.520941:0:19100:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000b873b7e/0x89871fc3aba19415 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044357.520950:0:19100:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000b873b7e/0x89871fc3aba19415 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044357.520962:0:19100:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000b873b7e/0x89871fc3aba19415 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044357.520971:0:19100:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784044357.520973:0:19100:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784044357.520975:0:19100:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784044357.524253:0:18933:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1784044357.524268:0:18933:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000b873b7e/0x89871fc3aba19415 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784044357.525311:0:18933:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784044357.525321:0:18933:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000842c2105/0x89871fc3aba1941c lrc: 3/0,1 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044357.525344:0:18933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=550s v=(0 0) 00010000:00010000:1.0:1784044357.525651:0:18933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784044357.525730:0:18933:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000842c2105/0x89871fc3aba1941c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044357.525874:0:18933:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000842c2105/0x89871fc3aba1941c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044357.525884:0:18933:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000842c2105/0x89871fc3aba1941c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044357.525891:0:18933:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000842c2105/0x89871fc3aba1941c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044357.525916:0:18933:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784044357.526446:0:17187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784044357.526457:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000842c2105/0x89871fc3aba1941c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044357.526466:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b397cb18200 already unused, calling callback (ffffffffc0b56230) 00010000:00010000:0.0:1784044357.526478:0:17187:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000842c2105/0x89871fc3aba1941c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044357.526489:0:17187:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000842c2105/0x89871fc3aba1941c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044357.526509:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000842c2105/0x89871fc3aba1941c lrc: 1/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044357.526517:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000842c2105/0x89871fc3aba1941c lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044357.526538:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784044357.526540:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784044357.526542:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784044357.530079:0:18933:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784044357.530094:0:18933:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000089e3b0c1/0x89871fc3aba19423 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044357.530226:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784044357.530645:0:18933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=550s v=(0 0) 00010000:00010000:1.0:1784044357.530651:0:18933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784044357.530790:0:18933:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000089e3b0c1/0x89871fc3aba19423 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044357.530813:0:18933:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000089e3b0c1/0x89871fc3aba19423 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044357.530839:0:18933:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000089e3b0c1/0x89871fc3aba19423 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044357.530847:0:18933:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000089e3b0c1/0x89871fc3aba19423 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044357.530865:0:18933:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784044357.531216:0:19100:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784044357.531224:0:19100:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000089e3b0c1/0x89871fc3aba19423 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044357.531233:0:19100:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b397cb19e00 already unused, calling callback (ffffffffc0b56230) 00010000:00010000:2.0:1784044357.531238:0:19100:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000089e3b0c1/0x89871fc3aba19423 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044357.531247:0:19100:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000089e3b0c1/0x89871fc3aba19423 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044357.531263:0:19100:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000089e3b0c1/0x89871fc3aba19423 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044357.531277:0:19100:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000089e3b0c1/0x89871fc3aba19423 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044357.531300:0:19100:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784044357.531301:0:19100:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784044357.531303:0:19100:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784044357.534688:0:18933:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784044357.534704:0:18933:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a97904ca/0x89871fc3aba1942a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044357.534722:0:18933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=550s v=(0 0) 00010000:00010000:1.0:1784044357.534727:0:18933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784044357.534745:0:18933:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a97904ca/0x89871fc3aba1942a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044357.534760:0:18933:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a97904ca/0x89871fc3aba1942a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044357.534771:0:18933:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a97904ca/0x89871fc3aba1942a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044357.534778:0:18933:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a97904ca/0x89871fc3aba1942a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044357.534823:0:18933:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784044357.534840:0:17187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784044357.534847:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a97904ca/0x89871fc3aba1942a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044357.534856:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b397cb18400 already unused, calling callback (ffffffffc0b56230) 00010000:00010000:1.0:1784044357.534862:0:17187:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a97904ca/0x89871fc3aba1942a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044357.534873:0:17187:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a97904ca/0x89871fc3aba1942a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044357.534892:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a97904ca/0x89871fc3aba1942a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044357.534900:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a97904ca/0x89871fc3aba1942a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044357.534922:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784044357.534923:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784044357.534925:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784044357.539879:0:18933:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784044357.539895:0:18933:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f5866641/0x89871fc3aba19431 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044357.539914:0:18933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=550s v=(0 0) 00010000:00010000:1.0:1784044357.539933:0:18933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784044357.539940:0:18933:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f5866641/0x89871fc3aba19431 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044357.539955:0:18933:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f5866641/0x89871fc3aba19431 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044357.539966:0:18933:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f5866641/0x89871fc3aba19431 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044357.539973:0:18933:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f5866641/0x89871fc3aba19431 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044357.540009:0:18933:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784044357.541171:0:17188:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784044357.541623:0:17188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f5866641/0x89871fc3aba19431 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044357.541638:0:17188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b397cb19400 already unused, calling callback (ffffffffc0b56230) 00010000:00010000:2.0:1784044357.541643:0:17188:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f5866641/0x89871fc3aba19431 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044357.541653:0:17188:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f5866641/0x89871fc3aba19431 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044357.541687:0:17188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f5866641/0x89871fc3aba19431 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044357.541696:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f5866641/0x89871fc3aba19431 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044357.541724:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784044357.541726:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784044357.541728:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1784044357.542920:0:18933:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784044357.542932:0:18933:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e170421d/0x89871fc3aba19438 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044357.542947:0:18933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=550s v=(0 0) 00010000:00010000:0.0:1784044357.542952:0:18933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784044357.542959:0:18933:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e170421d/0x89871fc3aba19438 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044357.542972:0:18933:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e170421d/0x89871fc3aba19438 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044357.542982:0:18933:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e170421d/0x89871fc3aba19438 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044357.543012:0:18933:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e170421d/0x89871fc3aba19438 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044357.543037:0:18933:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:0.0:1784044357.543127:0:18933:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:6 00000100:00100000:0.0:1784044357.543603:0:18933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3945930a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:17225:x1870705581049728:12345-0@lo:5:osp-pre-0-0.0 Request processed in 128958us (131638us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044357.543614:0:18933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1784044357.543689:0:17225:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3945930700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17225:1870705581049728:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1784044357.543709:0:17225:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x21:0x0] from OST, last_created [0x280000401:0x21:0x0]last_used is [0x280000401:0x6:0x0] 00000100:00100000:0.0:1784044357.543776:0:17225:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3945930700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17225:1870705581049856:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1784044357.543818:0:17225:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044357.543853:0:17225:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b38420db600 going to sleep for 11 seconds 00000100:00100000:0.0:1784044357.543872:0:18933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581049856 00000100:00100000:0.0:1784044357.543878:0:18933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581049856 00000100:00100000:0.0:1784044357.543922:0:18933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1784044357.543931:0:18933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3945933b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:17225:x1870705581049856:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:0.0:1784044357.543980:0:18933:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 34 00010000:00010000:2.0:1784044357.545444:0:19100:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784044357.545459:0:19100:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e170421d/0x89871fc3aba19438 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044357.545473:0:19100:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38410b6800 already unused, calling callback (ffffffffc0b56230) 00010000:00010000:2.0:1784044357.545478:0:19100:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e170421d/0x89871fc3aba19438 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044357.545487:0:19100:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e170421d/0x89871fc3aba19438 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044357.545510:0:19100:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e170421d/0x89871fc3aba19438 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044357.545518:0:19100:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e170421d/0x89871fc3aba19438 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044357.545559:0:19100:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784044357.545561:0:19100:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784044357.545562:0:19100:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1784044357.586251:0:18702:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934594 is committed 00000001:00100000:1.0:1784044357.586294:0:18702:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1784044357.586984:0:18933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3945933b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:17225:x1870705581049856:12345-0@lo:5:osp-pre-0-0.0 Request processed in 43047us (43158us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1784044357.587011:0:18933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1784044357.588561:0:17225:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 2 00000100:00100000:1.0:1784044357.588575:0:17225:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3945930700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17225:1870705581049856:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1784044357.588591:0:17225:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x21:0x0]-[0x280000401:0x41:0x0] 00010000:00010000:1.0:1784044357.652056:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1784044357.897441:0:19126:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1784044357.897634:0:19126:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1784044358.671680:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784044358.734431:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784044358.734480:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1870705581049984:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1784044358.734578:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044358.735948:0:18709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581049984 00000100:00100000:2.0:1784044358.735963:0:18709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581049984 00000100:00100000:2.0:1784044358.736044:0:18709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1784044358.736054:0:18709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d4d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1870705581049984:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1784044358.736084:0:18709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1784044358.736151:0:18709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d4d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1870705581049984:12345-0@lo:13:osp-pre-0-1.0 Request processed in 98us (1572us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044358.736159:0:18709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1784044358.736432:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1870705581049984:0@lo:13:osp-pre-0-1.0 00000020:00000004:3.0:1784044359.064662:0:19176:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1784044359.065023:0:19176:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1784044359.693389:0:19100:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784044359.758774:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1870705581050112:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1784044359.758889:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044359.758936:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581050112 00000100:00100000:3.0:1784044359.758949:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581050112 00000100:00100000:3.0:1784044359.759024:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1784044359.759034:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1870705581050112:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1784044359.759086:0:17205:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1784044359.759158:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1870705581050112:12345-0@lo:41:osp-pre-1-0.0 Request processed in 125us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044359.759165:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1784044359.759298:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1870705581050112:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1784044359.760668:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1870705581050240:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1784044359.760757:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044359.761080:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581050240 00000100:00100000:1.0:1784044359.761090:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581050240 00000100:00100000:1.0:1784044359.761158:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1784044359.761168:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3945933100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1870705581050240:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1784044359.761247:0:17206:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1784044359.761309:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3945933100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1870705581050240:12345-0@lo:41:osp-pre-0-1.0 Request processed in 142us (552us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044359.761318:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1784044359.763123:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1870705581050240:0@lo:41:osp-pre-0-1.0 00000040:00080000:2.0:1784044360.659232:0:17952:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1784044360.726537:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784044361.741682:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784044362.765416:0:19100:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784044362.830602:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1784044362.830639:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1870705581050368:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1784044362.831094:0:14129:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1784044362.831100:0:14129:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1784044362.831115:0:14129:0:(import.c:65:import_set_state_nolock()) ffff9b397b804800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1784044362.831122:0:14129:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 550 00000100:00080000:0.0:1784044362.831126:0:14129:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1784044362.831137:0:14129:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9b397b804800 using connection 192.168.202.140@tcp/0@lo 00000100:00100000:0.0:1784044362.831165:0:14129:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b3947eea680 x1870705581050880/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1784044362.831233:0:14129:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1784044362.831236:0:14129:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1784044362.831237:0:14129:0:(import.c:65:import_set_state_nolock()) ffff9b3944fd3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1784044362.831241:0:14129:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 550 00000100:00080000:0.0:1784044362.831244:0:14129:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1784044362.831248:0:14129:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9b3944fd3800 using connection 192.168.202.140@tcp/0@lo 00000100:00100000:0.0:1784044362.831262:0:14129:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b3947ee8700 x1870705581051392/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1784044362.831312:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3947ee9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1870705581050752:0@lo:400:kworker.0 00000100:00100000:0.0:1784044362.831395:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044362.831515:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3947ee9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1870705581051008:0@lo:400:kworker.0 00000100:00100000:2.0:1784044362.831557:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044362.831633:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843cae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1870705581051648:0@lo:400:kworker.0 00000100:00100000:2.0:1784044362.831655:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044362.831680:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1784044362.831692:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3945930700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:99a46fb7-9af9-40f1-9c76-329d6781ee81:3638:1870705581050496:0@lo:400:kworker.0 00000100:00100000:2.0:1784044362.831807:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044362.831832:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3947ee9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1870705581051136:0@lo:400:kworker.0 00000100:00100000:2.0:1784044362.831857:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044362.831872:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843caf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1870705581051776:0@lo:400:kworker.0 00000100:00100000:2.0:1784044362.831890:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044362.832014:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044362.832052:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581051008 00000100:00100000:1.0:1784044362.832060:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581051008 00000100:00100000:1.0:1784044362.832109:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581051648 00000100:00100000:1.0:1784044362.832112:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581051648 00000100:00100000:1.0:1784044362.832136:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581051776 00000100:00100000:1.0:1784044362.832138:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581051776 00000100:00100000:1.0:1784044362.832156:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1784044362.832165:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39759b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1870705581051008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044362.832242:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39759b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1870705581051008:12345-0@lo:400:kworker.0 Request processed in 77us (684us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044362.832250:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1784044362.832267:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1784044362.832273:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39759b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1870705581051648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044362.832294:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39759b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1870705581051648:12345-0@lo:400:kworker.0 Request processed in 21us (638us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044362.832313:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1784044362.832324:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1784044362.832330:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39759b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1870705581051776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044362.832360:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39759b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1870705581051776:12345-0@lo:400:kworker.0 Request processed in 31us (469us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044362.832366:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1784044362.832387:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581050496 00000100:00100000:1.0:1784044362.832391:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581050496 00000100:00100000:2.0:1784044362.832504:0:18709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581050368 00000100:00100000:2.0:1784044362.832509:0:18709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581050368 00000100:00100000:2.0:1784044362.832544:0:18709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1784044362.832550:0:18709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1870705581050368:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1784044362.832577:0:18709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1784044362.832627:0:18709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1870705581050368:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (613us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044362.832634:0:18709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1784044362.833118:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3945932d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1870705581050624:0@lo:400:kworker.0 00000100:00100000:3.0:1784044362.833167:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044362.833360:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3947ee8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1870705581051264:0@lo:400:kworker.0 00000100:00100000:3.0:1784044362.833398:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3947eea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1870705581050880:0@lo:8:kworker.0 00000100:00100000:0.0:1784044362.833537:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3947eead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3641:1870705581051520:0@lo:400:kworker.0 00000100:00100000:0.0:1784044362.833569:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1784044362.833644:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1784044362.833650:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1784044362.833654:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784044362.833666:0:18572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581051520 00000100:00100000:0.0:1784044362.833671:0:18572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581051520 00000100:00100000:2.0:1784044362.833833:0:18706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581050752 00000100:00100000:2.0:1784044362.833838:0:18706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581050752 00000100:00100000:2.0:1784044362.834537:0:18706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1784044362.834551:0:18706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843cadf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1870705581050752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784044362.835518:0:18706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843cadf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1870705581050752:12345-0@lo:400:kworker.0 Request processed in 967us (4118us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044362.835532:0:18706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1784044362.835618:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3947ee9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1870705581050752:0@lo:400:kworker.0 00000100:00100000:3.0:1784044362.835897:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044362.835930:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3947ee8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1870705581051392:0@lo:8:kworker.0 00000100:00100000:3.0:1784044362.835964:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044362.839497:0:18572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1784044362.839530:0:18572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843cac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1870705581051520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784044362.839668:0:18572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843cac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1870705581051520:12345-0@lo:400:kworker.0 Request processed in 155us (6097us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044362.839926:0:18572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1784044362.839994:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581051136 00000100:00100000:0.0:1784044362.840006:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581051136 00000100:00100000:0.0:1784044362.840041:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581050624 00000100:00100000:0.0:1784044362.840045:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581050624 00000100:00100000:0.0:1784044362.840059:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1784044362.840065:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39759b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1870705581051136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784044362.840108:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39759b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1870705581051136:12345-0@lo:400:kworker.0 Request processed in 42us (8249us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044362.840114:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1784044362.840126:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1784044362.840131:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843ce6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1870705581050624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784044362.840161:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843ce6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1870705581050624:12345-0@lo:400:kworker.0 Request processed in 30us (6994us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044362.840167:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1784044362.840249:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3947ee9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1870705581051136:0@lo:400:kworker.0 00010000:00080000:0.0:1784044362.840273:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b3843caf480 x1870705581051776/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044378 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784044362.840286:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843caf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1870705581051776:0@lo:400:kworker.0 00010000:00080000:0.0:1784044362.840302:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b3947ee9c00 x1870705581051008/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044378 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784044362.840312:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3947ee9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1870705581051008:0@lo:400:kworker.0 00010000:00080000:0.0:1784044362.840326:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b3843cae300 x1870705581051648/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044378 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784044362.840350:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843cae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1870705581051648:0@lo:400:kworker.0 00000100:00100000:0.0:1784044362.840530:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1870705581050368:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784044362.840969:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044362.841031:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3945932d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1870705581050624:0@lo:400:kworker.0 00000100:00100000:1.0:1784044362.841582:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1784044362.841597:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38437a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99a46fb7-9af9-40f1-9c76-329d6781ee81+21:3638:x1870705581050496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044362.841695:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38437a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99a46fb7-9af9-40f1-9c76-329d6781ee81+21:3638:x1870705581050496:12345-0@lo:400:kworker.0 Request processed in 91us (9875us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044362.841703:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1784044362.842030:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3945930700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:99a46fb7-9af9-40f1-9c76-329d6781ee81:3638:1870705581050496:0@lo:400:kworker.0 00000100:00100000:2.0:1784044362.842610:0:18707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581050880 00000100:00100000:2.0:1784044362.842619:0:18707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581050880 00000100:00100000:2.0:1784044362.842649:0:18933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581051392 00000100:00100000:2.0:1784044362.842652:0:18933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581051392 00000100:00100000:2.0:1784044362.842863:0:18933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581051264 00000100:00100000:2.0:1784044362.842868:0:18933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581051264 00000100:00080000:3.0:1784044362.842936:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784044362.842979:0:18708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1784044362.842990:0:18708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843cae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1870705581051264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784044362.843113:0:18708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843cae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1870705581051264:12345-0@lo:400:kworker.0 Request processed in 125us (2143us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044362.843121:0:18708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1784044362.843136:0:18708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1784044362.843141:0:18708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843ce7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3637:x1870705581051392:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1784044362.843205:0:18708:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1784044362.843253:0:18708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843ce7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3637:x1870705581051392:12345-0@lo:8:kworker.0 Request processed in 111us (7288us total) trans 0 rc -19/-19 00000100:00100000:0.0:1784044362.843260:0:18708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:1.0:1784044362.843642:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9b3944fd3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1784044362.843649:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1784044362.843653:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3947ee8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1870705581051392:0@lo:8:kworker.0 00010000:00080000:2.0:1784044362.843957:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b3947eead80 x1870705581051520/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044378 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784044362.843974:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3947eead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3641:1870705581051520:0@lo:400:kworker.0 00000100:00100000:2.0:1784044362.844037:0:18707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1784044362.844043:0:18707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843ce6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3637:x1870705581050880:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1784044362.844061:0:18707:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1784044362.844112:0:18707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843ce6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3637:x1870705581050880:12345-0@lo:8:kworker.0 Request processed in 67us (8214us total) trans 0 rc -19/-19 00000100:00100000:2.0:1784044362.844119:0:18707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:1.0:1784044362.845598:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9b397b804800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1784044362.845612:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1784044362.845618:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3947eea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1870705581050880:0@lo:8:kworker.0 00000100:00100000:3.0:1784044362.847376:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3947ee8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1870705581051264:0@lo:400:kworker.0 00010000:00010000:1.0:1784044363.794063:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784044363.856820:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1784044363.856892:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843ce4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1870705581051904:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1784044363.856997:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044363.857057:0:18709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581051904 00000100:00100000:2.0:1784044363.857066:0:18709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581051904 00000100:00100000:2.0:1784044363.857120:0:18709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1784044363.857130:0:18709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39759b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1870705581051904:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1784044363.857158:0:18709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1784044363.857229:0:18709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39759b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1870705581051904:12345-0@lo:13:osp-pre-0-1.0 Request processed in 99us (231us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044363.857236:0:18709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1784044363.857292:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843ce4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1870705581051904:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1784044364.813333:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784044364.877994:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784044364.878016:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1870705581052032:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1784044364.878090:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044364.878147:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581052032 00000100:00100000:1.0:1784044364.878153:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581052032 00000100:00100000:1.0:1784044364.878209:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1784044364.878218:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1870705581052032:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1784044364.878255:0:17206:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1784044364.878300:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1870705581052032:12345-0@lo:41:osp-pre-1-0.0 Request processed in 83us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044364.878308:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1784044364.878357:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1870705581052032:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1784044364.878992:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1870705581052160:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1784044364.879032:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044364.879066:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581052160 00000100:00100000:0.0:1784044364.879070:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581052160 00000100:00100000:0.0:1784044364.879096:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1784044364.879101:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843caf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1870705581052160:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1784044364.879121:0:17206:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1784044364.879153:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843caf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1870705581052160:12345-0@lo:41:osp-pre-0-1.0 Request processed in 51us (119us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044364.879166:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1784044364.879340:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1870705581052160:0@lo:41:osp-pre-0-1.0 00000040:00080000:1.0:1784044365.198808:0:17236:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1784044365.838108:0:19100:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784044366.874668:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784044367.888527:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1784044367.949350:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1784044367.949358:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1784044367.949361:0:36:0:(import.c:65:import_set_state_nolock()) ffff9b397b804800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1784044367.949370:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 556 00000100:00080000:0.0:1784044367.949374:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1784044367.949382:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9b397b804800 using connection 192.168.202.140@tcp/0@lo 00000100:00100000:0.0:1784044367.949406:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b3843cac380 x1870705581052672/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1784044367.949442:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1784044367.949446:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1784044367.949448:0:36:0:(import.c:65:import_set_state_nolock()) ffff9b3944fd3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1784044367.949452:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 556 00000100:00080000:0.0:1784044367.949454:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1784044367.949458:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9b3944fd3800 using connection 192.168.202.140@tcp/0@lo 00000100:00100000:0.0:1784044367.949469:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b3843caf100 x1870705581053184/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1784044367.949515:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843caca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:99a46fb7-9af9-40f1-9c76-329d6781ee81:3639:1870705581052288:0@lo:400:kworker.0 00000100:00100000:0.0:1784044367.949584:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044367.949633:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843cad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1870705581052928:0@lo:400:kworker.0 00000100:00100000:0.0:1784044367.949660:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044367.949867:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843cafb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3639:1870705581053568:0@lo:400:kworker.0 00000100:00100000:0.0:1784044367.950719:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044367.950757:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1784044367.950765:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843caf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3639:1870705581052800:0@lo:400:kworker.0 00000100:00100000:0.0:1784044367.950792:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044367.950810:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843cac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3639:1870705581053440:0@lo:400:kworker.0 00000100:00100000:0.0:1784044367.950833:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044367.950874:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843caea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1870705581052544:0@lo:400:kworker.0 00000100:00100000:0.0:1784044367.951008:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044367.951033:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843caed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3641:1870705581053312:0@lo:400:kworker.0 00000100:00100000:0.0:1784044367.951285:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044367.951308:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1784044367.951314:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843cad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1870705581052416:0@lo:400:kworker.0 00000100:00100000:0.0:1784044367.951341:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044367.951359:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843cace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1870705581053056:0@lo:400:kworker.0 00000100:00100000:0.0:1784044367.951380:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044367.951415:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843cac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1870705581052672:0@lo:8:kworker.0 00000100:00100000:0.0:1784044367.951439:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044367.951564:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843caf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1870705581053184:0@lo:8:kworker.0 00000100:00100000:3.0:1784044367.951579:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784044367.951587:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044367.951588:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843ce4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1870705581053696:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784044367.951613:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044367.951622:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581052288 00000100:00100000:0.0:1784044367.951630:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581052288 00000100:00100000:3.0:1784044367.951655:0:18709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581053696 00000100:00100000:3.0:1784044367.951659:0:18709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581053696 00000100:00100000:3.0:1784044367.951703:0:18709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1784044367.951713:0:18709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843ce5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1870705581053696:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1784044367.951760:0:18709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1784044367.951782:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1784044367.951789:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38437a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99a46fb7-9af9-40f1-9c76-329d6781ee81+21:3639:x1870705581052288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044367.951804:0:18709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843ce5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1870705581053696:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (189us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044367.951825:0:18709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1784044367.951844:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38437a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99a46fb7-9af9-40f1-9c76-329d6781ee81+21:3639:x1870705581052288:12345-0@lo:400:kworker.0 Request processed in 56us (2261us total) trans 0 rc 0/0 00000100:00080000:3.0:1784044367.951847:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784044367.951855:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1784044367.951883:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843ce4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1870705581053696:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784044367.951884:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581052928 00000100:00100000:0.0:1784044367.951888:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581052928 00000100:00100000:0.0:1784044367.952333:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581052416 00000100:00100000:0.0:1784044367.952338:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581052416 00000100:00100000:0.0:1784044367.952354:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1784044367.952360:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843cadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1870705581052928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784044367.952398:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843cadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1870705581052928:12345-0@lo:400:kworker.0 Request processed in 38us (2738us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044367.952404:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1784044367.952417:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1784044367.952423:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39412e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1870705581052416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784044367.952451:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39412e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1870705581052416:12345-0@lo:400:kworker.0 Request processed in 29us (1109us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044367.952457:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1784044367.952478:0:18572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581053568 00000100:00100000:0.0:1784044367.952482:0:18572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581053568 00000100:00100000:0.0:1784044367.952505:0:18572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581052800 00000100:00100000:0.0:1784044367.952509:0:18572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581052800 00000100:00100000:0.0:1784044367.952518:0:18572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581053440 00000100:00100000:0.0:1784044367.952520:0:18572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581053440 00000100:00100000:0.0:1784044367.952532:0:18572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581053312 00000100:00100000:0.0:1784044367.952534:0:18572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581053312 00000100:00100000:0.0:1784044367.952547:0:18572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1784044367.952552:0:18572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843cae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1870705581053568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784044367.952582:0:18572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843cae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1870705581053568:12345-0@lo:400:kworker.0 Request processed in 30us (1927us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044367.952589:0:18572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1784044367.952609:0:18572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1784044367.952614:0:18572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843cad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1870705581052800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784044367.952643:0:18572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843cad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1870705581052800:12345-0@lo:400:kworker.0 Request processed in 29us (1851us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044367.952648:0:18572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1784044367.952661:0:18572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1784044367.952827:0:18572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3945930700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1870705581053440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784044367.952857:0:18572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3945930700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1870705581053440:12345-0@lo:400:kworker.0 Request processed in 191us (2023us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044367.952864:0:18572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1784044367.952876:0:18572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1784044367.952893:0:18572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39412eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1870705581053312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784044367.952930:0:18572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39412eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1870705581053312:12345-0@lo:400:kworker.0 Request processed in 37us (1715us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044367.952936:0:18572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1784044367.952964:0:18706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581052544 00000100:00100000:0.0:1784044367.952968:0:18706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581052544 00000100:00100000:0.0:1784044367.952984:0:18706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581053056 00000100:00100000:0.0:1784044367.952986:0:18706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581053056 00000100:00100000:0.0:1784044367.952997:0:18706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581052672 00000100:00100000:0.0:1784044367.953000:0:18706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581052672 00000100:00100000:0.0:1784044367.953007:0:18706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581053184 00000100:00100000:0.0:1784044367.953009:0:18706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581053184 00000100:00100000:0.0:1784044367.953016:0:18706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1784044367.953022:0:18706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3945932d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1870705581052544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784044367.953064:0:18706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3945932d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1870705581052544:12345-0@lo:400:kworker.0 Request processed in 29us (2042us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044367.953080:0:18706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1784044367.953091:0:18706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1784044367.953097:0:18706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39412e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1870705581053056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784044367.953125:0:18706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39412e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1870705581053056:12345-0@lo:400:kworker.0 Request processed in 29us (1745us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044367.953131:0:18706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1784044367.953142:0:18706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1784044367.953146:0:18706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39412e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3637:x1870705581052672:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1784044367.953164:0:18706:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1784044367.953392:0:18706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39412e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3637:x1870705581052672:12345-0@lo:8:kworker.0 Request processed in 244us (1951us total) trans 0 rc -19/-19 00000100:00100000:0.0:1784044367.953399:0:18706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1784044367.953412:0:18706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1784044367.953416:0:18706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39412ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3637:x1870705581053184:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1784044367.953425:0:18706:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1784044367.953450:0:18706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39412ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3637:x1870705581053184:12345-0@lo:8:kworker.0 Request processed in 33us (1862us total) trans 0 rc -19/-19 00000100:00100000:0.0:1784044367.953456:0:18706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:0.0:1784044367.953506:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9b397b804800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1784044367.953512:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1784044367.953515:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843cac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1870705581052672:0@lo:8:kworker.0 00000100:00080000:0.0:1784044367.953524:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9b3944fd3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1784044367.953527:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1784044367.953530:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843caf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1870705581053184:0@lo:8:kworker.0 00000100:00080000:3.0:1784044367.953536:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1784044367.953541:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1784044367.953542:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1784044367.953572:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b3843caf800 x1870705581052800/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044383 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784044367.953574:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843cad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1870705581052416:0@lo:400:kworker.0 00000100:00100000:0.0:1784044367.953582:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843caf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3639:1870705581052800:0@lo:400:kworker.0 00000100:00100000:3.0:1784044367.953585:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843cace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1870705581053056:0@lo:400:kworker.0 00010000:00080000:0.0:1784044367.953592:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b3843cac000 x1870705581053440/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044383 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784044367.953594:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843caea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1870705581052544:0@lo:400:kworker.0 00000100:00100000:0.0:1784044367.953600:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843cac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3639:1870705581053440:0@lo:400:kworker.0 00010000:00080000:3.0:1784044367.953603:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b3843caed80 x1870705581053312/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044383 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784044367.953609:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843caca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:99a46fb7-9af9-40f1-9c76-329d6781ee81:3639:1870705581052288:0@lo:400:kworker.0 00000100:00100000:3.0:1784044367.953611:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843caed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3641:1870705581053312:0@lo:400:kworker.0 00000100:00100000:0.0:1784044367.953618:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843cad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1870705581052928:0@lo:400:kworker.0 00010000:00080000:0.0:1784044367.953626:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b3843cafb80 x1870705581053568/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044383 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784044367.953633:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843cafb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3639:1870705581053568:0@lo:400:kworker.0 00010000:00010000:2.0:1784044368.909895:0:19100:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784044368.973422:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784044368.973580:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1870705581053824:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1784044368.974467:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044368.974931:0:18709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581053824 00000100:00100000:1.0:1784044368.974941:0:18709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581053824 00000100:00100000:1.0:1784044368.975047:0:18709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1784044368.975059:0:18709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39412e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1870705581053824:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1784044368.975090:0:18709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1784044368.975155:0:18709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39412e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1870705581053824:12345-0@lo:13:osp-pre-0-1.0 Request processed in 98us (690us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044368.975163:0:18709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1784044368.975603:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1870705581053824:0@lo:13:osp-pre-0-1.0 00000020:01000004:2.0:1784044369.551992:0:19521:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1784044369.551997:0:19521:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:2.0:1784044369.551999:0:19521:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:2.0:1784044369.552112:0:19521:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9b3975aa7800 00000020:01000004:2.0:1784044369.552129:0:19521:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1784044369.552145:0:19521:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1784044369.552160:0:19521:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9b3947bccd40) 00000020:00000080:2.0:1784044369.552210:0:19521:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1784044369.616243:0:19521:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1784044369.619432:0:19521:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1784044369.620127:0:19521:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1784044369.620450:0:19521:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:3.0:1784044369.620714:0:19521:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1784044369.621078:0:19521:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:3.0:1784044369.621495:0:19521:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:01000000:3.0:1784044369.623753:0:19521:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1784044369.624012:0:19521:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1784044369.624033:0:19521:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:3.0:1784044369.624046:0:19521:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x89871fc3aba19446 00000020:01000004:3.0:1784044369.624053:0:19521:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:3.0:1784044369.624076:0:19521:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.140@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1784044369.624079:0:19521:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.140@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1784044369.624085:0:19521:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1784044369.624165:0:19521:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:3.0:1784044369.624170:0:19521:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.140@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1784044369.642045:0:19521:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.140@tcp ctxt 0 is initialized 00000020:01000004:2.0:1784044369.642089:0:19521:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.202.140@tcp, index=0001, flags=0x20002 00000020:01000004:2.0:1784044369.642093:0:19521:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1784044369.642095:0:19521:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1784044369.642096:0:19521:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784044369.642098:0:19521:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784044369.642099:0:19521:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784044369.642100:0:19521:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784044369.642102:0:19521:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1784044369.642109:0:19521:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784044369.642110:0:19521:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1784044369.642114:0:19521:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:2.0:1784044369.642116:0:19521:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1784044369.642117:0:19521:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1784044369.642118:0:19521:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784044369.642118:0:19521:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784044369.642119:0:19521:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784044369.642120:0:19521:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784044369.642121:0:19521:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1784044369.642122:0:19521:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784044369.642123:0:19521:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1784044369.642152:0:19521:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1784044369.642207:0:19521:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39759b7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99a46fb7-9af9-40f1-9c76-329d6781ee81:19521:1870705581053952:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1784044369.642331:0:19521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044369.642390:0:19521:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3975850600 going to sleep for 11 seconds 00000100:00100000:1.0:1784044369.643469:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581053952 00000100:00100000:1.0:1784044369.643480:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581053952 00000100:00100000:1.0:1784044369.643553:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1784044369.643566:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38437a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99a46fb7-9af9-40f1-9c76-329d6781ee81+21:19521:x1870705581053952:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1784044369.643605:0:17192:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1784044369.643609:0:17192:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:1.0:1784044369.643613:0:17192:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1784044369.644148:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38437a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99a46fb7-9af9-40f1-9c76-329d6781ee81+21:19521:x1870705581053952:12345-0@lo:253:mount.lustre.0 Request processed in 582us (1814us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044369.644168:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1784044369.644834:0:19521:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39759b7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99a46fb7-9af9-40f1-9c76-329d6781ee81:19521:1870705581053952:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1784044369.644849:0:19521:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1784044369.644852:0:19521:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1784044369.644854:0:19521:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1784044369.644855:0:19521:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784044369.644857:0:19521:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784044369.644858:0:19521:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784044369.644859:0:19521:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784044369.644861:0:19521:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1784044369.644862:0:19521:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784044369.644863:0:19521:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1784044369.644898:0:19521:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9b3975aa7800 from lustre-OST0001 10000000:01000000:2.0:1784044369.644932:0:19521:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1784044369.644934:0:19521:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1784044369.644943:0:19521:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9b3842450000 local copy 00010000:00010000:2.0:1784044369.644955:0:19521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b38410b7000/0x89871fc3aba1909c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba190a3 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044369.645050:0:19521:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39759b7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99a46fb7-9af9-40f1-9c76-329d6781ee81:19521:1870705581054080:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784044369.645093:0:19521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044369.645132:0:19521:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3975850300 going to sleep for 11 seconds 00000100:00100000:0.0:1784044369.645250:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581054080 00000100:00100000:0.0:1784044369.645256:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581054080 00000100:00100000:0.0:1784044369.645306:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1784044369.645313:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38437a5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99a46fb7-9af9-40f1-9c76-329d6781ee81+21:19521:x1870705581054080:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1784044369.645389:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38437a5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99a46fb7-9af9-40f1-9c76-329d6781ee81+21:19521:x1870705581054080:12345-0@lo:501:mount.lustre.0 Request processed in 76us (295us total) trans 0 rc -2/-2 00000100:00100000:0.0:1784044369.645396:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1784044369.645717:0:19521:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39759b7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99a46fb7-9af9-40f1-9c76-329d6781ee81:19521:1870705581054080:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1784044369.645732:0:19521:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.140@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1784044369.645752:0:19521:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.140@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1784044369.645759:0:19521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b38410b7000/0x89871fc3aba1909c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba190a3 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044369.645767:0:19521:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9b38410b7000/0x89871fc3aba1909c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba190a3 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784044369.645852:0:19521:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9b3975aa7800 10000000:01000000:2.0:1784044369.645857:0:19521:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1784044369.645862:0:19521:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1784044369.645865:0:19521:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1784044369.645869:0:19521:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:2.0:1784044369.645872:0:19521:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1784044369.645907:0:19521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b3843798a00/0x89871fc3aba1944d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044369.645915:0:19521:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9b3843798a00/0x89871fc3aba1944d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044369.645923:0:19521:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9b3843798a00/0x89871fc3aba1944d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044369.645936:0:19521:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39759b7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99a46fb7-9af9-40f1-9c76-329d6781ee81:19521:1870705581054208:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1784044369.645962:0:19521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044369.645997:0:19521:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3975850300 going to sleep for 11 seconds 00000100:00100000:1.0:1784044369.646168:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581054208 00000100:00100000:1.0:1784044369.646196:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581054208 00000100:00100000:1.0:1784044369.646280:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1784044369.646288:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38437a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99a46fb7-9af9-40f1-9c76-329d6781ee81+21:19521:x1870705581054208:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1784044369.646297:0:17192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784044369.646308:0:17192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b397cb19c00/0x89871fc3aba19454 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x89871fc3aba1944d expref: -99 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044369.646329:0:17192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b397cb19c00/0x89871fc3aba19454 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x89871fc3aba1944d expref: 22 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044369.646348:0:17192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b397cb19c00/0x89871fc3aba19454 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x89871fc3aba1944d expref: 22 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044369.646357:0:17192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b397cb19c00, rc 0) 00000100:00100000:1.0:1784044369.646390:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38437a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99a46fb7-9af9-40f1-9c76-329d6781ee81+22:19521:x1870705581054208:12345-0@lo:101:mount.lustre.0 Request processed in 103us (426us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044369.646404:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1784044369.646485:0:19521:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39759b7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99a46fb7-9af9-40f1-9c76-329d6781ee81:19521:1870705581054208:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1784044369.646497:0:19521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9b3843798a00/0x89871fc3aba1944d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba19454 expref: -99 pid: 19521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044369.646505:0:19521:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9b3843798a00/0x89871fc3aba1944d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x89871fc3aba19454 expref: -99 pid: 19521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1784044369.648828:0:19521:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:2.0:1784044369.649539:0:19521:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1784044369.655487:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:2.0:1784044369.655609:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:2.0:1784044369.655705:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:2.0:1784044369.655725:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:2.0:1784044369.655740:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:2.0:1784044369.655756:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:2.0:1784044369.655785:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:2.0:1784044369.656157:0:19521:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:2.0:1784044369.656538:0:19521:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39759b7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99a46fb7-9af9-40f1-9c76-329d6781ee81:19521:1870705581054336:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784044369.656750:0:19521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044369.656937:0:19521:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b39758500c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784044369.656983:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581054336 00000100:00100000:1.0:1784044369.656992:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581054336 00000100:00100000:1.0:1784044369.657129:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1784044369.657139:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38437a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99a46fb7-9af9-40f1-9c76-329d6781ee81+22:19521:x1870705581054336:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1784044369.657350:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38437a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99a46fb7-9af9-40f1-9c76-329d6781ee81+22:19521:x1870705581054336:12345-0@lo:501:mount.lustre.0 Request processed in 201us (589us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044369.657360:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1784044369.657468:0:19521:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39759b7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99a46fb7-9af9-40f1-9c76-329d6781ee81:19521:1870705581054336:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784044369.657505:0:19521:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39759b7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99a46fb7-9af9-40f1-9c76-329d6781ee81:19521:1870705581054464:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1784044369.657561:0:19521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044369.658144:0:19521:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b39758500c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784044369.658192:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581054464 00000100:00100000:0.0:1784044369.658199:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581054464 00000100:00100000:1.0:1784044369.658282:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1784044369.658295:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38437a6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99a46fb7-9af9-40f1-9c76-329d6781ee81+22:19521:x1870705581054464:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1784044369.659486:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38437a6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99a46fb7-9af9-40f1-9c76-329d6781ee81+22:19521:x1870705581054464:12345-0@lo:503:mount.lustre.0 Request processed in 1187us (1920us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044369.659497:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1784044369.659596:0:19521:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39759b7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99a46fb7-9af9-40f1-9c76-329d6781ee81:19521:1870705581054464:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1784044369.660214:0:19521:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1784044369.660311:0:19521:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39759b7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99a46fb7-9af9-40f1-9c76-329d6781ee81:19521:1870705581054592:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1784044369.660374:0:19521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044369.661012:0:19521:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3975850300 going to sleep for 11 seconds 00000100:00100000:3.0:1784044369.661059:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581054592 00000100:00100000:3.0:1784044369.661066:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581054592 00000100:00100000:3.0:1784044369.661106:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1784044369.661117:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38437a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99a46fb7-9af9-40f1-9c76-329d6781ee81+22:19521:x1870705581054592:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1784044369.662221:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38437a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99a46fb7-9af9-40f1-9c76-329d6781ee81+22:19521:x1870705581054592:12345-0@lo:502:mount.lustre.0 Request processed in 1098us (1838us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044369.662235:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1784044369.663102:0:19521:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39759b7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99a46fb7-9af9-40f1-9c76-329d6781ee81:19521:1870705581054592:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1784044369.663730:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:2.0:1784044369.663767:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:2.0:1784044369.663783:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:2.0:1784044369.664014:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:2.0:1784044369.664032:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:2.0:1784044369.664048:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:2.0:1784044369.664062:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:2.0:1784044369.664076:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:2.0:1784044369.664106:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:2.0:1784044369.664147:0:19521:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39759b7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99a46fb7-9af9-40f1-9c76-329d6781ee81:19521:1870705581054720:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1784044369.664484:0:19521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044369.664617:0:19521:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3975850300 going to sleep for 11 seconds 00000100:00100000:1.0:1784044369.664804:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581054720 00000100:00100000:1.0:1784044369.664811:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581054720 00000100:00100000:1.0:1784044369.664861:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1784044369.664869:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38437a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99a46fb7-9af9-40f1-9c76-329d6781ee81+22:19521:x1870705581054720:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1784044369.665009:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38437a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99a46fb7-9af9-40f1-9c76-329d6781ee81+22:19521:x1870705581054720:12345-0@lo:502:mount.lustre.0 Request processed in 140us (525us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044369.665018:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1784044369.665198:0:19521:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39759b7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99a46fb7-9af9-40f1-9c76-329d6781ee81:19521:1870705581054720:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1784044369.665261:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:2.0:1784044369.665285:0:19521:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 10 count 11 00000020:01000000:2.0:1784044369.668802:0:19525:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1784044369.668815:0:19525:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:2.0:1784044369.668824:0:19525:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784044369.668826:0:19525:0:(obd_config.c:1561:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:2.0:1784044369.668832:0:19525:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1784044369.668850:0:19525:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9b3947bc8000) 00000020:00000080:2.0:1784044369.668877:0:19525:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type obdfilter with refcount 2 00000020:00000080:2.0:1784044369.668895:0:19525:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1784044369.668988:0:19525:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9b3975aa7800 from lustre-OST0001, refs=2 00080000:01000000:2.0:1784044369.668997:0:19525:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:2.0:1784044369.669004:0:19525:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x89871fc3aba19462 00010000:00010000:2.0:1784044369.685100:0:19525:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:00000004:2.0:1784044369.686757:0:19525:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967311 00080000:10000000:2.0:1784044369.690083:0:19525:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0001: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000080:3.0:1784044369.692987:0:19525:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:3.0:1784044369.693008:0:19525:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784044369.693019:0:19525:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784044369.693021:0:19525:0:(obd_config.c:1561:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:3.0:1784044369.693025:0:19525:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784044369.693029:0:19525:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784044369.693030:0:19525:0:(obd_config.c:1561:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:3.0:1784044369.693033:0:19525:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1784044369.693035:0:19525:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1784044369.693037:0:19525:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784044369.693039:0:19525:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784044369.693041:0:19525:0:(obd_config.c:1561:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000020:01000000:3.0:1784044369.693043:0:19525:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784044369.693045:0:19525:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784044369.693046:0:19525:0:(obd_config.c:1561:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1784044369.693050:0:19525:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1784044369.693086:0:19525:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784044369.693089:0:19525:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784044369.693090:0:19525:0:(obd_config.c:1561:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1784044369.693094:0:19525:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:0.0:1784044369.693301:0:19521:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:0.0:1784044369.693333:0:19521:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1784044369.693368:0:19521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b3843798a00/0x89871fc3aba1944d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba19454 expref: -99 pid: 19521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044369.693380:0:19521:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9b3843798a00/0x89871fc3aba1944d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba19454 expref: -99 pid: 19521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784044369.693388:0:19521:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9b3975aa7800 from 1 10000000:01000000:0.0:1784044369.693400:0:19521:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1784044369.693439:0:19521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b38410b6800/0x89871fc3aba19469 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044369.693447:0:19521:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9b38410b6800/0x89871fc3aba19469 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044369.693459:0:19521:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9b38410b6800/0x89871fc3aba19469 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044369.693483:0:19521:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39412eaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99a46fb7-9af9-40f1-9c76-329d6781ee81:19521:1870705581054848:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1784044369.694075:0:19521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044369.694136:0:19521:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3965ee1b40 going to sleep for 11 seconds 00000100:00100000:3.0:1784044369.694440:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581054848 00000100:00100000:3.0:1784044369.694450:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581054848 00000100:00100000:3.0:1784044369.694505:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1784044369.694516:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38437a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99a46fb7-9af9-40f1-9c76-329d6781ee81+22:19521:x1870705581054848:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1784044369.694531:0:17193:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784044369.694716:0:17193:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b3982054800/0x89871fc3aba19470 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x89871fc3aba19469 expref: -99 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044369.694747:0:17193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b3982054800/0x89871fc3aba19470 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x89871fc3aba19469 expref: 23 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044369.694759:0:17193:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b3982054800/0x89871fc3aba19470 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x89871fc3aba19469 expref: 23 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044369.694769:0:17193:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3982054800, rc 0) 00000100:00100000:3.0:1784044369.694903:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38437a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99a46fb7-9af9-40f1-9c76-329d6781ee81+23:19521:x1870705581054848:12345-0@lo:101:mount.lustre.0 Request processed in 388us (1353us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044369.694910:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1784044369.694998:0:19521:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39412eaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99a46fb7-9af9-40f1-9c76-329d6781ee81:19521:1870705581054848:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1784044369.695017:0:19521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9b38410b6800/0x89871fc3aba19469 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba19470 expref: -99 pid: 19521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044369.695026:0:19521:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9b38410b6800/0x89871fc3aba19469 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x89871fc3aba19470 expref: -99 pid: 19521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1784044369.696247:0:19521:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:1.0:1784044369.696920:0:19521:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1784044369.697128:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:1.0:1784044369.697156:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:1.0:1784044369.699306:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:1.0:1784044369.699334:0:19521:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:1.0:1784044369.699780:0:19521:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d4f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99a46fb7-9af9-40f1-9c76-329d6781ee81:19521:1870705581054976:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1784044369.700779:0:19521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044369.700956:0:19521:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b39510aac00 going to sleep for 11 seconds 00000100:00100000:3.0:1784044369.701057:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581054976 00000100:00100000:3.0:1784044369.701066:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581054976 00000100:00100000:3.0:1784044369.701127:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1784044369.701138:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38437a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99a46fb7-9af9-40f1-9c76-329d6781ee81+23:19521:x1870705581054976:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1784044369.701301:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38437a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99a46fb7-9af9-40f1-9c76-329d6781ee81+23:19521:x1870705581054976:12345-0@lo:501:mount.lustre.0 Request processed in 164us (524us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044369.701309:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1784044369.701711:0:19521:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d4f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99a46fb7-9af9-40f1-9c76-329d6781ee81:19521:1870705581054976:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1784044369.701759:0:19521:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39412e8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99a46fb7-9af9-40f1-9c76-329d6781ee81:19521:1870705581055104:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1784044369.703033:0:19521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044369.703073:0:19521:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3965ee1540 going to sleep for 11 seconds 00000100:00100000:1.0:1784044369.703156:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581055104 00000100:00100000:1.0:1784044369.703164:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581055104 00000100:00100000:1.0:1784044369.703242:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1784044369.703250:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38437a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99a46fb7-9af9-40f1-9c76-329d6781ee81+23:19521:x1870705581055104:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1784044369.703404:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38437a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99a46fb7-9af9-40f1-9c76-329d6781ee81+23:19521:x1870705581055104:12345-0@lo:503:mount.lustre.0 Request processed in 154us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044369.703413:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1784044369.703690:0:19521:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39412e8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99a46fb7-9af9-40f1-9c76-329d6781ee81:19521:1870705581055104:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1784044369.706704:0:19521:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1784044369.707112:0:19521:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39412e8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99a46fb7-9af9-40f1-9c76-329d6781ee81:19521:1870705581055232:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1784044369.707236:0:19521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044369.707277:0:19521:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3965ee1540 going to sleep for 11 seconds 00000100:00100000:3.0:1784044369.707606:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581055232 00000100:00100000:3.0:1784044369.707613:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581055232 00000100:00100000:3.0:1784044369.707677:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1784044369.707687:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38437a7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99a46fb7-9af9-40f1-9c76-329d6781ee81+23:19521:x1870705581055232:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1784044369.707821:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38437a7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99a46fb7-9af9-40f1-9c76-329d6781ee81+23:19521:x1870705581055232:12345-0@lo:502:mount.lustre.0 Request processed in 135us (585us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044369.707831:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1784044369.707902:0:19521:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39412e8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99a46fb7-9af9-40f1-9c76-329d6781ee81:19521:1870705581055232:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1784044369.708150:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:3.0:1784044369.708209:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:3.0:1784044369.708230:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:3.0:1784044369.708246:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:3.0:1784044369.708261:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:3.0:1784044369.708277:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:3.0:1784044369.708292:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:3.0:1784044369.708304:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000040:00080000:3.0:1784044369.708315:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:3.0:1784044369.708327:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10112 00000040:00080000:3.0:1784044369.708337:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10240 00000100:00100000:3.0:1784044369.708382:0:19521:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843ce4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99a46fb7-9af9-40f1-9c76-329d6781ee81:19521:1870705581055360:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1784044369.708435:0:19521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044369.708462:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581055360 00000100:00100000:3.0:1784044369.708467:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581055360 00000100:00100000:3.0:1784044369.708494:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1784044369.708501:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38437a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99a46fb7-9af9-40f1-9c76-329d6781ee81+23:19521:x1870705581055360:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1784044369.708571:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38437a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99a46fb7-9af9-40f1-9c76-329d6781ee81+23:19521:x1870705581055360:12345-0@lo:502:mount.lustre.0 Request processed in 70us (135us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044369.708578:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1784044369.708619:0:19521:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b38420db840 going to sleep for 11 seconds 00000100:00100000:3.0:1784044369.708633:0:19521:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843ce4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99a46fb7-9af9-40f1-9c76-329d6781ee81:19521:1870705581055360:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1784044369.708667:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10464 00000040:00080000:3.0:1784044369.708675:0:19521:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:2.0:1784044369.713905:0:19529:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784044369.713920:0:19529:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784044369.713923:0:19529:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1784044369.713930:0:19529:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9b3975aa7800 00000020:00000080:2.0:1784044369.713933:0:19529:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1784044369.713940:0:19529:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784044369.713942:0:19529:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784044369.713944:0:19529:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1784044369.713946:0:19529:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784044369.713948:0:19529:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784044369.713949:0:19529:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1784044369.713952:0:19529:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9b3975aa7800 00000020:00000080:2.0:1784044369.713954:0:19529:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1784044369.714017:0:19529:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784044369.714020:0:19529:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784044369.714021:0:19529:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1784044369.714023:0:19529:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784044369.714025:0:19529:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784044369.714027:0:19529:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1784044369.714030:0:19529:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9b3975aa7800 00000020:00000080:2.0:1784044369.714032:0:19529:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1784044369.714049:0:19529:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784044369.714051:0:19529:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784044369.714052:0:19529:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1784044369.714054:0:19529:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784044369.714057:0:19529:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784044369.714058:0:19529:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1784044369.714061:0:19529:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9b3975aa7800 00000020:00000080:2.0:1784044369.714063:0:19529:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1784044369.714080:0:19529:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784044369.714089:0:19529:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784044369.714090:0:19529:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1784044369.714094:0:19529:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:3.0:1784044369.716942:0:19521:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:3.0:1784044369.716999:0:19521:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1784044369.717023:0:19521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b38410b6800/0x89871fc3aba19469 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba19470 expref: -99 pid: 19521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044369.717038:0:19521:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9b38410b6800/0x89871fc3aba19469 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba19470 expref: -99 pid: 19521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784044369.717118:0:19521:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1784044369.717121:0:19521:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9b3975aa7800 10000000:01000000:3.0:1784044369.717124:0:19521:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9b3975aa7800 10000000:01000000:3.0:1784044369.717128:0:19521:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1784044369.717135:0:19521:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9b3975aa7800 from 1 10000000:01000000:3.0:1784044369.717138:0:19521:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1784044369.717210:0:19521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b3982054e00/0x89871fc3aba19477 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044369.717220:0:19521:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9b3982054e00/0x89871fc3aba19477 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044369.717232:0:19521:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9b3982054e00/0x89871fc3aba19477 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044369.717259:0:19521:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843ce4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99a46fb7-9af9-40f1-9c76-329d6781ee81:19521:1870705581055488:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1784044369.717331:0:19521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044369.717379:0:19521:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b38420dbd80 going to sleep for 11 seconds 00000100:00100000:2.0:1784044369.718044:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581055488 00000100:00100000:2.0:1784044369.718052:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581055488 00000100:00100000:2.0:1784044369.718103:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1784044369.718113:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38437a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99a46fb7-9af9-40f1-9c76-329d6781ee81+23:19521:x1870705581055488:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1784044369.718126:0:17193:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784044369.718139:0:17193:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b3843799200/0x89871fc3aba1947e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x89871fc3aba19477 expref: -99 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044369.719739:0:17193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b3843799200/0x89871fc3aba1947e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x89871fc3aba19477 expref: 24 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044369.719757:0:17193:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b3843799200/0x89871fc3aba1947e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x89871fc3aba19477 expref: 24 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044369.719766:0:17193:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3843799200, rc 0) 00000100:00100000:2.0:1784044369.720008:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38437a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99a46fb7-9af9-40f1-9c76-329d6781ee81+24:19521:x1870705581055488:12345-0@lo:101:mount.lustre.0 Request processed in 1895us (2676us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044369.720018:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1784044369.721779:0:19521:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843ce4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99a46fb7-9af9-40f1-9c76-329d6781ee81:19521:1870705581055488:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1784044369.721819:0:19521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9b3982054e00/0x89871fc3aba19477 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba1947e expref: -99 pid: 19521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044369.721831:0:19521:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9b3982054e00/0x89871fc3aba19477 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x89871fc3aba1947e expref: -99 pid: 19521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1784044369.726608:0:19521:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000040:00080000:1.0:1784044369.727297:0:19521:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1784044369.729068:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:1.0:1784044369.729107:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:1.0:1784044369.729122:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:1.0:1784044369.729134:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:1.0:1784044369.729147:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:1.0:1784044369.729159:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:1.0:1784044369.729199:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:1.0:1784044369.729218:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:1.0:1784044369.729230:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:1.0:1784044369.729243:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:1.0:1784044369.729255:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:1.0:1784044369.729267:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:1.0:1784044369.729280:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:1.0:1784044369.729292:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:1.0:1784044369.729302:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:1.0:1784044369.729313:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:1.0:1784044369.729325:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:1.0:1784044369.729337:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:1.0:1784044369.729352:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:1.0:1784044369.729364:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:1.0:1784044369.729377:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:1.0:1784044369.729389:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:1.0:1784044369.729412:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:1.0:1784044369.729427:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:1.0:1784044369.729441:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:1.0:1784044369.729455:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:1.0:1784044369.729467:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:1.0:1784044369.729478:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:1.0:1784044369.729490:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:1.0:1784044369.729502:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:1.0:1784044369.729516:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:1.0:1784044369.729528:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:1.0:1784044369.729539:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:1.0:1784044369.729570:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:1.0:1784044369.729586:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:1.0:1784044369.729599:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:1.0:1784044369.729611:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:1.0:1784044369.732696:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:1.0:1784044369.732752:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14912 00000040:00080000:1.0:1784044369.732766:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 88 off15000 00000040:00080000:1.0:1784044369.732777:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 128 off15128 00000040:00080000:1.0:1784044369.733859:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 144 off15272 00000040:00080000:1.0:1784044369.733914:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 128 off15400 00000040:00080000:1.0:1784044369.733930:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 224 off15624 00000040:00080000:1.0:1784044369.733945:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off15848 00000040:00080000:1.0:1784044369.733958:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].46, 80 off15928 00000040:00080000:1.0:1784044369.733991:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].47, 224 off16152 00000040:00080000:1.0:1784044369.733997:0:19521:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 47 count 48 00000100:00100000:1.0:1784044369.734121:0:19521:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d4ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99a46fb7-9af9-40f1-9c76-329d6781ee81:19521:1870705581055616:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1784044369.734228:0:19521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044369.734283:0:19521:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b39510aa300 going to sleep for 11 seconds 00000100:00100000:0.0:1784044369.734378:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581055616 00000100:00100000:0.0:1784044369.734385:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581055616 00000100:00100000:0.0:1784044369.734443:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1784044369.734454:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38437a7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99a46fb7-9af9-40f1-9c76-329d6781ee81+24:19521:x1870705581055616:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1784044369.734601:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38437a7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99a46fb7-9af9-40f1-9c76-329d6781ee81+24:19521:x1870705581055616:12345-0@lo:501:mount.lustre.0 Request processed in 148us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044369.734610:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1784044369.736509:0:19521:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d4ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99a46fb7-9af9-40f1-9c76-329d6781ee81:19521:1870705581055616:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1784044369.736581:0:19521:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d4ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99a46fb7-9af9-40f1-9c76-329d6781ee81:19521:1870705581055744:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1784044369.736665:0:19521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044369.736698:0:19521:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b39510aa300 going to sleep for 11 seconds 00000100:00100000:3.0:1784044369.736905:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581055744 00000100:00100000:3.0:1784044369.736912:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581055744 00000100:00100000:3.0:1784044369.736964:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1784044369.736975:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843df9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99a46fb7-9af9-40f1-9c76-329d6781ee81+24:19521:x1870705581055744:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1784044369.737099:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843df9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99a46fb7-9af9-40f1-9c76-329d6781ee81+24:19521:x1870705581055744:12345-0@lo:503:mount.lustre.0 Request processed in 125us (432us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044369.737107:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1784044369.737163:0:19521:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d4ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99a46fb7-9af9-40f1-9c76-329d6781ee81:19521:1870705581055744:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1784044369.737634:0:19521:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1784044369.737709:0:19521:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843ce4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99a46fb7-9af9-40f1-9c76-329d6781ee81:19521:1870705581055872:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1784044369.737751:0:19521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044369.737780:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581055872 00000100:00100000:3.0:1784044369.737784:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581055872 00000100:00100000:3.0:1784044369.737827:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1784044369.737834:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843dfb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99a46fb7-9af9-40f1-9c76-329d6781ee81+24:19521:x1870705581055872:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1784044369.737926:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843dfb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99a46fb7-9af9-40f1-9c76-329d6781ee81+24:19521:x1870705581055872:12345-0@lo:502:mount.lustre.0 Request processed in 92us (174us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044369.737934:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1784044369.737969:0:19521:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b38420dbd80 going to sleep for 11 seconds 00000100:00100000:3.0:1784044369.737992:0:19521:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843ce4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99a46fb7-9af9-40f1-9c76-329d6781ee81:19521:1870705581055872:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1784044369.738165:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:3.0:1784044369.738217:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:3.0:1784044369.738231:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:3.0:1784044369.738244:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:3.0:1784044369.738256:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:3.0:1784044369.738271:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:3.0:1784044369.738285:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:3.0:1784044369.738298:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:3.0:1784044369.738311:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:3.0:1784044369.738325:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:3.0:1784044369.738339:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:3.0:1784044369.738353:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:3.0:1784044369.738366:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:3.0:1784044369.738379:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:3.0:1784044369.738392:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:3.0:1784044369.738423:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:3.0:1784044369.738439:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:3.0:1784044369.738452:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:3.0:1784044369.738465:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:3.0:1784044369.738478:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:3.0:1784044369.738489:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:3.0:1784044369.738501:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:3.0:1784044369.738515:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:3.0:1784044369.738529:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:3.0:1784044369.738542:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:3.0:1784044369.738555:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:3.0:1784044369.738568:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:3.0:1784044369.738580:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:3.0:1784044369.738592:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:3.0:1784044369.738604:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:3.0:1784044369.738617:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:3.0:1784044369.738648:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:3.0:1784044369.738662:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:3.0:1784044369.738674:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:3.0:1784044369.738685:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:3.0:1784044369.738696:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:3.0:1784044369.738708:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:3.0:1784044369.738720:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:3.0:1784044369.738732:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:3.0:1784044369.738743:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:3.0:1784044369.738755:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:3.0:1784044369.738766:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:3.0:1784044369.738776:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:3.0:1784044369.738788:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:3.0:1784044369.738799:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:3.0:1784044369.738811:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:3.0:1784044369.738823:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:3.0:1784044369.738848:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:3.0:1784044369.738901:0:19521:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843ce4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99a46fb7-9af9-40f1-9c76-329d6781ee81:19521:1870705581056000:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1784044369.738957:0:19521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044369.738995:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581056000 00000100:00100000:3.0:1784044369.739000:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581056000 00000100:00100000:3.0:1784044369.739032:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1784044369.739039:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397d65dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99a46fb7-9af9-40f1-9c76-329d6781ee81+24:19521:x1870705581056000:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1784044369.739128:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397d65dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99a46fb7-9af9-40f1-9c76-329d6781ee81+24:19521:x1870705581056000:12345-0@lo:502:mount.lustre.0 Request processed in 89us (171us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044369.739136:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1784044369.739195:0:19521:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b38420dbd80 going to sleep for 11 seconds 00000100:00100000:3.0:1784044369.739214:0:19521:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843ce4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99a46fb7-9af9-40f1-9c76-329d6781ee81:19521:1870705581056000:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1784044369.739349:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:3.0:1784044369.739375:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:3.0:1784044369.739396:0:19521:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843ce4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99a46fb7-9af9-40f1-9c76-329d6781ee81:19521:1870705581056128:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1784044369.739430:0:19521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044369.739455:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581056128 00000100:00100000:3.0:1784044369.739458:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581056128 00000100:00100000:3.0:1784044369.739481:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1784044369.739486:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397d65c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99a46fb7-9af9-40f1-9c76-329d6781ee81+24:19521:x1870705581056128:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1784044369.739548:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397d65c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99a46fb7-9af9-40f1-9c76-329d6781ee81+24:19521:x1870705581056128:12345-0@lo:502:mount.lustre.0 Request processed in 61us (117us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044369.739555:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1784044369.739585:0:19521:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b38420dbd80 going to sleep for 11 seconds 00000100:00100000:3.0:1784044369.739597:0:19521:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843ce4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99a46fb7-9af9-40f1-9c76-329d6781ee81:19521:1870705581056128:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1784044369.739634:0:19521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:3.0:1784044369.739642:0:19521:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:1.0:1784044369.766127:0:19533:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1784044369.766146:0:19533:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9b3970fe19c0) 00000020:00000080:1.0:1784044369.766208:0:19533:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type lwp with refcount 2 00000020:01000004:1.0:1784044369.766433:0:19533:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9b3975aa7800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1784044369.766439:0:19533:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9b3975aa7800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1784044369.766442:0:19533:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9b3975aa7800 3 00010000:00080000:1.0:1784044369.766476:0:19533:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9b39513bb000@lustre-MDT0000-lwp-OST0001: add connection 192.168.202.140@tcp at head 00010000:00010000:1.0:1784044369.779005:0:19533:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-11 is initialized 00000020:00000080:1.0:1784044369.779122:0:19533:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:1.0:1784044369.779203:0:19533:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1784044369.779218:0:19533:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x89871fc3aba1948c 00000100:00080000:1.0:1784044369.779228:0:19533:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1784044369.779234:0:19533:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9b39513bb000 using connection 192.168.202.140@tcp/0@lo 00000100:00100000:1.0:1784044369.779276:0:19533:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b3843d4df80 x1870705581056256/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1784044369.779301:0:19533:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1784044369.779749:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3637:1870705581056256:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1784044369.779849:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1784044369.779962:0:14129:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1784044369.779966:0:14129:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1784044369.779969:0:14129:0:(import.c:65:import_set_state_nolock()) ffff9b397b804800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784044369.779973:0:14129:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 561 00000100:00080000:2.0:1784044369.779976:0:14129:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1784044369.779989:0:14129:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9b397b804800 using connection 192.168.202.140@tcp/0@lo 00000100:00100000:2.0:1784044369.780005:0:14129:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b39759b6d80 x1870705581056640/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1784044369.780039:0:14129:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1784044369.780042:0:14129:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1784044369.780044:0:14129:0:(import.c:65:import_set_state_nolock()) ffff9b3944fd3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784044369.780047:0:14129:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 561 00000100:00080000:2.0:1784044369.780050:0:14129:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1784044369.780053:0:14129:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9b3944fd3800 using connection 192.168.202.140@tcp/0@lo 00000100:00100000:2.0:1784044369.780063:0:14129:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b39759b4380 x1870705581057024/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1784044369.780099:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39759b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1870705581056384:0@lo:400:kworker.0 00000100:00100000:2.0:1784044369.780203:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044369.780224:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39759b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1870705581057152:0@lo:400:kworker.0 00000100:00100000:2.0:1784044369.780249:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044369.780268:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1784044369.780274:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39759b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1870705581056512:0@lo:400:kworker.0 00000100:00100000:2.0:1784044369.780301:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044369.780320:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39759b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1870705581057280:0@lo:400:kworker.0 00000100:00100000:2.0:1784044369.780354:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044369.780385:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39759b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1870705581056768:0@lo:400:kworker.0 00000100:00100000:2.0:1784044369.780409:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044369.780427:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39759b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1870705581057408:0@lo:400:kworker.0 00000100:00100000:2.0:1784044369.780445:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044369.780464:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784044369.780469:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39759b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1870705581056896:0@lo:400:kworker.0 00000100:00100000:2.0:1784044369.780490:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044369.780542:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581056384 00000100:00100000:2.0:1784044369.781001:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581056384 00000100:00100000:2.0:1784044369.781047:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581056896 00000100:00100000:2.0:1784044369.781051:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581056896 00000100:00100000:2.0:1784044369.781086:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1784044369.781094:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39759b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1870705581056384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784044369.781155:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39759b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1870705581056384:12345-0@lo:400:kworker.0 Request processed in 61us (950us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044369.781163:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1784044369.781203:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1784044369.781209:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3947ee9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1870705581056896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784044369.781242:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3947ee9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1870705581056896:12345-0@lo:400:kworker.0 Request processed in 33us (750us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044369.781246:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1784044369.781267:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581056256 00000100:00100000:2.0:1784044369.781270:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581056256 00000100:00100000:2.0:1784044369.781282:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581057152 00000100:00100000:2.0:1784044369.781284:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581057152 00000100:00100000:2.0:1784044369.781297:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581057280 00000100:00100000:2.0:1784044369.781299:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581057280 00000100:00100000:2.0:1784044369.781324:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581056768 00000100:00100000:2.0:1784044369.781326:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581056768 00000100:00100000:2.0:1784044369.781335:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581057408 00000100:00080000:3.0:1784044369.781582:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784044369.785392:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581057408 00000100:00100000:2.0:1784044369.785472:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1784044369.785483:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3947ee8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1870705581057152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784044369.785730:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3947ee8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1870705581057152:12345-0@lo:400:kworker.0 Request processed in 248us (5478us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044369.785738:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1784044369.785756:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1784044369.785762:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3947eead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1870705581057280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784044369.785859:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3947eead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1870705581057280:12345-0@lo:400:kworker.0 Request processed in 97us (5503us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044369.785866:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1784044369.785890:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1784044369.785897:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3947ee8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1870705581056768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784044369.785930:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3947ee8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1870705581056768:12345-0@lo:400:kworker.0 Request processed in 33us (5519us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044369.785936:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1784044369.785948:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1784044369.785954:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3947ee9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1870705581057408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784044369.786001:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3947ee9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1870705581057408:12345-0@lo:400:kworker.0 Request processed in 48us (5554us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044369.786008:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1784044369.786020:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1784044369.786025:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39759b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3637:x1870705581056256:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1784044369.786048:0:17200:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 562 last 0 00000020:00000080:2.0:1784044369.786087:0:17200:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x89871fc3aba19493 00000004:00100000:2.0:1784044369.786105:0:17200:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1784044369.786138:0:17200:0:(import.c:65:import_set_state_nolock()) ffff9b38437d8000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784044369.786206:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39759b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1870705581056256:12345-0@lo:38:llog_process_th.0 Request processed in 179us (6358us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044369.786213:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1784044369.786239:0:18706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581056512 00000100:00100000:2.0:1784044369.786243:0:18706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581056512 00000100:00100000:2.0:1784044369.786282:0:18706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1784044369.786289:0:18706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3947eea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1870705581056512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784044369.786322:0:18706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3947eea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1870705581056512:12345-0@lo:400:kworker.0 Request processed in 34us (6021us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044369.786328:0:18706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000020:01000004:1.0:1784044369.786611:0:19533:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1784044369.786642:0:19533:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff9b3970fe4d40) 00000020:00000080:1.0:1784044369.786668:0:19533:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:1.0:1784044369.786867:0:19533:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9b3975aa7800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1784044369.786872:0:19533:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9b3975aa7800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1784044369.786875:0:19533:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9b3975aa7800 3 00010000:00080000:1.0:1784044369.786922:0:19533:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9b397a9eb000@lustre-MDT0001-lwp-OST0001: add connection 192.168.202.140@tcp at head 00010000:00010000:1.0:1784044369.788518:0:19533:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-12 is initialized 00000020:00000080:1.0:1784044369.788612:0:19533:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:1.0:1784044369.788650:0:19533:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1784044369.788668:0:19533:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0x89871fc3aba194a1 00000100:00080000:1.0:1784044369.788677:0:19533:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1784044369.788681:0:19533:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff9b397a9eb000 using connection 192.168.202.140@tcp/0@lo 00000100:00100000:1.0:1784044369.788713:0:19533:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b3843d4ea00 x1870705581057536/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1784044369.788727:0:19533:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:2.0:1784044369.789305:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39759b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1870705581056896:0@lo:400:kworker.0 00010000:00080000:2.0:1784044369.789321:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b39759b7b80 x1870705581056768/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044385 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784044369.789330:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39759b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1870705581056768:0@lo:400:kworker.0 00010000:00080000:2.0:1784044369.789403:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b39759b7800 x1870705581057408/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044385 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784044369.789412:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39759b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1870705581057408:0@lo:400:kworker.0 00000100:00100000:2.0:1784044369.789450:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39759b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1870705581056640:0@lo:8:kworker.0 00000100:00100000:2.0:1784044369.789508:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044369.789538:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39759b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1870705581057024:0@lo:8:kworker.0 00000100:00100000:2.0:1784044369.792014:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044369.792070:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3637:1870705581057536:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1784044369.792108:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1784044369.792165:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b3843d4df80 x1870705581056256/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784044379 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784044369.792206:0:3637:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1784044369.792218:0:3637:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:2.0:1784044369.792229:0:3637:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1784044369.792235:0:3637:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1784044369.792238:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9b39513bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1784044369.792246:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3637:1870705581056256:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1784044369.792308:0:18707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581056640 00000100:00100000:2.0:1784044369.792315:0:18707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581056640 00000100:00100000:1.0:1784044369.792473:0:18933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581057024 00000100:00100000:1.0:1784044369.792477:0:18933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581057024 00000100:00100000:1.0:1784044369.793595:0:18933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1784044369.793604:0:18933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3947ee9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3637:x1870705581056640:12345-0@lo:8:kworker.0 00000100:00100000:1.0:1784044369.793690:0:18933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3947ee9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3637:x1870705581056640:12345-0@lo:8:kworker.0 Request processed in 85us (4180us total) trans 0 rc -11/-11 00000100:00100000:1.0:1784044369.793698:0:18933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1784044369.793716:0:18933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1784044369.793720:0:18933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39759b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3637:x1870705581057024:12345-0@lo:8:kworker.0 00000100:00100000:1.0:1784044369.793752:0:18933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39759b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3637:x1870705581057024:12345-0@lo:8:kworker.0 Request processed in 31us (1750us total) trans 0 rc -11/-11 00000100:00100000:1.0:1784044369.793759:0:18933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1784044369.793801:0:3637:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1784044369.793808:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9b397b804800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1784044369.793812:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1784044369.793815:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39759b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1870705581056640:0@lo:8:kworker.0 00000100:00100000:1.0:1784044369.793824:0:3637:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1784044369.793827:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9b3944fd3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1784044369.793830:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1784044369.793832:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39759b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1870705581057024:0@lo:8:kworker.0 00000100:00080000:3.0:1784044369.794903:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1784044369.794910:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1784044369.796016:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39759b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1870705581056512:0@lo:400:kworker.0 00010000:00080000:3.0:1784044369.796039:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b39759b5f80 x1870705581057280/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044385 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784044369.796048:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39759b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1870705581057280:0@lo:400:kworker.0 00000100:00100000:3.0:1784044369.796061:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39759b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1870705581056384:0@lo:400:kworker.0 00010000:00080000:3.0:1784044369.796073:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b39759b4000 x1870705581057152/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044385 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784044369.796082:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39759b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1870705581057152:0@lo:400:kworker.0 00000040:00080000:1.0:1784044369.797655:0:19533:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000020:01000000:2.0:1784044369.800667:0:19521:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1784044369.800722:0:19521:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1784044369.801353:0:19521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b3982054e00/0x89871fc3aba19477 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba1947e expref: -99 pid: 19521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044369.801367:0:19521:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9b3982054e00/0x89871fc3aba19477 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba1947e expref: -99 pid: 19521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1784044369.801436:0:19521:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1784044369.801438:0:19521:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1784044369.801440:0:19521:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784044369.801441:0:19521:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784044369.801442:0:19521:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784044369.801443:0:19521:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784044369.801445:0:19521:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1784044369.801446:0:19521:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784044369.801447:0:19521:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1784044369.801451:0:19521:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:2.0:1784044369.801454:0:19521:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1784044369.801455:0:19521:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1784044369.801456:0:19521:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784044369.801457:0:19521:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784044369.801458:0:19521:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784044369.801462:0:19521:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784044369.801463:0:19521:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1784044369.801464:0:19521:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784044369.801465:0:19521:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1784044369.801489:0:19521:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1784044369.801508:0:19521:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39759b4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99a46fb7-9af9-40f1-9c76-329d6781ee81:19521:1870705581057664:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1784044369.801753:0:19521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044369.801797:0:19521:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3844627b40 going to sleep for 11 seconds 00000100:00100000:2.0:1784044369.801827:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581057536 00000100:00100000:2.0:1784044369.801834:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581057536 00000100:00100000:2.0:1784044369.801873:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1784044369.801890:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39759b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3637:x1870705581057536:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1784044369.801919:0:17200:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 562 last 0 00000020:00000080:2.0:1784044369.801960:0:17200:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0x89871fc3aba194a8 00000004:00100000:2.0:1784044369.801977:0:17200:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1784044369.802020:0:17200:0:(import.c:65:import_set_state_nolock()) ffff9b38437df800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784044369.802082:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39759b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1870705581057536:12345-0@lo:38:llog_process_th.0 Request processed in 199us (9971us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044369.802089:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1784044369.804162:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b3843d4ea00 x1870705581057536/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784044379 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784044369.804199:0:3637:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1784044369.804211:0:3637:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 2 00000100:00080000:0.0:1784044369.804223:0:3637:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1784044369.804229:0:3637:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1784044369.804232:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9b397a9eb000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1784044369.804241:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3637:1870705581057536:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1784044369.804518:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581057664 00000100:00100000:3.0:1784044369.804524:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581057664 00000100:00100000:3.0:1784044369.804750:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1784044369.804760:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397d65f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99a46fb7-9af9-40f1-9c76-329d6781ee81+24:19521:x1870705581057664:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1784044369.804790:0:17193:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1784044369.804805:0:17193:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1784044369.830393:0:17193:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1784044369.830424:0:17193:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:2.0:1784044369.830925:0:17216:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1784044369.830932:0:17216:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1784044369.830961:0:17216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b3843799e00/0x89871fc3aba194af lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044369.830984:0:17216:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b38410b7200/0x89871fc3aba1935f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x89871fc3aba19358 expref: 24 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044369.830992:0:17216:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b38410b6c00/0x89871fc3aba1936d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x89871fc3aba19366 expref: 24 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044369.831000:0:17216:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b3843799e00/0x89871fc3aba194af lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044369.831059:0:17216:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b38410b6c00/0x89871fc3aba1936d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x89871fc3aba19366 expref: 24 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044369.831074:0:17216:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b38410b6c00/0x89871fc3aba1936d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x89871fc3aba19366 expref: 24 pid: 17193 timeout: 663 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044369.831090:0:17216:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39759b4000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17216:1870705581057792:0@lo:104: 00000100:00100000:2.0:1784044369.831163:0:17216:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044369.831241:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397d65f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99a46fb7-9af9-40f1-9c76-329d6781ee81+24:19521:x1870705581057664:12345-0@lo:253:mount.lustre.0 Request processed in 26482us (29486us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044369.831253:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00010000:00010000:2.0:1784044369.832353:0:17216:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b38410b7200/0x89871fc3aba1935f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x89871fc3aba19358 expref: 23 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044369.832366:0:17216:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b38410b7200/0x89871fc3aba1935f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x89871fc3aba19358 expref: 23 pid: 17192 timeout: 663 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044369.832378:0:17216:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39759b5f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17216:1870705581057920:0@lo:104: 00000100:00100000:2.0:1784044369.832421:0:17216:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044369.832445:0:17216:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3844627300 going to sleep for 11 seconds 00000100:00100000:2.0:1784044369.832494:0:19521:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39759b4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:99a46fb7-9af9-40f1-9c76-329d6781ee81:19521:1870705581057664:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1784044369.832506:0:19521:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1784044369.832510:0:19521:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1784044369.832511:0:19521:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1784044369.832512:0:19521:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784044369.832514:0:19521:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784044369.832515:0:19521:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784044369.832516:0:19521:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784044369.832517:0:19521:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1784044369.832519:0:19521:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784044369.832521:0:19521:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1784044369.832536:0:19521:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:1.0:1784044369.833829:0:17183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581057792 00000100:00100000:1.0:1784044369.833841:0:17183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581057792 00000100:00100000:1.0:1784044369.833892:0:17183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581057920 00000100:00100000:1.0:1784044369.833896:0:17183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581057920 00000100:00100000:1.0:1784044369.833916:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1784044369.833925:0:17183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39759b6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:99a46fb7-9af9-40f1-9c76-329d6781ee81+4:17216:x1870705581057792:12345-0@lo:104: 00010000:00010000:1.0:1784044369.833940:0:17183:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.140@tcp lock: ffff9b38410b7e00/0x89871fc3aba19366 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x89871fc3aba1936d expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044369.834027:0:17183:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1784044369.834033:0:17183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39759b6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:99a46fb7-9af9-40f1-9c76-329d6781ee81+4:17216:x1870705581057792:12345-0@lo:104: Request processed in 109us (2870us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044369.834040:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1784044369.834056:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1784044369.834062:0:17183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39759b5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:99a46fb7-9af9-40f1-9c76-329d6781ee81+3:17216:x1870705581057920:12345-0@lo:104: 00010000:00010000:1.0:1784044369.834070:0:17183:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.140@tcp lock: ffff9b38410b6e00/0x89871fc3aba19358 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x89871fc3aba1935f expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044369.834106:0:17183:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1784044369.834110:0:17183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39759b5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:99a46fb7-9af9-40f1-9c76-329d6781ee81+3:17216:x1870705581057920:12345-0@lo:104: Request processed in 49us (1690us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044369.834116:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:1.0:1784044369.834134:0:17187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1784044369.834140:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: ffff9b38410b7e00/0x89871fc3aba19366 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x89871fc3aba1936d expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044369.834148:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38410b7e00 already unused, calling callback (ffffffffc113cc20) 10000000:00010000:1.0:1784044369.834164:0:17187:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: ffff9b38410b7e00/0x89871fc3aba19366 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x89871fc3aba1936d expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044369.834203:0:17187:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9b38410b7e00/0x89871fc3aba19366 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x89871fc3aba1936d expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784044369.834212:0:17187:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9b38410b7e00/0x89871fc3aba19366 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x89871fc3aba1936d expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784044369.834219:0:17187:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1784044369.834260:0:17187:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.140@tcp lock: ffff9b38410b7e00/0x89871fc3aba19366 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x89871fc3aba1936d expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044369.834266:0:17187:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784044369.834291:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: ffff9b38410b7e00/0x89871fc3aba19366 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x89871fc3aba1936d expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044369.834298:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9b38410b7e00/0x89871fc3aba19366 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x89871fc3aba1936d expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044369.834312:0:17187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784044369.834315:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: ffff9b38410b6e00/0x89871fc3aba19358 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x89871fc3aba1935f expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044369.834321:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38410b6e00 already unused, calling callback (ffffffffc113cc20) 10000000:00010000:1.0:1784044369.834323:0:17187:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: ffff9b38410b6e00/0x89871fc3aba19358 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x89871fc3aba1935f expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044369.834330:0:17187:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9b38410b6e00/0x89871fc3aba19358 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x89871fc3aba1935f expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784044369.834348:0:17187:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9b38410b6e00/0x89871fc3aba19358 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x89871fc3aba1935f expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784044369.834353:0:17187:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1784044369.834367:0:17187:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.140@tcp lock: ffff9b38410b6e00/0x89871fc3aba19358 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x89871fc3aba1935f expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044369.834373:0:17187:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784044369.834388:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: ffff9b38410b6e00/0x89871fc3aba19358 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x89871fc3aba1935f expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044369.834410:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9b38410b6e00/0x89871fc3aba19358 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x89871fc3aba1935f expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044369.834424:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784044369.834425:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784044369.834427:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784044369.834434:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784044369.834448:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:99a46fb7-9af9-40f1-9c76-329d6781ee81:3641:1870705581058048:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784044369.834530:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044369.835796:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1784044369.835810:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:99a46fb7-9af9-40f1-9c76-329d6781ee81:3639:1870705581058176:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784044369.835851:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044369.835905:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581058048 00000100:00100000:1.0:1784044369.835912:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581058048 00010000:00010000:1.0:1784044369.835940:0:17184:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b38410b6c00/0x89871fc3aba1936d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x89871fc3aba19366 expref: 24 pid: 17193 timeout: 663 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044369.835964:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581058176 00000100:00100000:1.0:1784044369.835980:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581058176 00010000:00010000:1.0:1784044369.835992:0:17184:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b38410b7200/0x89871fc3aba1935f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x89871fc3aba19358 expref: 25 pid: 17192 timeout: 663 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044369.836007:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1784044369.836014:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:99a46fb7-9af9-40f1-9c76-329d6781ee81+25:3641:x1870705581058048:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784044369.836026:0:17184:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784044369.836031:0:17184:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b38410b6c00/0x89871fc3aba1936d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x89871fc3aba19366 expref: 25 pid: 17193 timeout: 663 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044369.836042:0:17184:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b38410b6c00/0x89871fc3aba1936d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x89871fc3aba19366 expref: 25 pid: 17193 timeout: 663 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044369.836062:0:17184:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784044369.836098:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:99a46fb7-9af9-40f1-9c76-329d6781ee81+25:3641:x1870705581058048:12345-0@lo:103:ldlm_bl.0 Request processed in 84us (1567us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044369.836105:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1784044369.836120:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1784044369.836126:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d4f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:99a46fb7-9af9-40f1-9c76-329d6781ee81+24:3639:x1870705581058176:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784044369.836149:0:17184:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784044369.836154:0:17184:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b38410b7200/0x89871fc3aba1935f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x89871fc3aba19358 expref: 24 pid: 17192 timeout: 663 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044369.836163:0:17184:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b38410b7200/0x89871fc3aba1935f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x89871fc3aba19358 expref: 24 pid: 17192 timeout: 663 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044369.836195:0:17184:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b3843799e00/0x89871fc3aba194af lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044369.836205:0:17184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b3843799e00/0x89871fc3aba194af lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1784044369.836225:0:17184:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.025288238s 00010000:00010000:1.0:1784044369.836231:0:17184:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b3843799e00/0x89871fc3aba194af lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044369.836237:0:17184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b3843799e00/0x89871fc3aba194af lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044369.836244:0:17184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b3843799e00/0x89871fc3aba194af lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044369.836251:0:17184:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b3843799e00/0x89871fc3aba194af lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044369.836257:0:17184:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3843799e00 already unused, calling callback (ffffffffc0b56230) 00010000:00010000:1.0:1784044369.836261:0:17184:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b3843799e00/0x89871fc3aba194af lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044369.836269:0:17184:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b3843799e00/0x89871fc3aba194af lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044369.836279:0:17184:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b3843799e00/0x89871fc3aba194af lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044369.836288:0:17184:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784044369.836316:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d4f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:99a46fb7-9af9-40f1-9c76-329d6781ee81+24:3639:x1870705581058176:12345-0@lo:103:ldlm_bl.0 Request processed in 189us (464us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044369.836323:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1784044369.836371:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:99a46fb7-9af9-40f1-9c76-329d6781ee81:3641:1870705581058048:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784044369.836394:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:99a46fb7-9af9-40f1-9c76-329d6781ee81:3639:1870705581058176:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784044369.836435:0:17216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b38410b6c00/0x89871fc3aba1936d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x89871fc3aba19366 expref: 23 pid: 17193 timeout: 663 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044369.836446:0:17216:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39759b4000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17216:1870705581057792:0@lo:104: 00010000:00010000:1.0:1784044369.836457:0:17216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b38410b7200/0x89871fc3aba1935f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x89871fc3aba19358 expref: 22 pid: 17192 timeout: 663 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044369.836465:0:17216:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39759b5f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17216:1870705581057920:0@lo:104: 00010000:00010000:1.0:1784044369.836481:0:17216:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b3843799e00/0x89871fc3aba194af lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044369.836489:0:17216:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b3843799e00/0x89871fc3aba194af lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044369.836495:0:17216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b3843799e00/0x89871fc3aba194af lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044369.836501:0:17216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b3843799e00/0x89871fc3aba194af lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00000004:0.0:1784044369.853002:0:19521:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:2.0:1784044369.857473:0:19521:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:2.0:1784044369.857492:0:19521:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:2.0:1784044369.857537:0:19521:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1784044369.858041:0:19521:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.140@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1784044369.858070:0:19521:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=50 00000080:00000004:2.0:1784044369.858092:0:19521:0:(super25.c:181:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:1.0:1784044369.875525:0:19521:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1784044369.875986:0:19521:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1784044369.948681:0:19100:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784044370.000327:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784044370.000367:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1870705581058304:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1784044370.000448:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044370.000497:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581058304 00000100:00100000:1.0:1784044370.000504:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581058304 00000100:00100000:1.0:1784044370.000568:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1784044370.000579:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1870705581058304:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1784044370.000635:0:17206:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1784044370.000744:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1870705581058304:12345-0@lo:41:osp-pre-1-0.0 Request processed in 166us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044370.000751:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1784044370.000804:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1870705581058304:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1784044370.004588:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843ce4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1870705581058432:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1784044370.004668:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044370.004724:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581058432 00000100:00100000:3.0:1784044370.004731:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581058432 00000100:00100000:3.0:1784044370.004779:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1784044370.004787:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843ce4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1870705581058432:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1784044370.004821:0:17206:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1784044370.005020:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843ce4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1870705581058432:12345-0@lo:41:osp-pre-0-1.0 Request processed in 233us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044370.005028:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1784044370.011402:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843ce4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1870705581058432:0@lo:41:osp-pre-0-1.0 00000040:00080000:2.0:1784044370.894987:0:17952:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1784044370.959484:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1784044371.109692:0:19588:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1784044371.109951:0:19588:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 10000000:01000000:1.0:1784044371.471471:0:17196:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1784044371.471479:0:17196:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9b396f25a800 from 10 10000000:01000000:1.0:1784044371.471485:0:17196:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1784044371.471537:0:17196:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b397cb18400/0x89871fc3aba194b6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044371.471550:0:17196:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9b397cb18400/0x89871fc3aba194b6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044371.471562:0:17196:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9b397cb18400/0x89871fc3aba194b6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044371.471589:0:17196:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d4df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99a46fb7-9af9-40f1-9c76-329d6781ee81:17196:1870705581058560:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784044371.471660:0:17196:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044371.471711:0:17196:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3965ee7cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1784044371.472480:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581058560 00000100:00100000:0.0:1784044371.472488:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581058560 00000100:00100000:0.0:1784044371.472545:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1784044371.472554:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397d65e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99a46fb7-9af9-40f1-9c76-329d6781ee81+22:17196:x1870705581058560:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784044371.472568:0:17192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784044371.472583:0:17192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b38410b7200/0x89871fc3aba194bd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x89871fc3aba194b6 expref: -99 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044371.472608:0:17192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b38410b7200/0x89871fc3aba194bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x89871fc3aba194b6 expref: 23 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044371.472618:0:17192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b38410b7200/0x89871fc3aba194bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x89871fc3aba194b6 expref: 23 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044371.472629:0:17192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b38410b7200, rc 0) 00000100:00100000:0.0:1784044371.472684:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397d65e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99a46fb7-9af9-40f1-9c76-329d6781ee81+23:17196:x1870705581058560:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 130us (1023us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044371.472691:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1784044371.472829:0:17196:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d4df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99a46fb7-9af9-40f1-9c76-329d6781ee81:17196:1870705581058560:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784044371.472845:0:17196:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9b397cb18400/0x89871fc3aba194b6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba194bd expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044371.472854:0:17196:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9b397cb18400/0x89871fc3aba194b6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x89871fc3aba194bd expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044371.472937:0:17196:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d4df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99a46fb7-9af9-40f1-9c76-329d6781ee81:17196:1870705581058688:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1784044371.472969:0:17196:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044371.472997:0:17196:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3965ee7cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1784044371.474443:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581058688 00000100:00100000:0.0:1784044371.474453:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581058688 00000100:00100000:0.0:1784044371.474508:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1784044371.474516:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397d65c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99a46fb7-9af9-40f1-9c76-329d6781ee81+23:17196:x1870705581058688:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1784044371.474533:0:17193:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1784044371.474555:0:17193:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1784044371.474558:0:17193:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:0.0:1784044371.474663:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397d65c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99a46fb7-9af9-40f1-9c76-329d6781ee81+23:17196:x1870705581058688:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 149us (1693us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044371.474671:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1784044371.474822:0:17196:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d4df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99a46fb7-9af9-40f1-9c76-329d6781ee81:17196:1870705581058688:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1784044371.474901:0:17196:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1784044371.474909:0:17196:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b397cb18400/0x89871fc3aba194b6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba194bd expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044371.474918:0:17196:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9b397cb18400/0x89871fc3aba194b6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba194bd expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784044371.474927:0:17196:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1784044371.474930:0:17196:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9b397a8e8000 from 10 10000000:01000000:1.0:1784044371.474932:0:17196:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1784044371.474956:0:17196:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b397cb18200/0x89871fc3aba194c4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044371.474963:0:17196:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9b397cb18200/0x89871fc3aba194c4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044371.474972:0:17196:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9b397cb18200/0x89871fc3aba194c4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044371.474986:0:17196:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d4df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99a46fb7-9af9-40f1-9c76-329d6781ee81:17196:1870705581058816:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784044371.475013:0:17196:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044371.475046:0:17196:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3965ee7cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1784044371.475100:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581058816 00000100:00100000:3.0:1784044371.475104:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581058816 00000100:00100000:3.0:1784044371.475138:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1784044371.475146:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397d65ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99a46fb7-9af9-40f1-9c76-329d6781ee81+23:17196:x1870705581058816:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784044371.475154:0:17194:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784044371.475165:0:17194:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b3982054600/0x89871fc3aba194cb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x89871fc3aba194c4 expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044371.475230:0:17194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b3982054600/0x89871fc3aba194cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x89871fc3aba194c4 expref: 24 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044371.475248:0:17194:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b3982054600/0x89871fc3aba194cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x89871fc3aba194c4 expref: 24 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044371.475257:0:17194:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3982054600, rc 0) 00000100:00100000:3.0:1784044371.475286:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397d65ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99a46fb7-9af9-40f1-9c76-329d6781ee81+24:17196:x1870705581058816:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 141us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044371.475292:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1784044371.475412:0:17196:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d4df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99a46fb7-9af9-40f1-9c76-329d6781ee81:17196:1870705581058816:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784044371.475428:0:17196:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9b397cb18200/0x89871fc3aba194c4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba194cb expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044371.475436:0:17196:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9b397cb18200/0x89871fc3aba194c4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x89871fc3aba194cb expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044371.475469:0:17196:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d4df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99a46fb7-9af9-40f1-9c76-329d6781ee81:17196:1870705581058944:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1784044371.475495:0:17196:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044371.475517:0:17196:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3965ee7cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1784044371.475564:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581058944 00000100:00100000:3.0:1784044371.475567:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581058944 00000100:00100000:3.0:1784044371.475596:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1784044371.475602:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397d65fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99a46fb7-9af9-40f1-9c76-329d6781ee81+24:17196:x1870705581058944:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1784044371.475611:0:17192:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1784044371.475622:0:17192:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1784044371.475624:0:17192:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:3.0:1784044371.475690:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397d65fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99a46fb7-9af9-40f1-9c76-329d6781ee81+24:17196:x1870705581058944:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 88us (194us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044371.475697:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1784044371.475768:0:17196:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d4df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99a46fb7-9af9-40f1-9c76-329d6781ee81:17196:1870705581058944:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1784044371.475805:0:17196:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1784044371.475810:0:17196:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b397cb18200/0x89871fc3aba194c4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba194cb expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044371.475817:0:17196:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9b397cb18200/0x89871fc3aba194c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba194cb expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044372.002379:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784044373.005300:0:19100:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784044373.069861:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1870705581059072:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784044373.069938:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044373.070435:0:18710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581059072 00000100:00100000:1.0:1784044373.070443:0:18710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581059072 00000100:00100000:1.0:1784044373.070510:0:18710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1784044373.070519:0:18710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843ce4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1870705581059072:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1784044373.070550:0:18710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1784044373.070612:0:18710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843ce4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1870705581059072:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (673us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044373.070619:0:18710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1784044373.070664:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1870705581059072:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1784044373.071023:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1784044374.029508:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784044374.093484:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784044374.093507:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1870705581059200:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1784044374.093590:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044374.093784:0:18710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581059200 00000100:00100000:1.0:1784044374.093795:0:18710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581059200 00000100:00100000:1.0:1784044374.093887:0:18710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1784044374.093898:0:18710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39412e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1870705581059200:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1784044374.093921:0:18710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1784044374.093968:0:18710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39412e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1870705581059200:12345-0@lo:13:osp-pre-0-1.0 Request processed in 72us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044374.093975:0:18710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1784044374.094045:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1870705581059200:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1784044374.094162:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1784044375.054618:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1784044375.117466:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1784044375.117472:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1784044375.117476:0:37:0:(import.c:65:import_set_state_nolock()) ffff9b397b804800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1784044375.117490:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9b397b804800 using connection 192.168.202.140@tcp/0@lo 00000100:00100000:1.0:1784044375.117504:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784044375.117521:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b39412ebb80 x1870705581059840/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1784044375.117523:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39412ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1870705581059712:0@lo:400:kworker.0 00000100:00080000:0.0:1784044375.117554:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1784044375.117557:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1784044375.117559:0:37:0:(import.c:65:import_set_state_nolock()) ffff9b3944fd3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1784044375.117564:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9b3944fd3800 using connection 192.168.202.140@tcp/0@lo 00000100:00100000:0.0:1784044375.117575:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b39412e9880 x1870705581060352/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1784044375.117604:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044375.117620:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39412e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:99a46fb7-9af9-40f1-9c76-329d6781ee81:3640:1870705581059456:0@lo:400:kworker.0 00000100:00100000:1.0:1784044375.117653:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1870705581059328:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1784044375.117653:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044375.117677:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39412e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1870705581060096:0@lo:400:kworker.0 00000100:00100000:3.0:1784044375.118683:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39412e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3639:1870705581059968:0@lo:400:kworker.0 00000100:00100000:1.0:1784044375.124594:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044375.124673:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39412eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1870705581060480:0@lo:400:kworker.0 00000100:00100000:1.0:1784044375.124735:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044375.124760:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843cad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3638:1870705581060992:0@lo:400:kworker.0 00000100:00100000:1.0:1784044375.124784:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044375.124842:0:18933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581059712 00000100:00100000:1.0:1784044375.124851:0:18933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581059712 00000100:00100000:1.0:1784044375.124916:0:18933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1784044375.124926:0:18933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d4c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3638:x1870705581059712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044375.124985:0:18933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d4c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3638:x1870705581059712:12345-0@lo:400:kworker.0 Request processed in 60us (7379us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044375.124993:0:18933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1784044375.125018:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581060480 00000100:00100000:1.0:1784044375.125022:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581060480 00000100:00100000:1.0:1784044375.125045:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581060992 00000100:00100000:1.0:1784044375.125048:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581060992 00000100:00100000:1.0:1784044375.125070:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1784044375.125076:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1870705581060480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044375.125107:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1870705581060480:12345-0@lo:400:kworker.0 Request processed in 31us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044375.125114:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1784044375.125136:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1784044375.125142:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38436a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1870705581060992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044375.125172:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38436a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1870705581060992:12345-0@lo:400:kworker.0 Request processed in 30us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044375.125194:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:1.0:1784044375.125213:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1784044375.125218:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1784044375.125249:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b39412eb800 x1870705581060480/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044391 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784044375.125262:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39412eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1870705581060480:0@lo:400:kworker.0 00010000:00080000:1.0:1784044375.125274:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b3843cad880 x1870705581060992/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044391 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784044375.125562:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044375.125596:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39412eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1870705581060736:0@lo:400:kworker.0 00000100:00100000:0.0:1784044375.125621:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044375.125642:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1784044375.125655:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39412eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1870705581059584:0@lo:400:kworker.0 00000100:00100000:0.0:1784044375.125678:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044375.125690:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39412ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1870705581060224:0@lo:400:kworker.0 00000100:00100000:0.0:1784044375.125713:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044375.125730:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843cafb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3640:1870705581060864:0@lo:400:kworker.0 00000100:00100000:0.0:1784044375.125755:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044375.125787:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39412ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1870705581059840:0@lo:8:kworker.0 00000100:00100000:0.0:1784044375.125810:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044375.125828:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39412e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1870705581060352:0@lo:8:kworker.0 00000100:00100000:1.0:1784044375.127552:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843cad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3638:1870705581060992:0@lo:400:kworker.0 00000100:00100000:3.0:1784044375.127738:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581059328 00000100:00100000:3.0:1784044375.127747:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581059328 00000100:00100000:3.0:1784044375.127787:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581060096 00000100:00100000:3.0:1784044375.127794:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581060096 00000100:00100000:3.0:1784044375.127823:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581059584 00000100:00100000:3.0:1784044375.127826:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581059584 00000100:00100000:3.0:1784044375.127852:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1784044375.127861:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3638:x1870705581059328:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1784044375.127895:0:17206:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1784044375.127948:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39412ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1870705581059712:0@lo:400:kworker.0 00000100:00100000:1.0:1784044375.127989:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581060736 00000100:00100000:1.0:1784044375.127993:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581060736 00000100:00100000:1.0:1784044375.128033:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581060864 00000100:00100000:1.0:1784044375.128036:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581060864 00000100:00100000:1.0:1784044375.128054:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1784044375.128060:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843cac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1870705581060736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784044375.141797:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044375.141903:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581059456 00000100:00100000:0.0:1784044375.141913:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581059456 00000100:00100000:0.0:1784044375.141966:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1784044375.141975:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397d65e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99a46fb7-9af9-40f1-9c76-329d6781ee81+24:3640:x1870705581059456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784044375.142033:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397d65e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99a46fb7-9af9-40f1-9c76-329d6781ee81+24:3640:x1870705581059456:12345-0@lo:400:kworker.0 Request processed in 60us (24379us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044375.142042:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1784044375.142080:0:18706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581060224 00000100:00100000:0.0:1784044375.142084:0:18706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581060224 00000100:00100000:0.0:1784044375.142108:0:18706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581059840 00000100:00100000:0.0:1784044375.142112:0:18706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581059840 00000100:00100000:0.0:1784044375.142121:0:18706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581060352 00000100:00100000:0.0:1784044375.142123:0:18706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581060352 00000100:00100000:0.0:1784044375.142132:0:18706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1784044375.142139:0:18706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843caed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1870705581060224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784044375.142190:0:18706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843caed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1870705581060224:12345-0@lo:400:kworker.0 Request processed in 35us (16459us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044375.142215:0:18706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1784044375.142228:0:18706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1784044375.142232:0:18706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843cace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3637:x1870705581059840:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1784044375.142275:0:18706:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 568 last 0 00000020:00000080:0.0:1784044375.142308:0:18706:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x89871fc3aba194d2 00002000:00100000:0.0:1784044375.142324:0:18706:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9b3947bbc000 ocd_connect_flags: 0xa044401443000026 ocd_version: 21136a2 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1784044375.142328:0:18706:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:0.0:1784044375.142330:0:18706:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1784044375.142521:0:18706:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1784044375.142548:0:18706:0:(import.c:65:import_set_state_nolock()) ffff9b3947bbc800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1784044375.142592:0:18706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843cace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3637:x1870705581059840:12345-0@lo:8:kworker.0 Request processed in 358us (16781us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044375.142599:0:18706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1784044375.142612:0:18706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1784044375.142617:0:18706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843cad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3637:x1870705581060352:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1784044375.142632:0:18706:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 568 last 0 00000020:00000080:0.0:1784044375.142647:0:18706:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x89871fc3aba194d9 00002000:00100000:0.0:1784044375.142653:0:18706:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff9b3947bbe000 ocd_connect_flags: 0xa044401443000026 ocd_version: 21136a2 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:0.0:1784044375.142656:0:18706:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00002000:00100000:0.0:1784044375.142658:0:18706:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1784044375.142680:0:18706:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:0.0:1784044375.142692:0:18706:0:(import.c:65:import_set_state_nolock()) ffff9b3947bba800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1784044375.142719:0:18706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843cad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3637:x1870705581060352:12345-0@lo:8:kworker.0 Request processed in 101us (933us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044375.142726:0:18706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:0.0:1784044375.142783:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b39412ebb80 x1870705581059840/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1784044400 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1784044375.142802:0:3637:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1784044375.142810:0:3637:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1784044375.142816:0:3637:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1784044375.142818:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9b397b804800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1784044375.142848:0:3637:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1784044375.142854:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39412ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1870705581059840:0@lo:8:kworker.0 00010000:00080000:0.0:1784044375.142869:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b39412e9880 x1870705581060352/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1784044400 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1784044375.142878:0:3637:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 2 00000100:00080000:0.0:1784044375.142883:0:3637:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1784044375.142886:0:3637:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1784044375.142888:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9b3944fd3800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1784044375.142907:0:3637:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1784044375.142911:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39412e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1870705581060352:0@lo:8:kworker.0 00000004:00080000:0.0:1784044375.142956:0:17226:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1784044375.143022:0:17226:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 568313846866ns, next at 0ns, rc = 0 00080000:00080000:0.0:1784044375.143028:0:17226:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:0.0:1784044375.143084:0:17944:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:0.0:1784044375.143103:0:17944:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843cac380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17944:1870705581061248:0@lo:7:osp-pre-1-1.0 00000100:00100000:0.0:1784044375.143133:0:17944:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044375.143150:0:17944:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3947487600 going to sleep for 11 seconds 00000100:00100000:0.0:1784044375.143326:0:18706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581061248 00000100:00100000:0.0:1784044375.143331:0:18706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581061248 00000100:00100000:0.0:1784044375.143362:0:18706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1784044375.143369:0:18706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843cad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17944:x1870705581061248:12345-0@lo:7:osp-pre-1-1.0 00000100:00100000:0.0:1784044375.143870:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784044375.143883:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843caf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1870705581061120:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1784044375.144009:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044375.144051:0:18710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581061120 00000100:00100000:0.0:1784044375.144056:0:18710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581061120 00000100:00100000:0.0:1784044375.144084:0:18710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1784044375.144091:0:18710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3842706680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3638:x1870705581061120:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1784044375.144111:0:18710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1784044375.144150:0:18710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3842706680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3638:x1870705581061120:12345-0@lo:13:osp-pre-1-1.0 Request processed in 59us (159us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044375.144157:0:18710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:0.0:1784044375.144676:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b3843caf100 x1870705581061120/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784044391 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784044375.144698:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843caf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1870705581061120:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1784044375.144735:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39412ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1870705581060224:0@lo:400:kworker.0 00000100:00100000:0.0:1784044375.144749:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39412e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:99a46fb7-9af9-40f1-9c76-329d6781ee81:3640:1870705581059456:0@lo:400:kworker.0 00000100:00100000:3.0:1784044375.148695:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3638:x1870705581059328:12345-0@lo:41:osp-pre-1-0.0 Request processed in 20824us (24100us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044375.148724:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1784044375.148767:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1784044375.148780:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843caca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1870705581060096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044375.148856:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843caca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1870705581060096:12345-0@lo:400:kworker.0 Request processed in 81us (23294us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044375.148863:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1784044375.148876:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1784044375.148884:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843caf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1870705581059584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044375.148915:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843caf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1870705581059584:12345-0@lo:400:kworker.0 Request processed in 33us (23236us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044375.148921:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000004:00080000:3.0:1784044375.149001:0:17227:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x5:0x0] 00000100:00100000:3.0:1784044375.149022:0:17227:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843ce4700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17227:1870705581061632:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1784044375.149063:0:17227:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044375.149088:0:17227:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b396f2296c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784044375.149105:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843ce5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1870705581061504:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784044375.149128:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044375.149148:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1784044375.149153:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843ce5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1870705581061376:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1784044375.149223:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044375.149249:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581061376 00000100:00100000:3.0:1784044375.149256:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581061376 00000100:00100000:3.0:1784044375.149693:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1784044375.149704:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843c55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1870705581061376:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1784044375.149733:0:17205:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1784044375.149775:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843c55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1870705581061376:12345-0@lo:41:osp-pre-0-1.0 Request processed in 75us (552us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044375.149781:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1784044375.149825:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843ce5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1870705581061376:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1784044375.149871:0:18707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581061632 00000100:00100000:3.0:1784044375.149876:0:18707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581061632 00000100:00100000:3.0:1784044375.149902:0:18707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1784044375.149909:0:18707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843c55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:17227:x1870705581061632:12345-0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1784044375.149967:0:18710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581061504 00000100:00100000:3.0:1784044375.149971:0:18710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581061504 00000100:00100000:3.0:1784044375.149996:0:18710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1784044375.150002:0:18710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843c55180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3641:x1870705581061504:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1784044375.150016:0:18710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1784044375.150050:0:18710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843c55180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3641:x1870705581061504:12345-0@lo:13:osp-pre-1-0.0 Request processed in 48us (921us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044375.150056:0:18710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:3.0:1784044375.150085:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b3843ce5f80 x1870705581061504/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784044391 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784044375.150101:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843ce5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1870705581061504:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784044375.150139:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1870705581059328:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1784044375.150203:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39412eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1870705581059584:0@lo:400:kworker.0 00000100:00100000:3.0:1784044375.150214:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39412e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1870705581060096:0@lo:400:kworker.0 00000100:00100000:3.0:1784044375.150248:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044375.150266:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39412e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3639:1870705581060608:0@lo:400:kworker.0 00000100:00100000:3.0:1784044375.150565:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044375.151996:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581059968 00000100:00100000:3.0:1784044375.152006:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581059968 00000100:00100000:1.0:1784044375.152201:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843cac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1870705581060736:12345-0@lo:400:kworker.0 Request processed in 24135us (26573us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044375.160667:0:18572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1784044375.160751:0:18572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843caea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1870705581060864:12345-0@lo:400:kworker.0 00000004:00080000:0.0:1784044375.162325:0:17179:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:0.0:1784044375.163355:0:18572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843caea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1870705581060864:12345-0@lo:400:kworker.0 Request processed in 1749us (36673us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044375.165537:0:17200:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:3.0:1784044375.165556:0:17200:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00080000:3.0:1784044375.165673:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1784044375.165680:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1784044375.165683:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1784044375.165695:0:17199:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:3.0:1784044375.165706:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581060608 00000100:00100000:3.0:1784044375.165714:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581060608 00000100:00100000:3.0:1784044375.165759:0:17199:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:3.0:1784044375.165771:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1784044375.165781:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843c54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1870705581059968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044375.165911:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843c54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1870705581059968:12345-0@lo:400:kworker.0 Request processed in 131us (15661us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044375.165920:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1784044375.165936:0:17199:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:3.0:1784044375.165942:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1784044375.165948:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843c54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1870705581060608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044375.165977:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843c54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1870705581060608:12345-0@lo:400:kworker.0 Request processed in 30us (15412us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044375.165984:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:3.0:1784044375.166014:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1784044375.166512:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b39412e9f80 x1870705581059968/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044391 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784044375.166527:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39412e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3639:1870705581059968:0@lo:400:kworker.0 00010000:00080000:3.0:1784044375.166540:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b39412e8000 x1870705581060608/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044391 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784044375.166589:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39412e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3639:1870705581060608:0@lo:400:kworker.0 00000100:00100000:1.0:1784044375.166778:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000004:00080000:1.0:1784044375.166813:0:17943:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1784044375.166917:0:17943:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 568337741820ns, next at 0ns, rc = 0 00080000:00080000:1.0:1784044375.166924:0:17943:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0001: async commit OSD 00010000:00080000:1.0:1784044375.166992:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b3843cafb80 x1870705581060864/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044391 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784044375.167003:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843cafb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3640:1870705581060864:0@lo:400:kworker.0 00010000:00080000:1.0:1784044375.167017:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b39412eaa00 x1870705581060736/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044391 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784044375.167025:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39412eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1870705581060736:0@lo:400:kworker.0 00000004:00080000:3.0:1784044375.169492:0:17933:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00002000:00080000:1.0:1784044375.173519:0:18706:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:1.0:1784044375.173532:0:18706:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x21:0x0] 00000100:00100000:1.0:1784044375.173646:0:18706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843cad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17944:x1870705581061248:12345-0@lo:7:osp-pre-1-1.0 Request processed in 30272us (30505us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044375.173661:0:18706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:1.0:1784044375.174268:0:17944:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b3843cac380 x1870705581061248/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1784044391 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784044375.174598:0:17944:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843cac380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17944:1870705581061248:0@lo:7:osp-pre-1-1.0 00000004:00080000:1.0:1784044375.174616:0:17944:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x21:0x0] 00000100:00100000:1.0:1784044375.174666:0:17944:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b38436a1f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17944:1870705581061760:0@lo:5:osp-pre-1-1.0 00000100:00100000:1.0:1784044375.174715:0:17944:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044375.174741:0:17944:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3965ee7180 going to sleep for 11 seconds 00000100:00100000:3.0:1784044375.176640:0:18933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581061760 00000100:00100000:3.0:1784044375.176656:0:18933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581061760 00000100:00100000:3.0:1784044375.176728:0:18933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1784044375.176739:0:18933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39412eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17944:x1870705581061760:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:3.0:1784044375.176779:0:18933:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:3.0:1784044375.176876:0:18933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39412eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17944:x1870705581061760:12345-0@lo:5:osp-pre-1-1.0 Request processed in 138us (2159us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044375.176884:0:18933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:3.0:1784044375.176947:0:17944:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b38436a1f80 x1870705581061760/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1784044391 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784044375.176962:0:17944:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b38436a1f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17944:1870705581061760:0@lo:5:osp-pre-1-1.0 00000004:00080000:3.0:1784044375.176975:0:17944:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x21:0x0] from OST, last_created [0x2c0000400:0x21:0x0]last_used is [0x2c0000400:0x21:0x0] 00000100:00100000:3.0:1784044375.177011:0:17944:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843c55c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17944:1870705581061888:0@lo:5:osp-pre-1-1.0 00000100:00100000:3.0:1784044375.177042:0:17944:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044375.177062:0:17944:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b396f229a80 going to sleep for 11 seconds 00000100:00100000:3.0:1784044375.177077:0:18706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581061888 00000100:00100000:3.0:1784044375.177080:0:18706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581061888 00000100:00100000:3.0:1784044375.177113:0:18706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1784044375.177119:0:18706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843c54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17944:x1870705581061888:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:3.0:1784044375.177160:0:18706:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 34 00000100:00100000:0.0:1784044375.177972:0:18572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00002000:00080000:3.0:1784044375.178061:0:18707:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:3.0:1784044375.178068:0:18707:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:3.0:1784044375.178074:0:18707:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:6 to 0x2c0000401:33) 00002000:00010000:1.0:1784044375.201377:0:18707:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784044375.201406:0:18707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e981007e/0x89871fc3aba194e0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044375.201426:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=568s v=(0 0) 00010000:00010000:1.0:1784044375.201432:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784044375.201440:0:18707:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e981007e/0x89871fc3aba194e0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044375.201469:0:18707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e981007e/0x89871fc3aba194e0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044375.201481:0:18707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e981007e/0x89871fc3aba194e0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044375.201490:0:18707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e981007e/0x89871fc3aba194e0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044375.201514:0:18707:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784044375.201712:0:19100:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784044375.201721:0:19100:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e981007e/0x89871fc3aba194e0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044375.201739:0:19100:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b397cb18800 already unused, calling callback (ffffffffc0b56230) 00010000:00010000:0.0:1784044375.201746:0:19100:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e981007e/0x89871fc3aba194e0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044375.201757:0:19100:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e981007e/0x89871fc3aba194e0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044375.201777:0:19100:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e981007e/0x89871fc3aba194e0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044375.201785:0:19100:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e981007e/0x89871fc3aba194e0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044375.201807:0:19100:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784044375.201809:0:19100:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784044375.201811:0:19100:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1784044375.203715:0:18707:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784044375.203726:0:18707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000053671bb4/0x89871fc3aba194e7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044375.203743:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=568s v=(0 0) 00010000:00010000:0.0:1784044375.203748:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784044375.203755:0:18707:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000053671bb4/0x89871fc3aba194e7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044375.203771:0:18707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000053671bb4/0x89871fc3aba194e7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044375.203788:0:18707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000053671bb4/0x89871fc3aba194e7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044375.203795:0:18707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000053671bb4/0x89871fc3aba194e7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044375.203822:0:18707:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1784044375.206784:0:18707:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784044375.206798:0:18707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008362c6a2/0x89871fc3aba194ee lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044375.206816:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=568s v=(0 0) 00010000:00010000:0.0:1784044375.206821:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784044375.206828:0:18707:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008362c6a2/0x89871fc3aba194ee lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044375.206852:0:18707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008362c6a2/0x89871fc3aba194ee lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044375.206862:0:18707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008362c6a2/0x89871fc3aba194ee lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044375.206870:0:18707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008362c6a2/0x89871fc3aba194ee lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044375.206910:0:18707:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1784044375.206922:0:17188:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1784044375.206929:0:17188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000053671bb4/0x89871fc3aba194e7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044375.206937:0:17188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38410b6e00 already unused, calling callback (ffffffffc0b56230) 00010000:00010000:0.0:1784044375.206943:0:17188:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000053671bb4/0x89871fc3aba194e7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044375.206953:0:17188:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000053671bb4/0x89871fc3aba194e7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044375.206971:0:17188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000053671bb4/0x89871fc3aba194e7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044375.206979:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000053671bb4/0x89871fc3aba194e7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044375.206996:0:17188:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784044375.206999:0:17188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008362c6a2/0x89871fc3aba194ee lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044375.207005:0:17188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38410b6c00 already unused, calling callback (ffffffffc0b56230) 00010000:00010000:0.0:1784044375.207009:0:17188:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008362c6a2/0x89871fc3aba194ee lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044375.207027:0:17188:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008362c6a2/0x89871fc3aba194ee lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044375.207038:0:17188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008362c6a2/0x89871fc3aba194ee lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044375.207045:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008362c6a2/0x89871fc3aba194ee lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044375.207058:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784044375.207060:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784044375.207061:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1784044375.210573:0:18707:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784044375.210593:0:18707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004c2fbae0/0x89871fc3aba194f5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044375.210612:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=568s v=(0 0) 00010000:00010000:2.0:1784044375.210618:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784044375.210624:0:18707:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004c2fbae0/0x89871fc3aba194f5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044375.210643:0:18707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004c2fbae0/0x89871fc3aba194f5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044375.210653:0:18707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004c2fbae0/0x89871fc3aba194f5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044375.210671:0:18707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004c2fbae0/0x89871fc3aba194f5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044375.210695:0:18707:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784044375.212017:0:17187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784044375.212029:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004c2fbae0/0x89871fc3aba194f5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044375.212040:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3843798c00 already unused, calling callback (ffffffffc0b56230) 00010000:00010000:1.0:1784044375.212045:0:17187:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004c2fbae0/0x89871fc3aba194f5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044375.212054:0:17187:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004c2fbae0/0x89871fc3aba194f5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044375.212073:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004c2fbae0/0x89871fc3aba194f5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044375.212081:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004c2fbae0/0x89871fc3aba194f5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044375.212114:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784044375.212116:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784044375.212118:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784044375.212281:0:19100:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1784044375.214089:0:18707:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784044375.214101:0:18707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000095e25fff/0x89871fc3aba194fc lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044375.214120:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=568s v=(0 0) 00010000:00010000:0.0:1784044375.214136:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784044375.214145:0:18707:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000095e25fff/0x89871fc3aba194fc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044375.214161:0:18707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000095e25fff/0x89871fc3aba194fc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044375.214186:0:18707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000095e25fff/0x89871fc3aba194fc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044375.214313:0:18707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000095e25fff/0x89871fc3aba194fc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044375.214338:0:18707:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784044375.215278:0:17188:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784044375.215300:0:17188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000095e25fff/0x89871fc3aba194fc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044375.215312:0:17188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38410b6400 already unused, calling callback (ffffffffc0b56230) 00010000:00010000:1.0:1784044375.215317:0:17188:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000095e25fff/0x89871fc3aba194fc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044375.215330:0:17188:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000095e25fff/0x89871fc3aba194fc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044375.215350:0:17188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000095e25fff/0x89871fc3aba194fc lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044375.215358:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000095e25fff/0x89871fc3aba194fc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044375.215380:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784044375.215382:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784044375.215383:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1784044375.215631:0:18707:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784044375.215638:0:18707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000024f94990/0x89871fc3aba19503 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044375.215650:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=568s v=(0 0) 00010000:00010000:0.0:1784044375.215654:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784044375.215660:0:18707:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000024f94990/0x89871fc3aba19503 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044375.215672:0:18707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000024f94990/0x89871fc3aba19503 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044375.215681:0:18707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000024f94990/0x89871fc3aba19503 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044375.215690:0:18707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000024f94990/0x89871fc3aba19503 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044375.217231:0:18707:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784044375.220329:0:17187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784044375.220345:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000024f94990/0x89871fc3aba19503 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044375.220377:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38410b7a00 already unused, calling callback (ffffffffc0b56230) 00010000:00010000:1.0:1784044375.220383:0:17187:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000024f94990/0x89871fc3aba19503 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044375.220409:0:17187:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000024f94990/0x89871fc3aba19503 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044375.220430:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000024f94990/0x89871fc3aba19503 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044375.220438:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000024f94990/0x89871fc3aba19503 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044375.220464:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784044375.220466:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784044375.220468:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784044375.229396:0:18707:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784044375.229409:0:18707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000064306f5a/0x89871fc3aba1950a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044375.229428:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=568s v=(0 0) 00010000:00010000:1.0:1784044375.229433:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784044375.229441:0:18707:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000064306f5a/0x89871fc3aba1950a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044375.229455:0:18707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000064306f5a/0x89871fc3aba1950a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044375.229472:0:18707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000064306f5a/0x89871fc3aba1950a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044375.229481:0:18707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000064306f5a/0x89871fc3aba1950a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044375.229516:0:18707:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784044375.229673:0:19100:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784044375.229682:0:19100:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000064306f5a/0x89871fc3aba1950a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044375.229692:0:19100:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b397cb19200 already unused, calling callback (ffffffffc0b56230) 00010000:00010000:3.0:1784044375.229696:0:19100:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000064306f5a/0x89871fc3aba1950a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044375.229705:0:19100:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000064306f5a/0x89871fc3aba1950a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044375.229727:0:19100:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000064306f5a/0x89871fc3aba1950a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044375.229735:0:19100:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000064306f5a/0x89871fc3aba1950a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044375.229755:0:19100:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784044375.229757:0:19100:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784044375.229759:0:19100:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784044375.231516:0:18707:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784044375.231530:0:18707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cdf57e91/0x89871fc3aba19511 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044375.231548:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=568s v=(0 0) 00010000:00010000:1.0:1784044375.231554:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784044375.231561:0:18707:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cdf57e91/0x89871fc3aba19511 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044375.231575:0:18707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cdf57e91/0x89871fc3aba19511 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044375.231585:0:18707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cdf57e91/0x89871fc3aba19511 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044375.231593:0:18707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cdf57e91/0x89871fc3aba19511 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044375.231643:0:18707:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784044375.231755:0:17188:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784044375.231783:0:17188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cdf57e91/0x89871fc3aba19511 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044375.231793:0:17188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b397cb18e00 already unused, calling callback (ffffffffc0b56230) 00010000:00010000:3.0:1784044375.231798:0:17188:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cdf57e91/0x89871fc3aba19511 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044375.231823:0:17188:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cdf57e91/0x89871fc3aba19511 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044375.231850:0:17188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cdf57e91/0x89871fc3aba19511 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044375.231858:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cdf57e91/0x89871fc3aba19511 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044375.231878:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784044375.231880:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784044375.231883:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1784044375.233368:0:18707:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784044375.233378:0:18707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f7b9e822/0x89871fc3aba19518 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044375.233393:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=568s v=(0 0) 00010000:00010000:2.0:1784044375.233397:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784044375.233403:0:18707:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f7b9e822/0x89871fc3aba19518 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044375.233415:0:18707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f7b9e822/0x89871fc3aba19518 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044375.233424:0:18707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f7b9e822/0x89871fc3aba19518 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044375.233430:0:18707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f7b9e822/0x89871fc3aba19518 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044375.233446:0:18707:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784044375.233456:0:17187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784044375.233461:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f7b9e822/0x89871fc3aba19518 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044375.233476:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3843798e00 already unused, calling callback (ffffffffc0b56230) 00010000:00010000:2.0:1784044375.233480:0:17187:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f7b9e822/0x89871fc3aba19518 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044375.233488:0:17187:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f7b9e822/0x89871fc3aba19518 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044375.233502:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f7b9e822/0x89871fc3aba19518 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044375.233508:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f7b9e822/0x89871fc3aba19518 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044375.233524:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784044375.233526:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784044375.233528:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1784044375.233895:0:18707:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784044375.233902:0:18707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000083da212d/0x89871fc3aba1951f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044375.233921:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=568s v=(0 0) 00010000:00010000:2.0:1784044375.233924:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784044375.233928:0:18707:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000083da212d/0x89871fc3aba1951f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044375.233937:0:18707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000083da212d/0x89871fc3aba1951f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044375.233951:0:18707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000083da212d/0x89871fc3aba1951f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044375.234081:0:18707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000083da212d/0x89871fc3aba1951f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044375.234098:0:18707:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784044375.234106:0:19100:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784044375.234111:0:19100:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000083da212d/0x89871fc3aba1951f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044375.234118:0:19100:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3843799e00 already unused, calling callback (ffffffffc0b56230) 00010000:00010000:2.0:1784044375.234121:0:19100:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000083da212d/0x89871fc3aba1951f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044375.234129:0:19100:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000083da212d/0x89871fc3aba1951f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044375.234141:0:19100:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000083da212d/0x89871fc3aba1951f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044375.234149:0:19100:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000083da212d/0x89871fc3aba1951f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044375.234162:0:19100:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784044375.234170:0:19100:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784044375.234261:0:19100:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1784044375.234548:0:18707:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784044375.234554:0:18707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003c1ecb33/0x89871fc3aba19526 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044375.234563:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=568s v=(0 0) 00010000:00010000:2.0:1784044375.234623:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784044375.234631:0:18707:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003c1ecb33/0x89871fc3aba19526 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044375.234640:0:18707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003c1ecb33/0x89871fc3aba19526 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044375.234648:0:18707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003c1ecb33/0x89871fc3aba19526 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044375.234654:0:18707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003c1ecb33/0x89871fc3aba19526 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044375.234671:0:18707:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784044375.234680:0:17188:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784044375.234684:0:17188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003c1ecb33/0x89871fc3aba19526 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044375.234691:0:17188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3843799800 already unused, calling callback (ffffffffc0b56230) 00010000:00010000:2.0:1784044375.234695:0:17188:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003c1ecb33/0x89871fc3aba19526 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044375.234713:0:17188:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003c1ecb33/0x89871fc3aba19526 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044375.234725:0:17188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003c1ecb33/0x89871fc3aba19526 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044375.234732:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003c1ecb33/0x89871fc3aba19526 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044375.234746:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784044375.234748:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784044375.234750:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1784044375.236540:0:18707:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784044375.236552:0:18707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004c2fbae0/0x89871fc3aba1952d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044375.236621:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=568s v=(0 0) 00010000:00010000:2.0:1784044375.236627:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784044375.236634:0:18707:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004c2fbae0/0x89871fc3aba1952d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044375.236648:0:18707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004c2fbae0/0x89871fc3aba1952d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044375.236657:0:18707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004c2fbae0/0x89871fc3aba1952d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044375.236678:0:18707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004c2fbae0/0x89871fc3aba1952d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044375.236694:0:18707:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784044375.236704:0:17187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784044375.236710:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004c2fbae0/0x89871fc3aba1952d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044375.236717:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3843798c00 already unused, calling callback (ffffffffc0b56230) 00010000:00010000:2.0:1784044375.236721:0:17187:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004c2fbae0/0x89871fc3aba1952d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044375.236730:0:17187:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004c2fbae0/0x89871fc3aba1952d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044375.236744:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004c2fbae0/0x89871fc3aba1952d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044375.236752:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004c2fbae0/0x89871fc3aba1952d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044375.236769:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784044375.236770:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784044375.236772:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1784044375.242103:0:18707:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784044375.242126:0:18707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000da9ccad/0x89871fc3aba19534 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044375.242144:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=568s v=(0 0) 00010000:00010000:2.0:1784044375.242149:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784044375.242156:0:18707:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000da9ccad/0x89871fc3aba19534 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044375.242186:0:18707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000da9ccad/0x89871fc3aba19534 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044375.243297:0:18707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000da9ccad/0x89871fc3aba19534 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044375.243307:0:18707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000da9ccad/0x89871fc3aba19534 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044375.243336:0:18707:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784044375.243363:0:19100:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784044375.243373:0:19100:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000da9ccad/0x89871fc3aba19534 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044375.243391:0:19100:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3843799600 already unused, calling callback (ffffffffc0b56230) 00010000:00010000:0.0:1784044375.243396:0:19100:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000da9ccad/0x89871fc3aba19534 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044375.243477:0:19100:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000da9ccad/0x89871fc3aba19534 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044375.243499:0:19100:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000da9ccad/0x89871fc3aba19534 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044375.243507:0:19100:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000da9ccad/0x89871fc3aba19534 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044375.243531:0:19100:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784044375.243533:0:19100:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784044375.243535:0:19100:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1784044375.248629:0:19522:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:3.0:1784044375.248665:0:19522:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:3.0:1784044375.248670:0:19522:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1784044375.248953:0:18706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843c54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:17944:x1870705581061888:12345-0@lo:5:osp-pre-1-1.0 Request processed in 71827us (71904us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1784044375.248966:0:18706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00002000:00010000:2.0:1784044375.249037:0:18707:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784044375.249051:0:18707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a8ed0f0e/0x89871fc3aba1953b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044375.249070:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=568s v=(0 0) 00010000:00010000:2.0:1784044375.249075:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784044375.249082:0:18707:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a8ed0f0e/0x89871fc3aba1953b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044375.249097:0:18707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a8ed0f0e/0x89871fc3aba1953b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044375.249116:0:18707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a8ed0f0e/0x89871fc3aba1953b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044375.249124:0:18707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a8ed0f0e/0x89871fc3aba1953b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044375.249151:0:18707:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1784044375.249687:0:18707:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784044375.249694:0:18707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002ca132ce/0x89871fc3aba19542 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044375.249705:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=568s v=(0 0) 00010000:00010000:2.0:1784044375.249709:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784044375.249714:0:18707:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002ca132ce/0x89871fc3aba19542 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044375.249724:0:18707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002ca132ce/0x89871fc3aba19542 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044375.249731:0:18707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002ca132ce/0x89871fc3aba19542 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044375.249738:0:18707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002ca132ce/0x89871fc3aba19542 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044375.249764:0:18707:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1784044375.249776:0:17187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1784044375.249781:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a8ed0f0e/0x89871fc3aba1953b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044375.249790:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3843798000 already unused, calling callback (ffffffffc0b56230) 00010000:00010000:2.0:1784044375.249794:0:17187:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a8ed0f0e/0x89871fc3aba1953b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044375.249803:0:17187:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a8ed0f0e/0x89871fc3aba1953b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044375.249820:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a8ed0f0e/0x89871fc3aba1953b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044375.249840:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a8ed0f0e/0x89871fc3aba1953b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044375.249859:0:17187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784044375.249863:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002ca132ce/0x89871fc3aba19542 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044375.249870:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3843798800 already unused, calling callback (ffffffffc0b56230) 00010000:00010000:2.0:1784044375.249873:0:17187:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002ca132ce/0x89871fc3aba19542 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044375.249892:0:17187:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002ca132ce/0x89871fc3aba19542 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044375.249970:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002ca132ce/0x89871fc3aba19542 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044375.249979:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002ca132ce/0x89871fc3aba19542 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044375.249992:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784044375.249994:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784044375.249995:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784044375.250297:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1784044375.250315:0:18707:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784044375.250322:0:18707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a9f3b4d4/0x89871fc3aba19549 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044375.250331:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=568s v=(0 0) 00010000:00010000:2.0:1784044375.250335:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784044375.250339:0:18707:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a9f3b4d4/0x89871fc3aba19549 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044375.250349:0:18707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a9f3b4d4/0x89871fc3aba19549 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044375.250357:0:18707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a9f3b4d4/0x89871fc3aba19549 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044375.250371:0:18707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a9f3b4d4/0x89871fc3aba19549 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044375.250391:0:18707:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784044375.250432:0:19100:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784044375.250439:0:19100:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a9f3b4d4/0x89871fc3aba19549 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044375.250449:0:19100:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3843798600 already unused, calling callback (ffffffffc0b56230) 00010000:00010000:0.0:1784044375.250453:0:19100:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a9f3b4d4/0x89871fc3aba19549 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044375.250470:0:19100:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a9f3b4d4/0x89871fc3aba19549 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044375.250483:0:19100:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a9f3b4d4/0x89871fc3aba19549 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044375.250489:0:19100:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a9f3b4d4/0x89871fc3aba19549 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044375.250504:0:19100:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784044375.250506:0:19100:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784044375.250508:0:19100:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784044375.252049:0:17944:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 2 00000100:00100000:3.0:1784044375.252067:0:17944:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843c55c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17944:1870705581061888:0@lo:5:osp-pre-1-1.0 00000004:00080000:3.0:1784044375.252084:0:17944:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x21:0x0]-[0x2c0000400:0x41:0x0] 00002000:00010000:2.0:1784044375.252130:0:18707:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784044375.252139:0:18707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000017dbd489/0x89871fc3aba19550 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044375.252143:0:17944:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843c55c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17944:1870705581062016:0@lo:900:osp-pre-1-1.0 00010000:00010000:2.0:1784044375.252159:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=568s v=(0 0) 00010000:00010000:2.0:1784044375.252164:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784044375.252171:0:18707:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000017dbd489/0x89871fc3aba19550 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044375.252352:0:17944:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044375.252392:0:17944:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b396f229a80 going to sleep for 11 seconds 00000100:00100000:0.0:1784044375.252517:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581062016 00000100:00100000:0.0:1784044375.252525:0:17212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581062016 00000100:00100000:0.0:1784044375.252575:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00010000:00010000:2.0:1784044375.252583:0:18707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000017dbd489/0x89871fc3aba19550 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044375.252588:0:17212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843c54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17944:x1870705581062016:12345-0@lo:900:osp-pre-1-1.0 00010000:00010000:2.0:1784044375.252603:0:18707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000017dbd489/0x89871fc3aba19550 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044375.252611:0:18707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000017dbd489/0x89871fc3aba19550 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044375.252631:0:18707:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784044375.252644:0:17187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784044375.252649:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000017dbd489/0x89871fc3aba19550 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044375.252666:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b39586ee000 already unused, calling callback (ffffffffc0b56230) 00010000:00010000:2.0:1784044375.252669:0:17187:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000017dbd489/0x89871fc3aba19550 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044375.252677:0:17187:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000017dbd489/0x89871fc3aba19550 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044375.252690:0:17212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843c54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17944:x1870705581062016:12345-0@lo:900:osp-pre-1-1.0 Request processed in 104us (337us total) trans 0 rc 0/0 00010000:00010000:2.0:1784044375.252693:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000017dbd489/0x89871fc3aba19550 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044375.252701:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:2.0:1784044375.252707:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000017dbd489/0x89871fc3aba19550 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044375.252730:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784044375.252732:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784044375.252734:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1784044375.253755:0:18707:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784044375.253763:0:18707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000065436175/0x89871fc3aba19557 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044375.253776:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=568s v=(0 0) 00010000:00010000:2.0:1784044375.253781:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784044375.253787:0:18707:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000065436175/0x89871fc3aba19557 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044375.253797:0:18707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000065436175/0x89871fc3aba19557 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044375.253813:0:18707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000065436175/0x89871fc3aba19557 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044375.253820:0:18707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000065436175/0x89871fc3aba19557 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044375.253843:0:18707:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784044375.253933:0:17188:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784044375.253941:0:17188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000065436175/0x89871fc3aba19557 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044375.253951:0:17188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b39586efc00 already unused, calling callback (ffffffffc0b56230) 00010000:00010000:0.0:1784044375.253955:0:17188:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000065436175/0x89871fc3aba19557 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044375.253970:0:17188:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000065436175/0x89871fc3aba19557 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044375.253982:0:17188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000065436175/0x89871fc3aba19557 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044375.253989:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000065436175/0x89871fc3aba19557 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044375.254005:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784044375.254007:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784044375.254009:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00080000:3.0:1784044375.254207:0:17944:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b3843c55c00 x1870705581062016/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1784044391 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784044375.254224:0:17944:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843c55c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17944:1870705581062016:0@lo:900:osp-pre-1-1.0 00002000:00010000:0.0:1784044375.255388:0:18707:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784044375.255398:0:18707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008362c6a2/0x89871fc3aba1955e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044375.255425:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=568s v=(0 0) 00010000:00010000:0.0:1784044375.255430:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784044375.255437:0:18707:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008362c6a2/0x89871fc3aba1955e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044375.255462:0:18707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008362c6a2/0x89871fc3aba1955e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044375.255477:0:18707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008362c6a2/0x89871fc3aba1955e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044375.255493:0:18707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008362c6a2/0x89871fc3aba1955e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044375.255522:0:18707:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784044375.255650:0:19100:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784044375.255660:0:19100:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008362c6a2/0x89871fc3aba1955e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044375.255669:0:19100:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38410b6c00 already unused, calling callback (ffffffffc0b56230) 00010000:00010000:2.0:1784044375.255674:0:19100:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008362c6a2/0x89871fc3aba1955e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044375.255683:0:19100:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008362c6a2/0x89871fc3aba1955e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044375.255698:0:19100:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008362c6a2/0x89871fc3aba1955e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044375.255705:0:19100:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008362c6a2/0x89871fc3aba1955e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044375.255721:0:19100:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784044375.255728:0:19100:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784044375.255730:0:19100:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1784044375.256117:0:18707:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784044375.256123:0:18707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b72ce537/0x89871fc3aba19565 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044375.256132:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=568s v=(0 0) 00010000:00010000:2.0:1784044375.256136:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784044375.256141:0:18707:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b72ce537/0x89871fc3aba19565 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044375.256151:0:18707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b72ce537/0x89871fc3aba19565 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044375.256159:0:18707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b72ce537/0x89871fc3aba19565 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044375.256166:0:18707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b72ce537/0x89871fc3aba19565 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044375.257248:0:18707:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784044375.257465:0:17187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784044375.257474:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b72ce537/0x89871fc3aba19565 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044375.257485:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b39586ee600 already unused, calling callback (ffffffffc0b56230) 00010000:00010000:2.0:1784044375.257489:0:17187:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b72ce537/0x89871fc3aba19565 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044375.257512:0:17187:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b72ce537/0x89871fc3aba19565 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044375.257529:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b72ce537/0x89871fc3aba19565 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044375.257537:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b72ce537/0x89871fc3aba19565 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044375.257556:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784044375.257558:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784044375.257560:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1784044375.257879:0:18707:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784044375.257888:0:18707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000053671bb4/0x89871fc3aba1956c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044375.257901:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=568s v=(0 0) 00010000:00010000:0.0:1784044375.257905:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784044375.257912:0:18707:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000053671bb4/0x89871fc3aba1956c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044375.257924:0:18707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000053671bb4/0x89871fc3aba1956c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044375.257932:0:18707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000053671bb4/0x89871fc3aba1956c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044375.257939:0:18707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000053671bb4/0x89871fc3aba1956c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044375.257966:0:18707:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784044375.258030:0:17188:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784044375.258036:0:17188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000053671bb4/0x89871fc3aba1956c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044375.258045:0:17188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38410b6e00 already unused, calling callback (ffffffffc0b56230) 00010000:00010000:2.0:1784044375.258048:0:17188:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000053671bb4/0x89871fc3aba1956c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044375.258056:0:17188:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000053671bb4/0x89871fc3aba1956c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044375.258067:0:17188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000053671bb4/0x89871fc3aba1956c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044375.258086:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000053671bb4/0x89871fc3aba1956c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044375.258100:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784044375.258101:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784044375.258103:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1784044375.258397:0:18707:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784044375.258484:0:18707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a21e3764/0x89871fc3aba19573 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044375.258494:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=568s v=(0 0) 00010000:00010000:0.0:1784044375.258498:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784044375.258503:0:18707:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a21e3764/0x89871fc3aba19573 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044375.258513:0:18707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a21e3764/0x89871fc3aba19573 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044375.258521:0:18707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a21e3764/0x89871fc3aba19573 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044375.258528:0:18707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a21e3764/0x89871fc3aba19573 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044375.258547:0:18707:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784044375.258802:0:19100:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784044375.258808:0:19100:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a21e3764/0x89871fc3aba19573 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044375.258815:0:19100:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38410b7c00 already unused, calling callback (ffffffffc0b56230) 00010000:00010000:2.0:1784044375.258818:0:19100:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a21e3764/0x89871fc3aba19573 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044375.258826:0:19100:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a21e3764/0x89871fc3aba19573 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044375.258849:0:19100:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a21e3764/0x89871fc3aba19573 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044375.258855:0:19100:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a21e3764/0x89871fc3aba19573 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044375.258868:0:19100:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784044375.258870:0:19100:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784044375.258871:0:19100:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1784044375.259548:0:18707:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784044375.259556:0:18707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000024f94990/0x89871fc3aba1957a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044375.259567:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=568s v=(0 0) 00010000:00010000:0.0:1784044375.259580:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784044375.259586:0:18707:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000024f94990/0x89871fc3aba1957a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044375.259598:0:18707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000024f94990/0x89871fc3aba1957a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044375.259613:0:18707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000024f94990/0x89871fc3aba1957a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044375.259622:0:18707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000024f94990/0x89871fc3aba1957a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044375.259644:0:18707:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784044375.259699:0:17187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784044375.259705:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000024f94990/0x89871fc3aba1957a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044375.259713:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38410b7a00 already unused, calling callback (ffffffffc0b56230) 00010000:00010000:2.0:1784044375.259717:0:17187:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000024f94990/0x89871fc3aba1957a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044375.259726:0:17187:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000024f94990/0x89871fc3aba1957a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044375.259739:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000024f94990/0x89871fc3aba1957a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044375.259746:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000024f94990/0x89871fc3aba1957a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044375.259760:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784044375.259762:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784044375.259764:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1784044375.261440:0:18707:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784044375.261453:0:18707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000095e25fff/0x89871fc3aba19581 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044375.261471:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=568s v=(0 0) 00010000:00010000:0.0:1784044375.261475:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784044375.261482:0:18707:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000095e25fff/0x89871fc3aba19581 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044375.261493:0:18707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000095e25fff/0x89871fc3aba19581 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044375.261503:0:18707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000095e25fff/0x89871fc3aba19581 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044375.261510:0:18707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000095e25fff/0x89871fc3aba19581 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044375.261542:0:18707:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1784044375.262364:0:18707:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784044375.262372:0:18707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000162fcd51/0x89871fc3aba19588 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044375.262384:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=568s v=(0 0) 00010000:00010000:0.0:1784044375.262388:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784044375.262393:0:18707:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000162fcd51/0x89871fc3aba19588 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044375.262473:0:18707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000162fcd51/0x89871fc3aba19588 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044375.262483:0:18707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000162fcd51/0x89871fc3aba19588 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044375.262491:0:18707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000162fcd51/0x89871fc3aba19588 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044375.262566:0:18707:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1784044375.263845:0:18707:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784044375.263859:0:18707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009efb7f3c/0x89871fc3aba1958f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044375.263876:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=568s v=(0 0) 00010000:00010000:0.0:1784044375.263892:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784044375.263900:0:18707:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009efb7f3c/0x89871fc3aba1958f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044375.263915:0:18707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009efb7f3c/0x89871fc3aba1958f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044375.263924:0:18707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009efb7f3c/0x89871fc3aba1958f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044375.263932:0:18707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009efb7f3c/0x89871fc3aba1958f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044375.264302:0:19100:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1784044375.264302:0:17188:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1784044375.264314:0:19100:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000162fcd51/0x89871fc3aba19588 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044375.264315:0:17188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000095e25fff/0x89871fc3aba19581 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044375.264334:0:19100:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38410b7e00 already unused, calling callback (ffffffffc0b56230) 00010000:00010000:2.0:1784044375.264337:0:17188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38410b6400 already unused, calling callback (ffffffffc0b56230) 00010000:00010000:3.0:1784044375.264340:0:19100:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000162fcd51/0x89871fc3aba19588 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044375.264342:0:17188:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000095e25fff/0x89871fc3aba19581 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044375.264359:0:19100:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000162fcd51/0x89871fc3aba19588 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044375.264380:0:17188:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000095e25fff/0x89871fc3aba19581 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044375.264386:0:19100:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000162fcd51/0x89871fc3aba19588 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044375.264394:0:17188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000095e25fff/0x89871fc3aba19581 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044375.264397:0:19100:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000162fcd51/0x89871fc3aba19588 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044375.264408:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000095e25fff/0x89871fc3aba19581 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044375.264428:0:17188:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784044375.264431:0:17188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009efb7f3c/0x89871fc3aba1958f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044375.264437:0:17188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38410b7800 already unused, calling callback (ffffffffc0b56230) 00010000:00010000:2.0:1784044375.264439:0:17188:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009efb7f3c/0x89871fc3aba1958f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044375.264447:0:17188:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009efb7f3c/0x89871fc3aba1958f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044375.264456:0:17188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009efb7f3c/0x89871fc3aba1958f lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044375.264464:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784044375.264465:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784044375.264473:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784044375.267151:0:19100:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784044375.267155:0:19100:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784044375.267158:0:19100:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784044375.267743:0:18707:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1784044375.267744:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784044375.267755:0:18707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009efb7f3c/0x89871fc3aba1958f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784044375.268646:0:18707:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784044375.268657:0:18707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000053671bb4/0x89871fc3aba19596 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044375.268674:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=568s v=(0 0) 00010000:00010000:0.0:1784044375.268679:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784044375.268685:0:18707:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000053671bb4/0x89871fc3aba19596 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044375.268700:0:18707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000053671bb4/0x89871fc3aba19596 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044375.268715:0:18707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000053671bb4/0x89871fc3aba19596 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044375.268724:0:18707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000053671bb4/0x89871fc3aba19596 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044375.268748:0:18707:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784044375.268782:0:17188:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784044375.268792:0:17188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000053671bb4/0x89871fc3aba19596 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044375.268802:0:17188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38410b6e00 already unused, calling callback (ffffffffc0b56230) 00010000:00010000:2.0:1784044375.268810:0:17188:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000053671bb4/0x89871fc3aba19596 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044375.268821:0:17188:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000053671bb4/0x89871fc3aba19596 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044375.268850:0:17188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000053671bb4/0x89871fc3aba19596 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044375.268859:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000053671bb4/0x89871fc3aba19596 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044375.268874:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784044375.268876:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784044375.268878:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1784044375.269040:0:18707:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784044375.269046:0:18707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008362c6a2/0x89871fc3aba1959d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044375.269055:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=568s v=(0 0) 00010000:00010000:0.0:1784044375.269058:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784044375.269062:0:18707:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008362c6a2/0x89871fc3aba1959d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044375.269071:0:18707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008362c6a2/0x89871fc3aba1959d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044375.269079:0:18707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008362c6a2/0x89871fc3aba1959d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044375.269086:0:18707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008362c6a2/0x89871fc3aba1959d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044375.269151:0:18707:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:0.0:1784044375.269214:0:18707:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:5 00000100:00100000:0.0:1784044375.269320:0:18707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843c55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:17227:x1870705581061632:12345-0@lo:5:osp-pre-1-0.0 Request processed in 119407us (120253us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044375.269331:0:18707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1784044375.269507:0:17227:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843ce4700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17227:1870705581061632:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1784044375.269522:0:17227:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x21:0x0] from OST, last_created [0x2c0000401:0x21:0x0]last_used is [0x2c0000401:0x5:0x0] 00000100:00100000:2.0:1784044375.269569:0:17227:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39759b4700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17227:1870705581062144:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1784044375.269609:0:17227:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044375.269651:0:17227:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3975850cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1784044375.271327:0:18933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581062144 00000100:00100000:0.0:1784044375.271338:0:18933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581062144 00000100:00100000:0.0:1784044375.271400:0:18933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1784044375.271420:0:18933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39759b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:17227:x1870705581062144:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:0.0:1784044375.271464:0:18933:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 34 00010000:00010000:3.0:1784044375.272509:0:19100:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784044375.272527:0:19100:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008362c6a2/0x89871fc3aba1959d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044375.272542:0:19100:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38410b6c00 already unused, calling callback (ffffffffc0b56230) 00010000:00010000:3.0:1784044375.272547:0:19100:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008362c6a2/0x89871fc3aba1959d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044375.272557:0:19100:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008362c6a2/0x89871fc3aba1959d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044375.272580:0:19100:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008362c6a2/0x89871fc3aba1959d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044375.272589:0:19100:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008362c6a2/0x89871fc3aba1959d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044375.272612:0:19100:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784044375.272614:0:19100:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784044375.272616:0:19100:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784044375.278550:0:18933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39759b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:17227:x1870705581062144:12345-0@lo:5:osp-pre-1-0.0 Request processed in 7122us (8933us total) trans 8589934594 rc 0/0 00000100:00100000:3.0:1784044375.278564:0:18933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1784044375.282069:0:17227:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39759b4700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17227:1870705581062144:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1784044375.282098:0:17227:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x21:0x0]-[0x2c0000401:0x41:0x0] 00000040:00080000:0.0:1784044375.447313:0:17236:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1784044376.078652:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784044377.101290:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1784044377.752826:0:19879:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg240-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1784044378.130668:0:19100:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784044378.191041:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843c55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1870705581062272:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784044378.191113:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044378.191170:0:18710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581062272 00000100:00100000:3.0:1784044378.191207:0:18710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581062272 00000100:00100000:3.0:1784044378.191282:0:18710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1784044378.191292:0:18710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843c55f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1870705581062272:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1784044378.191322:0:18710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1784044378.191364:0:18710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843c55f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1870705581062272:12345-0@lo:13:osp-pre-0-0.0 Request processed in 73us (251us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044378.191371:0:18710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:3.0:1784044378.191390:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784044378.191428:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843c55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1870705581062272:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1784044379.165535:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1784044379.194914:0:19931:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1784044379.195168:0:19931:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1784044379.214609:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843c55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1870705581062400:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1784044379.214689:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044379.214816:0:18710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581062400 00000100:00100000:3.0:1784044379.214825:0:18710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581062400 00000100:00100000:3.0:1784044379.214889:0:18710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1784044379.214900:0:18710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39759b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1870705581062400:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1784044379.214922:0:18710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1784044379.214966:0:18710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39759b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1870705581062400:12345-0@lo:13:osp-pre-0-1.0 Request processed in 67us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044379.214973:0:18710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:2.0:1784044379.215037:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784044379.215075:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843c55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1870705581062400:0@lo:13:osp-pre-0-1.0 00000040:00080000:2.0:1784044380.111488:0:17952:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1784044380.176050:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1784044380.204836:0:19981:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1784044380.205075:0:19981:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1784044380.238595:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843c56680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1870705581062528:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1784044380.238694:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044380.238772:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784044380.238779:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843c57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1870705581062656:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1784044380.238816:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044380.238864:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581062528 00000100:00100000:3.0:1784044380.238873:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581062528 00000100:00100000:3.0:1784044380.238920:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581062656 00000100:00100000:3.0:1784044380.238923:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581062656 00000100:00100000:3.0:1784044380.238939:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1784044380.238948:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843c56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1870705581062528:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1784044380.239009:0:17205:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1784044380.239067:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843c56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1870705581062528:12345-0@lo:41:osp-pre-1-0.0 Request processed in 119us (373us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044380.239075:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1784044380.239094:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1784044380.239100:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843c56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1870705581062656:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1784044380.239117:0:17205:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1784044380.239143:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843c56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1870705581062656:12345-0@lo:41:osp-pre-0-1.0 Request processed in 44us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044380.239149:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1784044380.239226:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843c57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1870705581062656:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1784044380.239237:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843c56680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1870705581062528:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1784044380.240666:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3842707800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1870705581062784:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784044380.240732:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044380.240809:0:18710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581062784 00000100:00100000:0.0:1784044380.240816:0:18710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581062784 00000100:00100000:0.0:1784044380.240883:0:18710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1784044380.240893:0:18710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3842707b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3638:x1870705581062784:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1784044380.240923:0:18710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1784044380.240968:0:18710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3842707b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3638:x1870705581062784:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044380.240975:0:18710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:0.0:1784044380.240997:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784044380.241039:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3842707800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1870705581062784:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784044380.242343:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39759b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1870705581063040:0@lo:400:kworker.0 00000100:00100000:2.0:1784044380.242416:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044380.242457:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843e3b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1870705581063552:0@lo:400:kworker.0 00000100:00100000:2.0:1784044380.242494:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044380.242523:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843e38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3640:1870705581064064:0@lo:400:kworker.0 00000100:00100000:0.0:1784044380.242579:0:18706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581063040 00000100:00100000:0.0:1784044380.242599:0:18706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581063040 00000100:00100000:0.0:1784044380.242666:0:18706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1784044380.242676:0:18706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843e3a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1870705581063040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784044380.242751:0:18706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843e3a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1870705581063040:12345-0@lo:400:kworker.0 Request processed in 75us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044380.242764:0:18706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1784044380.242765:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1784044380.242815:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784044380.242837:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843e3b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1870705581063296:0@lo:400:kworker.0 00000100:00100000:2.0:1784044380.242855:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39759b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1870705581063040:0@lo:400:kworker.0 00000100:00100000:2.0:1784044380.242885:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1784044380.242896:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044380.242904:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843e38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1870705581063168:0@lo:400:kworker.0 00000100:00100000:0.0:1784044380.242938:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843e38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1870705581063808:0@lo:400:kworker.0 00000100:00100000:2.0:1784044380.242948:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044380.242980:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044380.242988:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843e39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3640:1870705581063680:0@lo:400:kworker.0 00000100:00100000:0.0:1784044380.243033:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1784044380.243035:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044380.243050:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39759b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:99a46fb7-9af9-40f1-9c76-329d6781ee81:3638:1870705581062912:0@lo:400:kworker.0 00000100:00100000:2.0:1784044380.243069:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843c56680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1870705581064192:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1784044380.243097:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044380.243150:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843e3ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1870705581063424:0@lo:400:kworker.0 00000100:00100000:1.0:1784044380.243267:0:19739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581063552 00000100:00100000:1.0:1784044380.243274:0:19739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581063552 00000100:00100000:1.0:1784044380.243304:0:19739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581064064 00000100:00100000:1.0:1784044380.243308:0:19739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581064064 00000100:00100000:1.0:1784044380.243338:0:19739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581063168 00000100:00100000:1.0:1784044380.243343:0:19739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581063168 00000100:00100000:1.0:1784044380.243363:0:19739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581063808 00000100:00100000:1.0:1784044380.243366:0:19739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581063808 00000100:00100000:1.0:1784044380.243393:0:19739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581063680 00000100:00100000:1.0:1784044380.243396:0:19739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581063680 00000100:00100000:1.0:1784044380.243420:0:19739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1784044380.243427:0:19739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843e39180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1870705581063552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784044380.243596:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044380.243684:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044380.243805:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1784044380.243817:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843e38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1870705581064064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784044380.243826:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1784044380.243842:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843e38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1870705581063168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044380.243874:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843e38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1870705581064064:12345-0@lo:400:kworker.0 Request processed in 58us (1120us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044380.243883:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1784044380.243914:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1784044380.243924:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843e38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1870705581063168:12345-0@lo:400:kworker.0 Request processed in 85us (973us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044380.243926:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3842706300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1870705581063808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784044380.243946:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1784044380.243983:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3842706300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1870705581063808:12345-0@lo:400:kworker.0 Request processed in 60us (1002us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044380.243988:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1784044380.244002:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1784044380.244009:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843e39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1870705581063680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784044380.244064:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843e39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1870705581063680:12345-0@lo:400:kworker.0 Request processed in 63us (1031us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044380.244071:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1784044380.244119:0:19739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843e39180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1870705581063552:12345-0@lo:400:kworker.0 Request processed in 686us (1619us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044380.244128:0:19739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1784044380.244612:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843e39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3638:1870705581063936:0@lo:400:kworker.0 00000100:00100000:0.0:1784044380.244646:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1784044380.244684:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b3843e38380 x1870705581063808/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044396 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784044380.244703:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843e38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1870705581063808:0@lo:400:kworker.0 00000100:00100000:2.0:1784044380.244721:0:18708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581063296 00000100:00100000:2.0:1784044380.244731:0:18708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581063296 00000100:00100000:0.0:1784044380.244747:0:18572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581063936 00000100:00100000:0.0:1784044380.244752:0:18572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581063936 00000100:00100000:0.0:1784044380.244807:0:18572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1784044380.244814:0:18572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3842705180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1870705581063936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784044380.244869:0:18708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581063424 00000100:00100000:2.0:1784044380.244877:0:18708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581063424 00000100:00100000:0.0:1784044380.244883:0:18572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3842705180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1870705581063936:12345-0@lo:400:kworker.0 Request processed in 65us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044380.244893:0:18572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1784044380.244930:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581062912 00000100:00100000:0.0:1784044380.244935:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581062912 00000100:00100000:2.0:1784044380.244936:0:18708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1784044380.244960:0:18708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3842707800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1870705581063296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784044380.244988:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1784044380.245000:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397d65d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99a46fb7-9af9-40f1-9c76-329d6781ee81+24:3638:x1870705581062912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784044380.245041:0:18708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3842707800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1870705581063296:12345-0@lo:400:kworker.0 Request processed in 88us (2151us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044380.245053:0:18708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1784044380.245062:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397d65d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99a46fb7-9af9-40f1-9c76-329d6781ee81+24:3638:x1870705581062912:12345-0@lo:400:kworker.0 Request processed in 63us (1963us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044380.245070:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1784044380.245081:0:18708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1784044380.245093:0:18708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3842707480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1870705581063424:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1784044380.245115:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784044380.245123:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1784044380.245128:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1784044380.245147:0:18710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581064192 00000100:00100000:2.0:1784044380.245149:0:18708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3842707480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1870705581063424:12345-0@lo:400:kworker.0 Request processed in 58us (1551us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044380.245154:0:18710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581064192 00000100:00100000:2.0:1784044380.245165:0:18708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1784044380.245208:0:18710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1784044380.245218:0:18710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843e3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3640:x1870705581064192:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1784044380.245237:0:18710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1784044380.245287:0:18710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843e3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1870705581064192:12345-0@lo:13:osp-pre-1-1.0 Request processed in 69us (1603us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044380.245297:0:18710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1784044380.245376:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39759b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:99a46fb7-9af9-40f1-9c76-329d6781ee81:3638:1870705581062912:0@lo:400:kworker.0 00010000:00080000:2.0:1784044380.245382:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b3843e38700 x1870705581063168/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044396 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784044380.245397:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843e3ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1870705581063424:0@lo:400:kworker.0 00010000:00080000:0.0:1784044380.245419:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b3843e39c00 x1870705581063936/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044396 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784044380.245424:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843e38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1870705581063168:0@lo:400:kworker.0 00000100:00100000:0.0:1784044380.245449:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843e39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3638:1870705581063936:0@lo:400:kworker.0 00010000:00080000:2.0:1784044380.245465:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b3843e39500 x1870705581063680/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044396 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784044380.245478:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843e39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3640:1870705581063680:0@lo:400:kworker.0 00000100:00100000:0.0:1784044380.245489:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843e3b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1870705581063296:0@lo:400:kworker.0 00000100:00100000:2.0:1784044380.245516:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843c56680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1870705581064192:0@lo:13:osp-pre-1-1.0 00010000:00080000:2.0:1784044380.245539:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b3843e3b480 x1870705581063552/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044396 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784044380.245680:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843e3b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1870705581063552:0@lo:400:kworker.0 00010000:00080000:2.0:1784044380.245697:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b3843e38e00 x1870705581064064/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044396 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784044380.245707:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843e38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3640:1870705581064064:0@lo:400:kworker.0 00000100:00100000:3.0:1784044380.400997:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1784044380.401092:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565227136 00000100:00100000:1.0:1784044380.401106:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565227136 00000100:00100000:1.0:1784044380.401221:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 121 00000100:00100000:1.0:1784044380.401233:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397d65f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2406:x1870705565227136:12345-192.168.202.40@tcp:250:mount.lustre.0 00010000:00080000:1.0:1784044380.401278:0:17194:0:(ldlm_lib.c:1445:target_handle_connect()) MGS: connection from cf001828-7720-4c65-ba45-a14bcd113197@192.168.202.40@tcp t0 exp 0000000000000000 cur 573 last 0 00000020:00000080:1.0:1784044380.401333:0:17194:0:(genops.c:1406:class_connect()) connect: client cf001828-7720-4c65-ba45-a14bcd113197, cookie 0x89871fc3aba195a4 00000100:00080000:1.0:1784044380.401544:0:17194:0:(import.c:65:import_set_state_nolock()) ffff9b3842440800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1784044380.401661:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397d65f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cf001828-7720-4c65-ba45-a14bcd113197+5:2406:x1870705565227136:12345-192.168.202.40@tcp:250:mount.lustre.0 Request processed in 428us (674us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044380.401671:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 121 00000100:00100000:1.0:1784044380.403468:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044380.403793:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565227264 00000100:00100000:0.0:1784044380.403806:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565227264 00000100:00100000:0.0:1784044380.403880:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 122 00000100:00100000:0.0:1784044380.403891:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397d65e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cf001828-7720-4c65-ba45-a14bcd113197+5:14929:x1870705565227264:12345-192.168.202.40@tcp:101:mount.lustre.0 00010000:00010000:0.0:1784044380.403916:0:17192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784044380.403945:0:17192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b38410b7a00/0x89871fc3aba195ab lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd3dffad52ca6a28 expref: -99 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044380.403982:0:17192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b38410b7a00/0x89871fc3aba195ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6a28 expref: 6 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044380.403994:0:17192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b38410b7a00/0x89871fc3aba195ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6a28 expref: 6 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044380.404003:0:17192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b38410b7a00, rc 0) 00000100:00100000:0.0:1784044380.404070:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397d65e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cf001828-7720-4c65-ba45-a14bcd113197+6:14929:x1870705565227264:12345-192.168.202.40@tcp:101:mount.lustre.0 Request processed in 181us (617us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044380.404075:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 122 00000100:00100000:3.0:1784044380.405432:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1784044380.405813:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565227392 00000100:00100000:1.0:1784044380.405821:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565227392 00000100:00100000:1.0:1784044380.405877:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 123 00000100:00100000:1.0:1784044380.405886:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397d65f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cf001828-7720-4c65-ba45-a14bcd113197+6:14929:x1870705565227392:12345-192.168.202.40@tcp:501:mount.lustre.0 00000100:00100000:1.0:1784044380.406035:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397d65f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cf001828-7720-4c65-ba45-a14bcd113197+6:14929:x1870705565227392:12345-192.168.202.40@tcp:501:mount.lustre.0 Request processed in 149us (613us total) trans 0 rc -2/-2 00000100:00100000:1.0:1784044380.406044:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 123 00000100:00100000:3.0:1784044380.407900:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044380.408046:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565227520 00000100:00100000:0.0:1784044380.408057:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565227520 00000100:00100000:0.0:1784044380.408124:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 124 00000100:00100000:0.0:1784044380.408135:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397d65d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cf001828-7720-4c65-ba45-a14bcd113197+6:14929:x1870705565227520:12345-192.168.202.40@tcp:101:mount.lustre.0 00010000:00010000:0.0:1784044380.408156:0:17192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784044380.408453:0:17192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b38410b7c00/0x89871fc3aba195b2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd3dffad52ca6a2f expref: -99 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044380.408513:0:17192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b38410b7c00/0x89871fc3aba195b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6a2f expref: 7 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044380.408599:0:17192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b38410b7c00/0x89871fc3aba195b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6a2f expref: 7 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044380.408611:0:17192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b38410b7c00, rc 0) 00000100:00100000:0.0:1784044380.408814:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397d65d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cf001828-7720-4c65-ba45-a14bcd113197+7:14929:x1870705565227520:12345-192.168.202.40@tcp:101:mount.lustre.0 Request processed in 679us (925us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044380.408823:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 124 00000100:00100000:2.0:1784044380.411500:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1784044380.411756:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565227648 00000100:00100000:1.0:1784044380.411768:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565227648 00000100:00100000:1.0:1784044380.411881:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 125 00000100:00100000:1.0:1784044380.411893:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397d65c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cf001828-7720-4c65-ba45-a14bcd113197+7:14929:x1870705565227648:12345-192.168.202.40@tcp:501:mount.lustre.0 00000100:00100000:1.0:1784044380.412113:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397d65c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cf001828-7720-4c65-ba45-a14bcd113197+8:14929:x1870705565227648:12345-192.168.202.40@tcp:501:mount.lustre.0 Request processed in 221us (629us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044380.412123:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 125 00000100:00100000:3.0:1784044380.413852:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044380.413945:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565227776 00000100:00100000:0.0:1784044380.413954:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565227776 00000100:00100000:0.0:1784044380.414019:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 126 00000100:00100000:0.0:1784044380.414028:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397d65cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cf001828-7720-4c65-ba45-a14bcd113197+8:14929:x1870705565227776:12345-192.168.202.40@tcp:503:mount.lustre.0 00000100:00100000:0.0:1784044380.414236:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397d65cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cf001828-7720-4c65-ba45-a14bcd113197+8:14929:x1870705565227776:12345-192.168.202.40@tcp:503:mount.lustre.0 Request processed in 208us (399us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044380.414244:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 126 00000100:00100000:3.0:1784044380.416969:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1784044380.417572:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565227904 00000100:00100000:1.0:1784044380.417587:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565227904 00000100:00100000:1.0:1784044380.417734:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 127 00000100:00100000:1.0:1784044380.417747:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397d65d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cf001828-7720-4c65-ba45-a14bcd113197+8:14947:x1870705565227904:12345-192.168.202.40@tcp:502:llog_process_th.0 00000100:00100000:1.0:1784044380.417965:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397d65d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cf001828-7720-4c65-ba45-a14bcd113197+8:14947:x1870705565227904:12345-192.168.202.40@tcp:502:llog_process_th.0 Request processed in 222us (1014us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044380.417974:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 127 00000100:00100000:3.0:1784044380.431646:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044380.431851:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565228032 00000100:00100000:2.0:1784044380.431866:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565228032 00000100:00100000:2.0:1784044380.431957:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 128 00000100:00100000:2.0:1784044380.431968:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3942b86850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cf001828-7720-4c65-ba45-a14bcd113197+8:14947:x1870705565228032:12345-192.168.202.40@tcp:502:llog_process_th.0 00000100:00100000:2.0:1784044380.432351:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3942b86850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cf001828-7720-4c65-ba45-a14bcd113197+8:14947:x1870705565228032:12345-192.168.202.40@tcp:502:llog_process_th.0 Request processed in 381us (716us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044380.432360:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 128 00000100:00100000:3.0:1784044380.439347:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1784044380.440436:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565228160 00000100:00100000:1.0:1784044380.440455:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565228160 00000100:00100000:1.0:1784044380.440536:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 129 00000100:00100000:1.0:1784044380.440547:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3975b97450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cf001828-7720-4c65-ba45-a14bcd113197+8:14947:x1870705565228160:12345-192.168.202.40@tcp:502:llog_process_th.0 00000100:00100000:1.0:1784044380.440761:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3975b97450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cf001828-7720-4c65-ba45-a14bcd113197+8:14947:x1870705565228160:12345-192.168.202.40@tcp:502:llog_process_th.0 Request processed in 215us (1428us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044380.440770:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 129 00000100:00100000:3.0:1784044380.446125:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044380.446228:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565228288 00000100:00100000:2.0:1784044380.446241:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565228288 00000100:00100000:2.0:1784044380.446326:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 130 00000100:00100000:2.0:1784044380.446360:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3975b94850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cf001828-7720-4c65-ba45-a14bcd113197+8:14929:x1870705565228288:12345-192.168.202.40@tcp:101:mount.lustre.0 00010000:00010000:2.0:1784044380.446384:0:17193:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784044380.446407:0:17193:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b39586efa00/0x89871fc3aba195b9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd3dffad52ca6a60 expref: -99 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044380.446453:0:17193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b39586efa00/0x89871fc3aba195b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6a60 expref: 9 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044380.446467:0:17193:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b39586efa00/0x89871fc3aba195b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6a60 expref: 9 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044380.446478:0:17193:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b39586efa00, rc 0) 00000100:00100000:2.0:1784044380.446560:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3975b94850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cf001828-7720-4c65-ba45-a14bcd113197+9:14929:x1870705565228288:12345-192.168.202.40@tcp:101:mount.lustre.0 Request processed in 203us (448us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044380.446569:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 130 00000100:00100000:2.0:1784044380.450554:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044380.450741:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565228416 00000100:00100000:0.0:1784044380.450754:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565228416 00000100:00100000:0.0:1784044380.450836:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 131 00000100:00100000:0.0:1784044380.450848:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3975b94450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cf001828-7720-4c65-ba45-a14bcd113197+9:14929:x1870705565228416:12345-192.168.202.40@tcp:256:mount.lustre.0 20000000:01000000:0.0:1784044380.450886:0:17192:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1784044380.450918:0:17192:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1784044380.450923:0:17192:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1784044380.450927:0:17192:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1784044380.450930:0:17192:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:0.0:1784044380.450938:0:17192:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:0.0:1784044380.453629:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3975b94450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cf001828-7720-4c65-ba45-a14bcd113197+9:14929:x1870705565228416:12345-192.168.202.40@tcp:256:mount.lustre.0 Request processed in 2766us (3073us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044380.453649:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 131 00000100:00100000:2.0:1784044380.455995:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044380.456123:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565228544 00000100:00100000:0.0:1784044380.456145:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565228544 00000100:00100000:0.0:1784044380.456252:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 132 00000100:00100000:0.0:1784044380.456265:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3975b95050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cf001828-7720-4c65-ba45-a14bcd113197+9:14929:x1870705565228544:12345-192.168.202.40@tcp:101:mount.lustre.0 00010000:00010000:0.0:1784044380.456289:0:17193:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784044380.456314:0:17193:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b38410b6400/0x89871fc3aba195c0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd3dffad52ca6a67 expref: -99 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044380.456352:0:17193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b38410b6400/0x89871fc3aba195c0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6a67 expref: 10 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044380.456378:0:17193:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b38410b6400/0x89871fc3aba195c0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6a67 expref: 10 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044380.456389:0:17193:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b38410b6400, rc 0) 00000100:00100000:0.0:1784044380.456492:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3975b95050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cf001828-7720-4c65-ba45-a14bcd113197+10:14929:x1870705565228544:12345-192.168.202.40@tcp:101:mount.lustre.0 Request processed in 229us (509us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044380.456500:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 132 00000100:00100000:2.0:1784044380.458309:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044380.458415:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565228672 00000100:00100000:0.0:1784044380.458423:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565228672 00000100:00100000:0.0:1784044380.458479:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 133 00000100:00100000:0.0:1784044380.458488:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3975b95850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cf001828-7720-4c65-ba45-a14bcd113197+10:14929:x1870705565228672:12345-192.168.202.40@tcp:501:mount.lustre.0 00000100:00100000:0.0:1784044380.458834:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3975b95850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cf001828-7720-4c65-ba45-a14bcd113197+10:14929:x1870705565228672:12345-192.168.202.40@tcp:501:mount.lustre.0 Request processed in 345us (535us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044380.458860:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 133 00000100:00100000:3.0:1784044380.460161:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044380.460288:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565228800 00000100:00100000:0.0:1784044380.460297:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565228800 00000100:00100000:0.0:1784044380.460344:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 134 00000100:00100000:0.0:1784044380.460354:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3975b97850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cf001828-7720-4c65-ba45-a14bcd113197+10:14929:x1870705565228800:12345-192.168.202.40@tcp:503:mount.lustre.0 00000100:00100000:0.0:1784044380.460510:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3975b97850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cf001828-7720-4c65-ba45-a14bcd113197+10:14929:x1870705565228800:12345-192.168.202.40@tcp:503:mount.lustre.0 Request processed in 156us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044380.460518:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 134 00000100:00100000:2.0:1784044380.463402:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044380.463656:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565228928 00000100:00100000:0.0:1784044380.463670:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565228928 00000100:00100000:0.0:1784044380.463747:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 135 00000100:00100000:0.0:1784044380.463758:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3975b96050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cf001828-7720-4c65-ba45-a14bcd113197+10:14954:x1870705565228928:12345-192.168.202.40@tcp:502:llog_process_th.0 00000100:00100000:0.0:1784044380.463960:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3975b96050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cf001828-7720-4c65-ba45-a14bcd113197+10:14954:x1870705565228928:12345-192.168.202.40@tcp:502:llog_process_th.0 Request processed in 203us (569us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044380.463970:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 135 00000100:00100000:2.0:1784044380.465774:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044380.465898:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565229056 00000100:00100000:0.0:1784044380.465907:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565229056 00000100:00100000:0.0:1784044380.466006:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 136 00000100:00100000:0.0:1784044380.466016:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3975b96c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cf001828-7720-4c65-ba45-a14bcd113197+10:14954:x1870705565229056:12345-192.168.202.40@tcp:502:llog_process_th.0 00000100:00100000:0.0:1784044380.466237:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3975b96c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cf001828-7720-4c65-ba45-a14bcd113197+10:14954:x1870705565229056:12345-192.168.202.40@tcp:502:llog_process_th.0 Request processed in 221us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044380.466255:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 136 00000100:00100000:0.0:1784044380.472310:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044380.472488:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1784044380.472930:0:19739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565229184 00000100:00100000:1.0:1784044380.472943:0:19739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565229184 00000100:00100000:1.0:1784044380.473025:0:19739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565229440 00000100:00100000:1.0:1784044380.473029:0:19739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565229440 00000100:00100000:3.0:1784044380.473071:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 7 00000100:00100000:3.0:1784044380.473082:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3842706d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2406:x1870705565229184:12345-192.168.202.40@tcp:38:mount.lustre.0 00010000:00080000:3.0:1784044380.473127:0:17200:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from ffd836bb-8324-4bbb-bdb8-ace806f205ee@192.168.202.40@tcp t0 exp 0000000000000000 cur 573 last 0 00000020:00000080:3.0:1784044380.473233:0:17200:0:(genops.c:1406:class_connect()) connect: client ffd836bb-8324-4bbb-bdb8-ace806f205ee, cookie 0x89871fc3aba195c7 00000004:00100000:3.0:1784044380.473274:0:17200:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return b7 00000100:00080000:3.0:1784044380.473543:0:17200:0:(import.c:65:import_set_state_nolock()) ffff9b39741fd000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1784044380.473629:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3842706d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ffd836bb-8324-4bbb-bdb8-ace806f205ee+6:2406:x1870705565229184:12345-192.168.202.40@tcp:38:mount.lustre.0 Request processed in 546us (1330us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044380.473638:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 7 00000100:00100000:3.0:1784044380.473660:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 8 00000100:00100000:3.0:1784044380.473666:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3842704000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2406:x1870705565229440:12345-192.168.202.40@tcp:38:mount.lustre.0 00010000:00080000:3.0:1784044380.473684:0:17200:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0001: connection from ffd836bb-8324-4bbb-bdb8-ace806f205ee@192.168.202.40@tcp t0 exp 0000000000000000 cur 573 last 0 00000020:00000080:3.0:1784044380.473718:0:17200:0:(genops.c:1406:class_connect()) connect: client ffd836bb-8324-4bbb-bdb8-ace806f205ee, cookie 0x89871fc3aba195ce 00000004:00100000:3.0:1784044380.473731:0:17200:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return b7 00000100:00080000:3.0:1784044380.473925:0:17200:0:(import.c:65:import_set_state_nolock()) ffff9b39749de800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1784044380.473952:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3842704000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ffd836bb-8324-4bbb-bdb8-ace806f205ee+6:2406:x1870705565229440:12345-192.168.202.40@tcp:38:mount.lustre.0 Request processed in 284us (1464us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044380.473959:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 8 00000100:00100000:3.0:1784044380.476455:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044380.476494:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1784044380.476678:0:18572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565229696 00000100:00100000:1.0:1784044380.476689:0:18572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565229696 00000100:00100000:1.0:1784044380.476774:0:18572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565229568 00000100:00100000:1.0:1784044380.476777:0:18572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565229568 00000100:00100000:1.0:1784044380.476826:0:18572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 9 00000100:00100000:1.0:1784044380.476837:0:18572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843c57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ffd836bb-8324-4bbb-bdb8-ace806f205ee+6:14929:x1870705565229696:12345-192.168.202.40@tcp:41:mount.lustre.0 00000004:00000024:1.0:1784044380.476878:0:18572:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1784044380.476916:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 10 00000100:00100000:0.0:1784044380.476931:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843c54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ffd836bb-8324-4bbb-bdb8-ace806f205ee+6:0:x1870705565229568:12345-192.168.202.40@tcp:41:mount.lustre.0 00000004:00000024:0.0:1784044380.476950:0:17201:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1784044380.476977:0:18572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843c57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ffd836bb-8324-4bbb-bdb8-ace806f205ee+6:14929:x1870705565229696:12345-192.168.202.40@tcp:41:mount.lustre.0 Request processed in 141us (535us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044380.476986:0:18572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 9 00000100:00100000:0.0:1784044380.477013:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843c54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ffd836bb-8324-4bbb-bdb8-ace806f205ee+6:0:x1870705565229568:12345-192.168.202.40@tcp:41:mount.lustre.0 Request processed in 86us (516us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044380.477021:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 10 00000100:00100000:3.0:1784044380.477086:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00080000:2.0:1784044380.477635:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1784044380.477642:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784044380.477798:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565229312 00000100:00100000:0.0:1784044380.477806:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565229312 00000100:00100000:0.0:1784044380.477888:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 11 00000100:00100000:0.0:1784044380.477897:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843c57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ffd836bb-8324-4bbb-bdb8-ace806f205ee+6:0:x1870705565229312:12345-192.168.202.40@tcp:41:mount.lustre.0 00000004:00000024:0.0:1784044380.477920:0:17200:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1784044380.477974:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843c57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ffd836bb-8324-4bbb-bdb8-ace806f205ee+6:0:x1870705565229312:12345-192.168.202.40@tcp:41:mount.lustre.0 Request processed in 79us (888us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044380.477981:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 11 00000100:00100000:3.0:1784044380.480678:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1784044380.480810:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565229824 00000100:00100000:1.0:1784044380.480820:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565229824 00000100:00100000:1.0:1784044380.480944:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 12 00000100:00100000:1.0:1784044380.480956:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843c57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ffd836bb-8324-4bbb-bdb8-ace806f205ee+6:14929:x1870705565229824:12345-192.168.202.40@tcp:40:mount.lustre.0 00000100:00100000:1.0:1784044380.481060:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843c57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ffd836bb-8324-4bbb-bdb8-ace806f205ee+6:14929:x1870705565229824:12345-192.168.202.40@tcp:40:mount.lustre.0 Request processed in 107us (396us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044380.481088:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 12 00000100:00100000:2.0:1784044380.482927:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044380.483119:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044380.483206:0:18708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565229952 00000100:00100000:0.0:1784044380.483219:0:18708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565229952 00000100:00100000:0.0:1784044380.483273:0:18708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565230080 00000100:00100000:0.0:1784044380.483276:0:18708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565230080 00000100:00100000:0.0:1784044380.483309:0:18708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 23 00000100:00100000:0.0:1784044380.483318:0:18708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843e38e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2406:x1870705565229952:12345-192.168.202.40@tcp:8:mount.lustre.0 00010000:00080000:0.0:1784044380.483361:0:18708:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from ffd836bb-8324-4bbb-bdb8-ace806f205ee@192.168.202.40@tcp t0 exp 0000000000000000 cur 573 last 0 00000020:00000080:0.0:1784044380.483402:0:18708:0:(genops.c:1406:class_connect()) connect: client ffd836bb-8324-4bbb-bdb8-ace806f205ee, cookie 0x89871fc3aba195d5 00002000:00100000:0.0:1784044380.483418:0:18708:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli ffd836bb-8324-4bbb-bdb8-ace806f205ee/ffff9b3947bbd000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136a2 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1784044380.483440:0:18708:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return b7 00002000:00080000:0.0:1784044380.483680:0:18708:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1784044380.483721:0:18708:0:(import.c:65:import_set_state_nolock()) ffff9b3947bbf000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1784044380.483814:0:18708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843e38e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ffd836bb-8324-4bbb-bdb8-ace806f205ee+6:2406:x1870705565229952:12345-192.168.202.40@tcp:8:mount.lustre.0 Request processed in 495us (901us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044380.483823:0:18708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 23 00000100:00100000:0.0:1784044380.483845:0:18708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 24 00000100:00100000:0.0:1784044380.483850:0:18708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843c56d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2406:x1870705565230080:12345-192.168.202.40@tcp:8:mount.lustre.0 00010000:00080000:0.0:1784044380.483869:0:18708:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from ffd836bb-8324-4bbb-bdb8-ace806f205ee@192.168.202.40@tcp t0 exp 0000000000000000 cur 573 last 0 00000020:00000080:0.0:1784044380.483894:0:18708:0:(genops.c:1406:class_connect()) connect: client ffd836bb-8324-4bbb-bdb8-ace806f205ee, cookie 0x89871fc3aba195dc 00002000:00100000:0.0:1784044380.483900:0:18708:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli ffd836bb-8324-4bbb-bdb8-ace806f205ee/ffff9b3947bbd800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136a2 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1784044380.483907:0:18708:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return b7 00002000:00080000:0.0:1784044380.484028:0:18708:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1784044380.484042:0:18708:0:(import.c:65:import_set_state_nolock()) ffff9b3947bbf800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1784044380.484064:0:18708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843c56d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ffd836bb-8324-4bbb-bdb8-ace806f205ee+6:2406:x1870705565230080:12345-192.168.202.40@tcp:8:mount.lustre.0 Request processed in 214us (947us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044380.484072:0:18708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 24 00000100:00100000:0.0:1784044380.485936:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1784044380.487441:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565230208 00000100:00100000:1.0:1784044380.487459:0:17212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565230208 00000100:00100000:1.0:1784044380.487596:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 3 00000100:00100000:1.0:1784044380.487610:0:17212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3842704e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:ffd836bb-8324-4bbb-bdb8-ace806f205ee+6:14929:x1870705565230208:12345-192.168.202.40@tcp:900:mount.lustre.0 00000100:00100000:1.0:1784044380.487727:0:17212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3842704e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:ffd836bb-8324-4bbb-bdb8-ace806f205ee+6:14929:x1870705565230208:12345-192.168.202.40@tcp:900:mount.lustre.0 Request processed in 121us (1806us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044380.487737:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 3 00000001:00100000:2.0:1784044380.487925:0:19522:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of ffd836bb-8324-4bbb-bdb8-ace806f205ee 00000001:00080000:2.0:1784044380.487940:0:19522:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934594 is committed 00000100:00100000:0.0:1784044380.490900:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1784044380.491050:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565230336 00000100:00100000:1.0:1784044380.491062:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565230336 00000100:00100000:1.0:1784044380.491125:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 0 00000100:00100000:1.0:1784044380.491135:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3842705c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ffd836bb-8324-4bbb-bdb8-ace806f205ee+6:14929:x1870705565230336:12345-192.168.202.40@tcp:33:mount.lustre.0 00000004:00080000:3.0:1784044380.494314:0:17202:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 3012us 00000004:00200000:3.0:1784044380.505526:0:17202:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1784044380.505741:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3842705c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ffd836bb-8324-4bbb-bdb8-ace806f205ee+6:14929:x1870705565230336:12345-192.168.202.40@tcp:33:mount.lustre.0 Request processed in 14597us (14845us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044380.505760:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 0 00000100:00100000:3.0:1784044380.602396:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044380.605714:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565230464 00000100:00100000:0.0:1784044380.605736:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565230464 00000100:00100000:0.0:1784044380.606333:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 13 00000100:00100000:0.0:1784044380.606351:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843c57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ffd836bb-8324-4bbb-bdb8-ace806f205ee+6:14977:x1870705565230464:12345-192.168.202.40@tcp:101:mkdir.0 00010000:00010000:0.0:1784044380.606382:0:17201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784044380.606426:0:17201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7800/0x89871fc3aba195e3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcd3dffad52ca6a98 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044380.606533:0:17201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6e00/0x89871fc3aba195ea lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044380.606574:0:17201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6e00/0x89871fc3aba195ea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044380.606596:0:17201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6e00/0x89871fc3aba195ea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784044380.606667:0:17201:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1784044380.606671:0:17201:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1784044380.606712:0:17201:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6e00/0x89871fc3aba195ea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044380.606743:0:17201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7800/0x89871fc3aba195e3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6a98 expref: 8 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044380.606768:0:17201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6e00/0x89871fc3aba195ea lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6a98 expref: 7 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044380.606779:0:17201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b3974d3ad00) 00010000:00010000:0.0:1784044380.606794:0:17201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1784044380.606799:0:17201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b38410b6e00, rc 0) 00000100:00100000:0.0:1784044380.606884:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843c57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ffd836bb-8324-4bbb-bdb8-ace806f205ee+7:14977:x1870705565230464:12345-192.168.202.40@tcp:101:mkdir.0 Request processed in 539us (4506us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044380.606892:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 13 00010000:00010000:1.0:1784044381.203099:0:19100:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784044382.224910:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784044382.431892:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044382.432026:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565230592 00000100:00100000:0.0:1784044382.432041:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565230592 00000100:00100000:0.0:1784044382.432320:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 14 00000100:00100000:0.0:1784044382.432334:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843e3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ffd836bb-8324-4bbb-bdb8-ace806f205ee+6:15030:x1870705565230592:12345-192.168.202.40@tcp:41:lfs.0 00000004:00000024:0.0:1784044382.432390:0:17200:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1784044382.432520:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843e3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ffd836bb-8324-4bbb-bdb8-ace806f205ee+6:15030:x1870705565230592:12345-192.168.202.40@tcp:41:lfs.0 Request processed in 190us (645us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044382.432529:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 14 00000100:00080000:2.0:1784044382.432772:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1784044382.439741:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044382.440373:0:18710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565230720 00000100:00100000:0.0:1784044382.440389:0:18710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565230720 00000100:00100000:0.0:1784044382.440510:0:18710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 15 00000100:00100000:0.0:1784044382.440525:0:18710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843e39500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:ffd836bb-8324-4bbb-bdb8-ace806f205ee+6:15030:x1870705565230720:12345-192.168.202.40@tcp:13:lfs.0 00002000:00000024:0.0:1784044382.440574:0:18710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1784044382.440704:0:18710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843e39500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:ffd836bb-8324-4bbb-bdb8-ace806f205ee+6:15030:x1870705565230720:12345-192.168.202.40@tcp:13:lfs.0 Request processed in 183us (978us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044382.440714:0:18710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 15 00000100:00080000:2.0:1784044382.441009:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784044382.443062:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044382.443282:0:18710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565230848 00000100:00100000:0.0:1784044382.443293:0:18710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565230848 00000100:00100000:0.0:1784044382.443478:0:18710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16 00000100:00100000:0.0:1784044382.443490:0:18710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843c56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:ffd836bb-8324-4bbb-bdb8-ace806f205ee+5:15030:x1870705565230848:12345-192.168.202.40@tcp:13:lfs.0 00002000:00000024:0.0:1784044382.443530:0:18710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1784044382.443673:0:18710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843c56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:ffd836bb-8324-4bbb-bdb8-ace806f205ee+5:15030:x1870705565230848:12345-192.168.202.40@tcp:13:lfs.0 Request processed in 186us (623us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044382.443682:0:18710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16 00000100:00080000:2.0:1784044382.448012:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784044382.723364:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1784044382.723791:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565230976 00000100:00100000:1.0:1784044382.723805:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565230976 00000100:00100000:1.0:1784044382.723888:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 137 00000100:00100000:1.0:1784044382.723899:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3975b97050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cf001828-7720-4c65-ba45-a14bcd113197+10:15063:x1870705565230976:12345-192.168.202.40@tcp:101:mount.lustre.0 00010000:00010000:1.0:1784044382.723921:0:17194:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784044382.723942:0:17194:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b397cb19e00/0x89871fc3aba195f1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd3dffad52ca6a9f expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044382.723976:0:17194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b397cb19e00/0x89871fc3aba195f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6a9f expref: 11 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044382.723989:0:17194:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b397cb19e00/0x89871fc3aba195f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6a9f expref: 11 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044382.724021:0:17194:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b397cb19e00, rc 0) 00000100:00100000:1.0:1784044382.724091:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3975b97050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cf001828-7720-4c65-ba45-a14bcd113197+11:15063:x1870705565230976:12345-192.168.202.40@tcp:101:mount.lustre.0 Request processed in 194us (741us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044382.724098:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 137 00000100:00100000:3.0:1784044382.741703:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044382.749362:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565231104 00000100:00100000:0.0:1784044382.749384:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565231104 00000100:00100000:0.0:1784044382.749547:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 138 00000100:00100000:0.0:1784044382.749559:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3975b94c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cf001828-7720-4c65-ba45-a14bcd113197+11:15063:x1870705565231104:12345-192.168.202.40@tcp:501:mount.lustre.0 00000100:00100000:0.0:1784044382.749830:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3975b94c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cf001828-7720-4c65-ba45-a14bcd113197+11:15063:x1870705565231104:12345-192.168.202.40@tcp:501:mount.lustre.0 Request processed in 272us (8142us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044382.749846:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 138 00000100:00100000:3.0:1784044382.753018:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1784044382.759017:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565231232 00000100:00100000:1.0:1784044382.759040:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565231232 00000100:00100000:1.0:1784044382.759117:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 139 00000100:00100000:1.0:1784044382.759939:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3975b95c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cf001828-7720-4c65-ba45-a14bcd113197+11:15063:x1870705565231232:12345-192.168.202.40@tcp:503:mount.lustre.0 00000100:00100000:1.0:1784044382.760335:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3975b95c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cf001828-7720-4c65-ba45-a14bcd113197+11:15063:x1870705565231232:12345-192.168.202.40@tcp:503:mount.lustre.0 Request processed in 405us (7334us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044382.760346:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 139 00000100:00100000:3.0:1784044382.769746:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1784044382.770539:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565231360 00000100:00100000:1.0:1784044382.770553:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565231360 00000100:00100000:1.0:1784044382.770634:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 140 00000100:00100000:1.0:1784044382.770646:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3975b96450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cf001828-7720-4c65-ba45-a14bcd113197+11:15069:x1870705565231360:12345-192.168.202.40@tcp:502:llog_process_th.0 00000100:00100000:1.0:1784044382.771414:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3975b96450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cf001828-7720-4c65-ba45-a14bcd113197+11:15069:x1870705565231360:12345-192.168.202.40@tcp:502:llog_process_th.0 Request processed in 761us (1677us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044382.771428:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 140 00000100:00100000:3.0:1784044382.818720:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044382.819217:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565231488 00000100:00100000:2.0:1784044382.819232:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565231488 00000100:00100000:2.0:1784044382.819306:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 141 00000100:00100000:2.0:1784044382.819319:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3975b95450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cf001828-7720-4c65-ba45-a14bcd113197+11:15069:x1870705565231488:12345-192.168.202.40@tcp:502:llog_process_th.0 00000100:00100000:2.0:1784044382.819548:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3975b95450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cf001828-7720-4c65-ba45-a14bcd113197+11:15069:x1870705565231488:12345-192.168.202.40@tcp:502:llog_process_th.0 Request processed in 231us (844us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044382.819559:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 141 00000100:00100000:2.0:1784044382.826024:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1784044382.833117:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565231616 00000100:00100000:1.0:1784044382.833579:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565231616 00000100:00100000:1.0:1784044382.833681:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 142 00000100:00100000:1.0:1784044382.833693:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3975b94050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cf001828-7720-4c65-ba45-a14bcd113197+11:15069:x1870705565231616:12345-192.168.202.40@tcp:502:llog_process_th.0 00000100:00100000:1.0:1784044382.834117:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3975b94050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cf001828-7720-4c65-ba45-a14bcd113197+11:15069:x1870705565231616:12345-192.168.202.40@tcp:502:llog_process_th.0 Request processed in 424us (8305us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044382.834153:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 142 00000100:00100000:3.0:1784044382.837587:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044382.837741:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565231744 00000100:00100000:0.0:1784044382.837757:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565231744 00000100:00100000:0.0:1784044382.837866:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 143 00000100:00100000:0.0:1784044382.838307:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3975b97c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cf001828-7720-4c65-ba45-a14bcd113197+11:15063:x1870705565231744:12345-192.168.202.40@tcp:101:mount.lustre.0 00010000:00010000:0.0:1784044382.838332:0:17193:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784044382.838358:0:17193:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b38410b7800/0x89871fc3aba195f8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd3dffad52ca6ad0 expref: -99 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044382.838397:0:17193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b38410b7800/0x89871fc3aba195f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6ad0 expref: 12 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044382.838411:0:17193:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b38410b7800/0x89871fc3aba195f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6ad0 expref: 12 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044382.838422:0:17193:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b38410b7800, rc 0) 00000100:00100000:0.0:1784044382.838543:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3975b97c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cf001828-7720-4c65-ba45-a14bcd113197+12:15063:x1870705565231744:12345-192.168.202.40@tcp:101:mount.lustre.0 Request processed in 659us (969us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044382.838553:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 143 00000100:00100000:3.0:1784044382.848635:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1784044382.849010:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565231872 00000100:00100000:1.0:1784044382.849025:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565231872 00000100:00100000:1.0:1784044382.849105:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 144 00000100:00100000:1.0:1784044382.849117:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397424c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cf001828-7720-4c65-ba45-a14bcd113197+12:15063:x1870705565231872:12345-192.168.202.40@tcp:256:mount.lustre.0 20000000:01000000:0.0:1784044382.849728:0:17194:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1784044382.849771:0:17194:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1784044382.849776:0:17194:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1784044382.849780:0:17194:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1784044382.849783:0:17194:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:0.0:1784044382.849785:0:17194:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:0.0:1784044382.856011:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397424c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cf001828-7720-4c65-ba45-a14bcd113197+12:15063:x1870705565231872:12345-192.168.202.40@tcp:256:mount.lustre.0 Request processed in 6876us (7371us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044382.856034:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 144 00000100:00100000:3.0:1784044382.869535:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044382.870394:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565232000 00000100:00100000:0.0:1784044382.870411:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565232000 00000100:00100000:0.0:1784044382.870524:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 145 00000100:00100000:0.0:1784044382.870537:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397424dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cf001828-7720-4c65-ba45-a14bcd113197+12:15063:x1870705565232000:12345-192.168.202.40@tcp:101:mount.lustre.0 00010000:00010000:0.0:1784044382.870563:0:17193:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784044382.870591:0:17193:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b38410b6c00/0x89871fc3aba195ff lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd3dffad52ca6ad7 expref: -99 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044382.870640:0:17193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b38410b6c00/0x89871fc3aba195ff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6ad7 expref: 13 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044382.870655:0:17193:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b38410b6c00/0x89871fc3aba195ff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6ad7 expref: 13 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044382.870666:0:17193:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b38410b6c00, rc 0) 00000100:00100000:0.0:1784044382.870770:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397424dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cf001828-7720-4c65-ba45-a14bcd113197+13:15063:x1870705565232000:12345-192.168.202.40@tcp:101:mount.lustre.0 Request processed in 227us (1244us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044382.870779:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 145 00000100:00100000:3.0:1784044382.877589:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044382.877795:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565232128 00000100:00100000:0.0:1784044382.877809:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565232128 00000100:00100000:0.0:1784044382.878743:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 146 00000100:00100000:0.0:1784044382.878774:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397424c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cf001828-7720-4c65-ba45-a14bcd113197+13:15063:x1870705565232128:12345-192.168.202.40@tcp:501:mount.lustre.0 00000100:00100000:0.0:1784044382.879597:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397424c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cf001828-7720-4c65-ba45-a14bcd113197+13:15063:x1870705565232128:12345-192.168.202.40@tcp:501:mount.lustre.0 Request processed in 836us (2019us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044382.879610:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 146 00000100:00100000:3.0:1784044382.886088:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044382.888115:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565232256 00000100:00100000:2.0:1784044382.888752:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565232256 00000100:00100000:2.0:1784044382.889093:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 147 00000100:00100000:2.0:1784044382.889107:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397424f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cf001828-7720-4c65-ba45-a14bcd113197+13:15063:x1870705565232256:12345-192.168.202.40@tcp:503:mount.lustre.0 00000100:00100000:2.0:1784044382.890747:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397424f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cf001828-7720-4c65-ba45-a14bcd113197+13:15063:x1870705565232256:12345-192.168.202.40@tcp:503:mount.lustre.0 Request processed in 1628us (4661us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044382.890775:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 147 00000100:00100000:2.0:1784044382.913077:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044382.914586:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565232384 00000100:00100000:0.0:1784044382.914606:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565232384 00000100:00100000:0.0:1784044382.914782:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 148 00000100:00100000:0.0:1784044382.914796:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397424d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cf001828-7720-4c65-ba45-a14bcd113197+13:15073:x1870705565232384:12345-192.168.202.40@tcp:502:llog_process_th.0 00000100:00100000:0.0:1784044382.915069:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397424d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cf001828-7720-4c65-ba45-a14bcd113197+13:15073:x1870705565232384:12345-192.168.202.40@tcp:502:llog_process_th.0 Request processed in 275us (2257us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044382.915079:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 148 00000100:00100000:3.0:1784044382.925627:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1784044382.925789:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565232512 00000100:00100000:1.0:1784044382.925802:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565232512 00000100:00100000:1.0:1784044382.925881:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 149 00000100:00100000:1.0:1784044382.925894:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397424c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cf001828-7720-4c65-ba45-a14bcd113197+13:15073:x1870705565232512:12345-192.168.202.40@tcp:502:llog_process_th.0 00000100:00100000:1.0:1784044382.926129:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397424c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cf001828-7720-4c65-ba45-a14bcd113197+13:15073:x1870705565232512:12345-192.168.202.40@tcp:502:llog_process_th.0 Request processed in 230us (510us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044382.926145:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 149 00000100:00100000:3.0:1784044382.935141:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044382.935248:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044382.936254:0:18572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565232640 00000100:00100000:0.0:1784044382.936271:0:18572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565232640 00000100:00100000:0.0:1784044382.936328:0:18572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565232768 00000100:00100000:0.0:1784044382.936332:0:18572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565232768 00000100:00100000:0.0:1784044382.936398:0:18572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 50 00000100:00100000:0.0:1784044382.936412:0:18572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38436a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ffd836bb-8324-4bbb-bdb8-ace806f205ee+7:2408:x1870705565232768:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:0.0:1784044382.936520:0:18572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38436a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ffd836bb-8324-4bbb-bdb8-ace806f205ee+7:2408:x1870705565232768:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 112us (1271us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044382.936529:0:18572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 50 00000100:00100000:0.0:1784044382.936563:0:18572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 15 00000100:00100000:0.0:1784044382.936569:0:18572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843c55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2406:x1870705565232640:12345-192.168.202.40@tcp:38:mount.lustre.0 00000100:00080000:3.0:1784044382.936594:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1784044382.936599:0:18572:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from 35f5085c-0464-4087-9b4b-890cdd0735b4@192.168.202.40@tcp t0 exp 0000000000000000 cur 576 last 0 00000020:00000080:0.0:1784044382.936644:0:18572:0:(genops.c:1406:class_connect()) connect: client 35f5085c-0464-4087-9b4b-890cdd0735b4, cookie 0x89871fc3aba19606 00000004:00100000:0.0:1784044382.936681:0:18572:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return b7 00000100:00080000:0.0:1784044382.936846:0:18572:0:(import.c:65:import_set_state_nolock()) ffff9b38423e7000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1784044382.936912:0:18572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843c55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35f5085c-0464-4087-9b4b-890cdd0735b4+6:2406:x1870705565232640:12345-192.168.202.40@tcp:38:mount.lustre.0 Request processed in 341us (1786us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044382.936920:0:18572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 15 00000100:00100000:3.0:1784044382.940094:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044382.942359:0:18708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565233024 00000100:00100000:0.0:1784044382.942385:0:18708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565233024 00000100:00100000:0.0:1784044382.942500:0:18708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 11 00000100:00100000:0.0:1784044382.942516:0:18708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d4e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ffd836bb-8324-4bbb-bdb8-ace806f205ee+6:2408:x1870705565233024:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:0.0:1784044382.942681:0:18708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d4e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ffd836bb-8324-4bbb-bdb8-ace806f205ee+6:2408:x1870705565233024:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 169us (2608us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044382.942691:0:18708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 11 00000100:00100000:3.0:1784044382.948276:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044382.948390:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044382.948489:0:18707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565233152 00000100:00100000:2.0:1784044382.948504:0:18707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565233152 00000100:00100000:2.0:1784044382.948594:0:18707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 12 00000100:00100000:2.0:1784044382.948608:0:18707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843ce5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ffd836bb-8324-4bbb-bdb8-ace806f205ee+5:2408:x1870705565233152:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:2.0:1784044382.948737:0:18707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843ce5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ffd836bb-8324-4bbb-bdb8-ace806f205ee+5:2408:x1870705565233152:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 132us (347us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044382.948746:0:18707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 12 00000100:00100000:0.0:1784044382.948859:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565232896 00000100:00100000:0.0:1784044382.948865:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565232896 00000100:00100000:0.0:1784044382.948933:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 51 00000100:00100000:0.0:1784044382.948942:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843ce4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ffd836bb-8324-4bbb-bdb8-ace806f205ee+6:2408:x1870705565232896:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:0.0:1784044382.948978:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843ce4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ffd836bb-8324-4bbb-bdb8-ace806f205ee+6:2408:x1870705565232896:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 38us (723us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044382.948985:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 51 00000100:00100000:1.0:1784044382.958070:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1784044382.958119:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044382.958328:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565233280 00000100:00100000:0.0:1784044382.958342:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565233280 00000100:00100000:0.0:1784044382.958434:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565233664 00000100:00100000:0.0:1784044382.958437:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565233664 00000100:00100000:0.0:1784044382.958466:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16 00000100:00100000:0.0:1784044382.958477:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39412e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35f5085c-0464-4087-9b4b-890cdd0735b4+7:2408:x1870705565233280:12345-192.168.202.40@tcp:41:mount.lustre.0 00000004:00000024:0.0:1784044382.958532:0:17199:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1784044382.958626:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39412e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35f5085c-0464-4087-9b4b-890cdd0735b4+7:2408:x1870705565233280:12345-192.168.202.40@tcp:41:mount.lustre.0 Request processed in 149us (572us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044382.958635:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16 00000100:00100000:0.0:1784044382.958659:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 17 00000100:00100000:0.0:1784044382.958665:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39412e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35f5085c-0464-4087-9b4b-890cdd0735b4+6:15063:x1870705565233664:12345-192.168.202.40@tcp:41:mount.lustre.0 00000004:00000024:0.0:1784044382.958678:0:17199:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1784044382.958700:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39412e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35f5085c-0464-4087-9b4b-890cdd0735b4+6:15063:x1870705565233664:12345-192.168.202.40@tcp:41:mount.lustre.0 Request processed in 36us (581us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044382.958734:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 17 00000100:00080000:3.0:1784044382.959056:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784044382.963678:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044382.964090:0:18572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565233408 00000100:00100000:2.0:1784044382.964106:0:18572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565233408 00000100:00100000:2.0:1784044382.964362:0:18572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 18 00000100:00100000:2.0:1784044382.964374:0:18572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843ce5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2406:x1870705565233408:12345-192.168.202.40@tcp:38:mount.lustre.0 00010000:00080000:2.0:1784044382.964421:0:18572:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0001: connection from 35f5085c-0464-4087-9b4b-890cdd0735b4@192.168.202.40@tcp t0 exp 0000000000000000 cur 576 last 0 00000020:00000080:2.0:1784044382.964478:0:18572:0:(genops.c:1406:class_connect()) connect: client 35f5085c-0464-4087-9b4b-890cdd0735b4, cookie 0x89871fc3aba1960d 00000004:00100000:2.0:1784044382.964519:0:18572:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return b7 00000100:00080000:2.0:1784044382.964666:0:18572:0:(import.c:65:import_set_state_nolock()) ffff9b384242d800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784044382.964776:0:18572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843ce5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35f5085c-0464-4087-9b4b-890cdd0735b4+6:2406:x1870705565233408:12345-192.168.202.40@tcp:38:mount.lustre.0 Request processed in 402us (1114us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044382.964786:0:18572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 18 00000100:00100000:3.0:1784044382.984379:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044382.984429:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044382.985316:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565233792 00000100:00100000:0.0:1784044382.985330:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565233792 00000100:00100000:0.0:1784044382.985408:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565233536 00000100:00100000:0.0:1784044382.985411:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565233536 00000100:00100000:0.0:1784044382.985455:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 19 00000100:00100000:0.0:1784044382.985466:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397a8a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35f5085c-0464-4087-9b4b-890cdd0735b4+6:15063:x1870705565233792:12345-192.168.202.40@tcp:40:mount.lustre.0 00000100:00100000:2.0:1784044382.985603:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 20 00000100:00100000:2.0:1784044382.985613:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397a8a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35f5085c-0464-4087-9b4b-890cdd0735b4+6:0:x1870705565233536:12345-192.168.202.40@tcp:41:mount.lustre.0 00000004:00000024:2.0:1784044382.985647:0:17201:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1784044382.985736:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397a8a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35f5085c-0464-4087-9b4b-890cdd0735b4+6:0:x1870705565233536:12345-192.168.202.40@tcp:41:mount.lustre.0 Request processed in 126us (1306us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044382.985744:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 20 00000100:00100000:0.0:1784044382.986458:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397a8a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35f5085c-0464-4087-9b4b-890cdd0735b4+6:15063:x1870705565233792:12345-192.168.202.40@tcp:40:mount.lustre.0 Request processed in 987us (2089us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044382.986468:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 19 00000100:00080000:3.0:1784044382.986616:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1784044382.995669:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1784044382.995711:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1784044382.995772:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044382.995911:0:17211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565234176 00000100:00100000:0.0:1784044382.995924:0:17211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565234176 00000100:00100000:0.0:1784044382.996000:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4 00000100:00100000:0.0:1784044382.996012:0:17211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39412e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:35f5085c-0464-4087-9b4b-890cdd0735b4+6:15063:x1870705565234176:12345-192.168.202.40@tcp:900:mount.lustre.0 00000100:00100000:0.0:1784044382.996126:0:17211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39412e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:35f5085c-0464-4087-9b4b-890cdd0735b4+6:15063:x1870705565234176:12345-192.168.202.40@tcp:900:mount.lustre.0 Request processed in 116us (471us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044382.996135:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4 00000100:00100000:3.0:1784044382.996545:0:18933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565233920 00000100:00100000:3.0:1784044382.996552:0:18933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565233920 00000100:00100000:3.0:1784044382.996588:0:18933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565234048 00000100:00100000:3.0:1784044382.996592:0:18933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565234048 00000100:00100000:3.0:1784044382.996611:0:18933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 25 00000100:00100000:3.0:1784044382.996618:0:18933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39412eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2406:x1870705565233920:12345-192.168.202.40@tcp:8:mount.lustre.0 00010000:00080000:3.0:1784044382.996653:0:18933:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from 35f5085c-0464-4087-9b4b-890cdd0735b4@192.168.202.40@tcp t0 exp 0000000000000000 cur 576 last 0 00000020:00000080:3.0:1784044382.996699:0:18933:0:(genops.c:1406:class_connect()) connect: client 35f5085c-0464-4087-9b4b-890cdd0735b4, cookie 0x89871fc3aba19614 00002000:00100000:3.0:1784044382.996718:0:18933:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 35f5085c-0464-4087-9b4b-890cdd0735b4/ffff9b39749d8000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136a2 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1784044382.996735:0:18933:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return b7 00000100:00100000:1.0:1784044382.997318:0:18706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 26 00000100:00100000:1.0:1784044382.997326:0:18706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3947beec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2406:x1870705565234048:12345-192.168.202.40@tcp:8:mount.lustre.0 00010000:00080000:1.0:1784044382.997353:0:18706:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from 35f5085c-0464-4087-9b4b-890cdd0735b4@192.168.202.40@tcp t0 exp 0000000000000000 cur 576 last 0 00000020:00000080:1.0:1784044382.997381:0:18706:0:(genops.c:1406:class_connect()) connect: client 35f5085c-0464-4087-9b4b-890cdd0735b4, cookie 0x89871fc3aba1961b 00002000:00100000:1.0:1784044382.997389:0:18706:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 35f5085c-0464-4087-9b4b-890cdd0735b4/ffff9b3974970000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136a2 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1784044382.997396:0:18706:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return b7 00002000:00080000:1.0:1784044382.997491:0:18706:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1784044382.999357:0:18706:0:(import.c:65:import_set_state_nolock()) ffff9b3974972800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1784044382.999457:0:18706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3947beec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:35f5085c-0464-4087-9b4b-890cdd0735b4+6:2406:x1870705565234048:12345-192.168.202.40@tcp:8:mount.lustre.0 Request processed in 2123us (3678us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044382.999469:0:18706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 26 00002000:00080000:2.0:1784044382.999615:0:18933:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1784044382.999635:0:18933:0:(import.c:65:import_set_state_nolock()) ffff9b38437dc000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784044382.999662:0:18933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39412eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:35f5085c-0464-4087-9b4b-890cdd0735b4+6:2406:x1870705565233920:12345-192.168.202.40@tcp:8:mount.lustre.0 Request processed in 3044us (3950us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044382.999670:0:18933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 25 00000100:00100000:1.0:1784044383.004441:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044383.004602:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565234304 00000100:00100000:3.0:1784044383.004616:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565234304 00000100:00100000:3.0:1784044383.004687:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 1 00000100:00100000:3.0:1784044383.004700:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39412e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:35f5085c-0464-4087-9b4b-890cdd0735b4+6:15063:x1870705565234304:12345-192.168.202.40@tcp:33:mount.lustre.0 00000004:00200000:3.0:1784044383.004851:0:17203:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1784044383.005234:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39412e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:35f5085c-0464-4087-9b4b-890cdd0735b4+6:15063:x1870705565234304:12345-192.168.202.40@tcp:33:mount.lustre.0 Request processed in 534us (805us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044383.005243:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 1 00000100:00100000:0.0:1784044383.161654:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1784044383.163024:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565234432 00000100:00100000:1.0:1784044383.163043:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565234432 00000100:00100000:1.0:1784044383.163136:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 21 00000100:00100000:1.0:1784044383.163149:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3842705500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35f5085c-0464-4087-9b4b-890cdd0735b4+6:15095:x1870705565234432:12345-192.168.202.40@tcp:101:mkdir.0 00010000:00010000:1.0:1784044383.163197:0:17199:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784044383.163245:0:17199:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b397cb19200/0x89871fc3aba19622 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcd3dffad52ca6b08 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044383.163347:0:17199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b397cb18800/0x89871fc3aba19629 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044383.163365:0:17199:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b397cb18800/0x89871fc3aba19629 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044383.163383:0:17199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b397cb18800/0x89871fc3aba19629 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784044383.163442:0:17199:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1784044383.163446:0:17199:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1784044383.163474:0:17199:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b397cb18800/0x89871fc3aba19629 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044383.163677:0:17199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b397cb19200/0x89871fc3aba19622 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6b08 expref: 8 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044383.163726:0:17199:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b397cb18800/0x89871fc3aba19629 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6b08 expref: 7 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044383.163736:0:17199:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b3974d3ad00) 00010000:00010000:1.0:1784044383.163741:0:17199:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1784044383.163745:0:17199:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b397cb18800, rc 0) 00000100:00100000:1.0:1784044383.164029:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3842705500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35f5085c-0464-4087-9b4b-890cdd0735b4+7:15095:x1870705565234432:12345-192.168.202.40@tcp:101:mkdir.0 Request processed in 881us (2387us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044383.164039:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 21 00010000:00010000:2.0:1784044383.245635:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784044383.311309:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397a8a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1870705581064320:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784044383.311422:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044383.311829:0:18710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581064320 00000100:00100000:2.0:1784044383.311841:0:18710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581064320 00000100:00100000:2.0:1784044383.311937:0:18710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1784044383.311969:0:18710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3842704380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1870705581064320:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1784044383.312001:0:18710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1784044383.312071:0:18710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3842704380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1870705581064320:12345-0@lo:13:osp-pre-0-0.0 Request processed in 105us (649us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044383.312079:0:18710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1784044383.312275:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397a8a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1870705581064320:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1784044383.312460:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1784044384.271232:0:19100:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784044384.344025:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784044384.344064:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397a8a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1870705581064448:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1784044384.344232:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044384.344324:0:18710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581064448 00000100:00100000:3.0:1784044384.344333:0:18710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581064448 00000100:00100000:3.0:1784044384.344403:0:18710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1784044384.344415:0:18710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397a8a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1870705581064448:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1784044384.344451:0:18710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1784044384.344496:0:18710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397a8a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1870705581064448:12345-0@lo:13:osp-pre-0-1.0 Request processed in 84us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044384.344504:0:18710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:3.0:1784044384.344529:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784044384.344581:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397a8a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1870705581064448:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1784044385.293637:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784044385.357427:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397a8a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1870705581064576:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1784044385.357539:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044385.357630:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843e3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1870705581064832:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784044385.357669:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044385.357727:0:18710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581064832 00000100:00100000:2.0:1784044385.357771:0:18710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581064832 00000100:00100000:3.0:1784044385.357939:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397a8a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1870705581064960:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1784044385.357977:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044385.358014:0:18709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581064960 00000100:00100000:3.0:1784044385.358018:0:18709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581064960 00000100:00100000:2.0:1784044385.358104:0:18710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1784044385.358117:0:18710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843e38e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1870705581064832:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1784044385.358162:0:18710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1784044385.358243:0:18710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843e38e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1870705581064832:12345-0@lo:13:osp-pre-1-0.0 Request processed in 129us (573us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044385.358252:0:18710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1784044385.360948:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3842707100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1870705581064704:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1784044385.361078:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044385.361415:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581064576 00000100:00100000:3.0:1784044385.361427:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581064576 00000100:00100000:3.0:1784044385.361477:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581064704 00000100:00100000:3.0:1784044385.361481:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581064704 00000100:00100000:3.0:1784044385.361500:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1784044385.361524:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39412ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1870705581064576:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1784044385.361576:0:17206:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1784044385.361636:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39412ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1870705581064576:12345-0@lo:41:osp-pre-1-0.0 Request processed in 115us (4097us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044385.361653:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1784044385.361676:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1784044385.361682:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3842705880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1870705581064704:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1784044385.361724:0:17206:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1784044385.361789:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3842705880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1870705581064704:12345-0@lo:41:osp-pre-0-1.0 Request processed in 96us (701us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044385.361795:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1784044385.361961:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397a8a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1870705581065472:0@lo:400:kworker.0 00000100:00100000:3.0:1784044385.361996:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044385.362027:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397a8a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3639:1870705581065984:0@lo:400:kworker.0 00000100:00100000:3.0:1784044385.362063:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044385.362093:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1784044385.362100:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397a8a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3639:1870705581065344:0@lo:400:kworker.0 00000100:00100000:3.0:1784044385.362123:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044385.362140:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397a8a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3639:1870705581065856:0@lo:400:kworker.0 00000100:00100000:3.0:1784044385.362162:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044385.362214:0:19739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581065984 00000100:00100000:3.0:1784044385.362218:0:19739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581065984 00000100:00100000:3.0:1784044385.362253:0:19739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581065344 00000100:00100000:3.0:1784044385.362256:0:19739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581065344 00000100:00100000:3.0:1784044385.362281:0:19739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581065856 00000100:00100000:3.0:1784044385.362284:0:19739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581065856 00000100:00100000:3.0:1784044385.362573:0:19739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1784044385.362582:0:19739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397a8a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1870705581065984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044385.362629:0:19739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397a8a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1870705581065984:12345-0@lo:400:kworker.0 Request processed in 47us (563us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044385.362831:0:19739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1784044385.362848:0:19739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1784044385.362854:0:19739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397a8a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1870705581065344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044385.362891:0:19739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397a8a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1870705581065344:12345-0@lo:400:kworker.0 Request processed in 38us (767us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044385.362898:0:19739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1784044385.362909:0:19739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1784044385.362915:0:19739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3844587480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1870705581065856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044385.362941:0:19739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3844587480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1870705581065856:12345-0@lo:400:kworker.0 Request processed in 27us (778us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044385.362948:0:19739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1784044385.362996:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397a8a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3639:1870705581065344:0@lo:400:kworker.0 00010000:00080000:3.0:1784044385.363014:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b397a8a7b80 x1870705581065856/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044401 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784044385.363026:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397a8a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3639:1870705581065856:0@lo:400:kworker.0 00000100:00100000:3.0:1784044385.363036:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397a8a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3639:1870705581065984:0@lo:400:kworker.0 00000100:00100000:3.0:1784044385.363091:0:18709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1784044385.363099:0:18709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397a8a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1870705581064960:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1784044385.363118:0:18709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1784044385.363158:0:18709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397a8a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1870705581064960:12345-0@lo:13:osp-pre-1-1.0 Request processed in 60us (5180us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044385.363164:0:18709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1784044385.364394:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397a8a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1870705581064960:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1784044385.364484:0:18708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581065472 00000100:00100000:3.0:1784044385.364492:0:18708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581065472 00000100:00100000:3.0:1784044385.364553:0:18708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1784044385.364561:0:18708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397a8a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1870705581065472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044385.364715:0:18708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397a8a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1870705581065472:12345-0@lo:400:kworker.0 Request processed in 153us (2716us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044385.364723:0:18708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1784044385.364766:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397a8a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1870705581065472:0@lo:400:kworker.0 00000100:00100000:3.0:1784044385.364861:0:3638:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934594 gen 2 00000100:00100000:3.0:1784044385.364882:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843e3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1870705581064832:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784044385.364961:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397a8a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1870705581065216:0@lo:400:kworker.0 00000100:00100000:3.0:1784044385.365003:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044385.365004:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397a8a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:99a46fb7-9af9-40f1-9c76-329d6781ee81:3640:1870705581065088:0@lo:400:kworker.0 00000100:00100000:1.0:1784044385.365026:0:18706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581065216 00000100:00100000:1.0:1784044385.365030:0:18706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581065216 00000100:00100000:3.0:1784044385.365033:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397a8a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3641:1870705581065728:0@lo:400:kworker.0 00000100:00100000:3.0:1784044385.365056:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044385.365072:0:18706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1784044385.365079:0:18706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3844584e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1870705581065216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044385.365083:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3842707100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1870705581064704:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1784044385.365107:0:19739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581065728 00000100:00100000:3.0:1784044385.365111:0:19739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581065728 00000100:00100000:3.0:1784044385.365140:0:19739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1784044385.365146:0:19739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3844585500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1870705581065728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044385.365206:0:19739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3844585500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1870705581065728:12345-0@lo:400:kworker.0 Request processed in 60us (149us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044385.365213:0:19739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1784044385.365216:0:18706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3844584e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1870705581065216:12345-0@lo:400:kworker.0 Request processed in 138us (214us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044385.365222:0:18706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1784044385.365239:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397a8a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1870705581065216:0@lo:400:kworker.0 00000100:00100000:3.0:1784044385.365250:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397a8a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3641:1870705581065728:0@lo:400:kworker.0 00000100:00100000:1.0:1784044385.365259:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044385.365285:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581065088 00000100:00100000:3.0:1784044385.365288:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581065088 00000100:00100000:1.0:1784044385.365290:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397a8a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1870705581065600:0@lo:400:kworker.0 00000100:00100000:1.0:1784044385.365313:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044385.365332:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581065600 00000100:00100000:1.0:1784044385.365341:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581065600 00000100:00100000:1.0:1784044385.365365:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1784044385.365371:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39412e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1870705581065600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044385.365401:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39412e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1870705581065600:12345-0@lo:400:kworker.0 Request processed in 30us (87us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044385.365408:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1784044385.365434:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397a8a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1870705581065600:0@lo:400:kworker.0 00000100:00100000:1.0:1784044385.365441:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397a8a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3640:1870705581066112:0@lo:400:kworker.0 00000100:00100000:1.0:1784044385.365464:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044385.365483:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581066112 00000100:00100000:1.0:1784044385.365486:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581066112 00000100:00100000:1.0:1784044385.365513:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1784044385.365519:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39412ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1870705581066112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044385.365549:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39412ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1870705581066112:12345-0@lo:400:kworker.0 Request processed in 30us (84us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044385.365556:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00010000:00080000:1.0:1784044385.365582:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b397a8a5f80 x1870705581066112/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044401 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784044385.365594:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397a8a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3640:1870705581066112:0@lo:400:kworker.0 00000100:00100000:1.0:1784044385.365611:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397a8a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1870705581064576:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1784044385.366469:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1784044385.366479:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397424e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99a46fb7-9af9-40f1-9c76-329d6781ee81+24:3640:x1870705581065088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044385.366548:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397424e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99a46fb7-9af9-40f1-9c76-329d6781ee81+24:3640:x1870705581065088:12345-0@lo:400:kworker.0 Request processed in 71us (1287us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044385.366556:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00080000:2.0:1784044385.366575:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1784044385.366587:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1784044385.366591:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1784044385.366594:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784044385.367375:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397a8a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:99a46fb7-9af9-40f1-9c76-329d6781ee81:3640:1870705581065088:0@lo:400:kworker.0 00000040:00080000:1.0:1784044385.686881:0:17236:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:00100000:3.0:1784044385.878422:0:17933:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 35f5085c-0464-4087-9b4b-890cdd0735b4 00000001:00100000:3.0:1784044385.878444:0:17933:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of ffd836bb-8324-4bbb-bdb8-ace806f205ee 00000001:00100000:1.0:1784044385.883610:0:17179:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 35f5085c-0464-4087-9b4b-890cdd0735b4 00000001:00100000:1.0:1784044385.883624:0:17179:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of ffd836bb-8324-4bbb-bdb8-ace806f205ee 00000001:00100000:0.0:1784044385.883815:0:18702:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 35f5085c-0464-4087-9b4b-890cdd0735b4 00000001:00100000:0.0:1784044385.883836:0:18702:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of ffd836bb-8324-4bbb-bdb8-ace806f205ee 00000001:02000400:3.0:1784044386.276632:0:20079:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:2.0:1784044386.318636:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784044387.341569:0:19100:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784044388.083780:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044388.084780:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044388.085268:0:18572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565234688 00000100:00100000:3.0:1784044388.085279:0:18572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565234688 00000100:00100000:3.0:1784044388.085360:0:18572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 58 00000100:00100000:3.0:1784044388.085371:0:18572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3842704a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ffd836bb-8324-4bbb-bdb8-ace806f205ee+6:2408:x1870705565234688:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:3.0:1784044388.085468:0:18572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3842704a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ffd836bb-8324-4bbb-bdb8-ace806f205ee+6:2408:x1870705565234688:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 99us (693us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044388.085477:0:18572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 58 00000100:00080000:0.0:1784044388.086008:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784044388.089936:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044388.089987:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044388.090012:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044388.090030:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044388.090047:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044388.090063:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044388.090101:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044388.090130:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565235200 00000100:00100000:3.0:1784044388.090141:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565235200 00000100:00100000:3.0:1784044388.090247:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565234816 00000100:00100000:3.0:1784044388.090251:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565234816 00000100:00100000:3.0:1784044388.090271:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565235328 00000100:00100000:3.0:1784044388.090274:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565235328 00000100:00100000:3.0:1784044388.090293:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 59 00000100:00100000:3.0:1784044388.090303:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3844585180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35f5085c-0464-4087-9b4b-890cdd0735b4+6:2407:x1870705565235200:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:3.0:1784044388.090394:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3844585180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35f5085c-0464-4087-9b4b-890cdd0735b4+6:2407:x1870705565235200:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 92us (405us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044388.090401:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 59 00000100:00100000:3.0:1784044388.090419:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 60 00000100:00100000:3.0:1784044388.090425:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3844587100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ffd836bb-8324-4bbb-bdb8-ace806f205ee+5:2407:x1870705565234816:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:3.0:1784044388.090448:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3844587100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ffd836bb-8324-4bbb-bdb8-ace806f205ee+5:2407:x1870705565234816:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 24us (418us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044388.090469:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 60 00000100:00100000:3.0:1784044388.090482:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 61 00000100:00100000:3.0:1784044388.090489:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3844585880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35f5085c-0464-4087-9b4b-890cdd0735b4+5:2407:x1870705565235328:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:3.0:1784044388.090512:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3844585880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35f5085c-0464-4087-9b4b-890cdd0735b4+5:2407:x1870705565235328:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 25us (448us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044388.090518:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 61 00000100:00100000:3.0:1784044388.090536:0:18707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565234944 00000100:00100000:3.0:1784044388.090538:0:18707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565234944 00000100:00100000:3.0:1784044388.090557:0:18707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565235456 00000100:00100000:3.0:1784044388.090559:0:18707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565235456 00000100:00100000:3.0:1784044388.090570:0:18707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565235072 00000100:00100000:3.0:1784044388.090572:0:18707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565235072 00000100:00100000:3.0:1784044388.090582:0:18707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565235584 00000100:00100000:3.0:1784044388.090584:0:18707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565235584 00000100:00100000:3.0:1784044388.090596:0:18707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 15 00000100:00100000:3.0:1784044388.090602:0:18707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3844584380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ffd836bb-8324-4bbb-bdb8-ace806f205ee+5:2407:x1870705565234944:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:3.0:1784044388.090626:0:18707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3844584380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ffd836bb-8324-4bbb-bdb8-ace806f205ee+5:2407:x1870705565234944:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 24us (704us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044388.090642:0:18707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 15 00000100:00100000:3.0:1784044388.090653:0:18707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16 00000100:00100000:3.0:1784044388.090658:0:18707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3844585c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:35f5085c-0464-4087-9b4b-890cdd0735b4+5:2407:x1870705565235456:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:3.0:1784044388.090682:0:18707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3844585c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:35f5085c-0464-4087-9b4b-890cdd0735b4+5:2407:x1870705565235456:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 25us (670us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044388.090688:0:18707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16 00000100:00100000:3.0:1784044388.090698:0:18707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 17 00000100:00100000:3.0:1784044388.090703:0:18707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3844586680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ffd836bb-8324-4bbb-bdb8-ace806f205ee+5:2407:x1870705565235072:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:3.0:1784044388.090736:0:18707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3844586680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ffd836bb-8324-4bbb-bdb8-ace806f205ee+5:2407:x1870705565235072:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 33us (688us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044388.090742:0:18707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 17 00000100:00100000:3.0:1784044388.090752:0:18707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 18 00000100:00100000:3.0:1784044388.090758:0:18707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3844586d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:35f5085c-0464-4087-9b4b-890cdd0735b4+6:2407:x1870705565235584:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:3.0:1784044388.090779:0:18707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3844586d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:35f5085c-0464-4087-9b4b-890cdd0735b4+6:2407:x1870705565235584:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 22us (678us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044388.090785:0:18707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 18 00000100:00080000:3.0:1784044388.090825:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1784044388.090830:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1784044388.090833:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1784044388.090835:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784044388.091942:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565234560 00000100:00100000:1.0:1784044388.091953:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565234560 00000100:00100000:3.0:1784044388.092451:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 151 00000100:00100000:3.0:1784044388.092468:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397424e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cf001828-7720-4c65-ba45-a14bcd113197+13:2408:x1870705565234560:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:3.0:1784044388.092543:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397424e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cf001828-7720-4c65-ba45-a14bcd113197+13:2408:x1870705565234560:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 84us (8775us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044388.092563:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 151 00010000:00010000:0.0:1784044388.365372:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784044388.432159:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784044388.432212:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3844584000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1870705581066240:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784044388.432291:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044388.432339:0:18709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581066240 00000100:00100000:1.0:1784044388.432349:0:18709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581066240 00000100:00100000:1.0:1784044388.432415:0:18709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1784044388.432426:0:18709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3844587800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1870705581066240:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1784044388.432459:0:18709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1784044388.432505:0:18709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3844587800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1870705581066240:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (214us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044388.432513:0:18709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:1.0:1784044388.432537:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784044388.432571:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3844584000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1870705581066240:0@lo:13:osp-pre-0-0.0 00000001:00100000:2.0:1784044388.953378:0:19522:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 35f5085c-0464-4087-9b4b-890cdd0735b4 00010000:00010000:2.0:1784044389.390474:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784044389.457973:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843e38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1870705581066368:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1784044389.458047:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044389.460475:0:18709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581066368 00000100:00100000:0.0:1784044389.460486:0:18709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581066368 00000100:00100000:0.0:1784044389.460555:0:18709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1784044389.460565:0:18709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3844584700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1870705581066368:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1784044389.460590:0:18709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1784044389.460675:0:18709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3844584700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1870705581066368:12345-0@lo:13:osp-pre-0-1.0 Request processed in 111us (2628us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044389.460683:0:18709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1784044389.460750:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843e38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1870705581066368:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1784044389.474210:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:2.0:1784044390.353251:0:17952:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1784044390.413571:0:19100:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784044390.477397:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3844586a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1870705581066496:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1784044390.477489:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044390.477672:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581066496 00000100:00100000:3.0:1784044390.477682:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581066496 00000100:00100000:3.0:1784044390.477749:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1784044390.477759:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39412ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1870705581066496:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1784044390.477795:0:17206:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1784044390.477855:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39412ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1870705581066496:12345-0@lo:41:osp-pre-1-0.0 Request processed in 97us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044390.477863:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1784044390.477985:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3844586a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1870705581066496:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1784044390.478316:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3844587b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1870705581066752:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1784044390.478324:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843e3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1870705581066880:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784044390.478347:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044390.478362:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044390.478369:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1784044390.478374:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3844586300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1870705581066624:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1784044390.478389:0:18710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581066752 00000100:00100000:2.0:1784044390.478392:0:18710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581066752 00000100:00100000:3.0:1784044390.478396:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044390.478418:0:18709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581066880 00000100:00100000:3.0:1784044390.478421:0:18709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581066880 00000100:00100000:2.0:1784044390.478425:0:18710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1784044390.478430:0:18710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3844585f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1870705581066752:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1784044390.478449:0:18710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1784044390.478453:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581066624 00000100:00100000:3.0:1784044390.478456:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581066624 00000100:00100000:3.0:1784044390.478469:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1784044390.478474:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3844584a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1870705581066624:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1784044390.478481:0:18710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3844585f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1870705581066752:12345-0@lo:13:osp-pre-1-1.0 Request processed in 51us (134us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044390.478487:0:18710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000004:00000024:3.0:1784044390.478491:0:17206:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1784044390.478499:0:18710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1784044390.478505:0:18710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843e39f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1870705581066880:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1784044390.478513:0:18710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1784044390.478525:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3844584a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1870705581066624:12345-0@lo:41:osp-pre-0-1.0 Request processed in 51us (128us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044390.478532:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1784044390.478533:0:18710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843e39f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1870705581066880:12345-0@lo:13:osp-pre-1-0.0 Request processed in 28us (170us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044390.478537:0:18710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:2.0:1784044390.478548:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784044390.478557:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3844586300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1870705581066624:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1784044390.478564:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843e3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1870705581066880:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784044390.478566:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3844587b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1870705581066752:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1784044390.478821:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39412e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1870705581067136:0@lo:400:kworker.0 00000100:00100000:1.0:1784044390.478852:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044390.478869:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39412eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3640:1870705581067648:0@lo:400:kworker.0 00000100:00100000:1.0:1784044390.478892:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044390.478907:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1784044390.478912:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39412e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1870705581067264:0@lo:400:kworker.0 00000100:00100000:1.0:1784044390.478932:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044390.478953:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843737800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1870705581067776:0@lo:400:kworker.0 00000100:00100000:1.0:1784044390.478973:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044390.478994:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39412ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1870705581067392:0@lo:400:kworker.0 00000100:00100000:1.0:1784044390.479022:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044390.479039:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843735180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3638:1870705581067904:0@lo:400:kworker.0 00000100:00100000:1.0:1784044390.479059:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044390.479073:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1784044390.479078:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39412eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:99a46fb7-9af9-40f1-9c76-329d6781ee81:3638:1870705581067008:0@lo:400:kworker.0 00000100:00100000:1.0:1784044390.479103:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044390.479127:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39412eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1870705581067520:0@lo:400:kworker.0 00000100:00100000:1.0:1784044390.479164:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044390.479199:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843734a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3638:1870705581068032:0@lo:400:kworker.0 00000100:00100000:1.0:1784044390.479220:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044390.479241:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581067008 00000100:00100000:1.0:1784044390.479245:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581067008 00000100:00100000:1.0:1784044390.479272:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1784044390.479279:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397424cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99a46fb7-9af9-40f1-9c76-329d6781ee81+24:3638:x1870705581067008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044390.479314:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397424cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99a46fb7-9af9-40f1-9c76-329d6781ee81+24:3638:x1870705581067008:12345-0@lo:400:kworker.0 Request processed in 35us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044390.479320:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1784044390.479359:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39412eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:99a46fb7-9af9-40f1-9c76-329d6781ee81:3638:1870705581067008:0@lo:400:kworker.0 00000100:00100000:3.0:1784044390.482206:0:18707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581067136 00000100:00100000:3.0:1784044390.482227:0:18707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581067136 00000100:00100000:3.0:1784044390.482307:0:18707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581067392 00000100:00100000:3.0:1784044390.482311:0:18707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581067392 00000100:00100000:3.0:1784044390.482352:0:18707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1784044390.482365:0:18707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843735500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1870705581067136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044390.482487:0:18707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843735500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1870705581067136:12345-0@lo:400:kworker.0 Request processed in 124us (3633us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044390.482494:0:18707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1784044390.482510:0:18707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1784044390.482516:0:18707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843735c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1870705581067392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044390.482548:0:18707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843735c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1870705581067392:12345-0@lo:400:kworker.0 Request processed in 32us (3524us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044390.482554:0:18707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1784044390.482577:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581067648 00000100:00100000:3.0:1784044390.482581:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581067648 00000100:00100000:3.0:1784044390.482599:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581067264 00000100:00100000:3.0:1784044390.482601:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581067264 00000100:00100000:3.0:1784044390.482609:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581067776 00000100:00100000:3.0:1784044390.482611:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581067776 00000100:00100000:3.0:1784044390.482638:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581067904 00000100:00100000:3.0:1784044390.482641:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581067904 00000100:00100000:3.0:1784044390.482652:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581067520 00000100:00100000:3.0:1784044390.482667:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581067520 00000100:00100000:3.0:1784044390.482681:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581068032 00000100:00100000:3.0:1784044390.482683:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581068032 00000100:00100000:3.0:1784044390.482727:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1784044390.482733:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843736a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1870705581067648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044390.482766:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843736a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1870705581067648:12345-0@lo:400:kworker.0 Request processed in 33us (3873us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044390.482772:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1784044390.482782:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1784044390.482788:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843737480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1870705581067264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044390.482816:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843737480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1870705581067264:12345-0@lo:400:kworker.0 Request processed in 29us (3883us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044390.482821:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1784044390.482831:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1784044390.482837:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843737100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1870705581067776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044390.482862:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843737100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1870705581067776:12345-0@lo:400:kworker.0 Request processed in 26us (3888us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044390.482868:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1784044390.482878:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1784044390.482883:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843734700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1870705581067904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044390.482906:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843734700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1870705581067904:12345-0@lo:400:kworker.0 Request processed in 23us (3847us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044390.482910:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1784044390.482919:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1784044390.482923:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843736680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1870705581067520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044390.482947:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843736680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1870705581067520:12345-0@lo:400:kworker.0 Request processed in 24us (3797us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044390.482959:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1784044390.482970:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1784044390.482975:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843ca8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1870705581068032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044390.483005:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843ca8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1870705581068032:12345-0@lo:400:kworker.0 Request processed in 30us (3784us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044390.483011:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1784044390.483083:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39412e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1870705581067264:0@lo:400:kworker.0 00010000:00080000:3.0:1784044390.483098:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b3843737800 x1870705581067776/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044406 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784044390.483107:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843737800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1870705581067776:0@lo:400:kworker.0 00000100:00100000:3.0:1784044390.483118:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39412e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1870705581067136:0@lo:400:kworker.0 00000100:00100000:3.0:1784044390.483127:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39412eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3640:1870705581067648:0@lo:400:kworker.0 00000100:00100000:3.0:1784044390.483204:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39412eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1870705581067520:0@lo:400:kworker.0 00010000:00080000:3.0:1784044390.483222:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b3843734a80 x1870705581068032/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044406 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784044390.483230:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843734a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3638:1870705581068032:0@lo:400:kworker.0 00000100:00100000:3.0:1784044390.483240:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39412ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1870705581067392:0@lo:400:kworker.0 00000100:00100000:3.0:1784044390.483248:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843735180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3638:1870705581067904:0@lo:400:kworker.0 00000100:00080000:1.0:1784044390.483858:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1784044390.483863:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1784044390.483867:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00000080:2.0:1784044390.681311:0:20226:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe942e05b0 20000000:00000080:2.0:1784044390.681329:0:20226:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9b3843455c00 uarg=0000000000000000 20000000:01000000:2.0:1784044390.681373:0:20226:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1784044390.681379:0:20226:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1784044390.681385:0:20226:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1784044390.681958:0:20227:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 13 20000000:00000400:1.0:1784044390.682101:0:20226:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:1.0:1784044390.697540:0:20226:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1784044390.697613:0:20226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b397cb19400/0x89871fc3aba19630 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044390.697638:0:20226:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b38410b6200/0x89871fc3aba192c5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x89871fc3aba192be expref: 23 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044390.697667:0:20226:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b38426fc000/0x89871fc3aba192d3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x89871fc3aba192cc expref: 23 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044390.697674:0:20226:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b38410b7600/0x89871fc3aba19312 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x89871fc3aba1930b expref: 23 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044390.697681:0:20226:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b3982054800/0x89871fc3aba19470 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x89871fc3aba19469 expref: 23 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044390.697703:0:20226:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b38410b6400/0x89871fc3aba195c0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6a67 expref: 12 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044390.697711:0:20226:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b38410b6c00/0x89871fc3aba195ff lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6ad7 expref: 12 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044390.697720:0:20226:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b397cb19400/0x89871fc3aba19630 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 20226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044390.697774:0:20226:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b38410b6c00/0x89871fc3aba195ff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6ad7 expref: 12 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044390.697790:0:20226:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b38410b6c00/0x89871fc3aba195ff lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6ad7 expref: 12 pid: 17193 timeout: 683 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044390.697808:0:20226:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843cabb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20226:1870705581068160:192.168.202.40@tcp:104: 00010000:00010000:1.0:1784044390.698820:0:20226:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b38410b6400/0x89871fc3aba195c0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6a67 expref: 12 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044390.698832:0:20226:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b38410b6400/0x89871fc3aba195c0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6a67 expref: 12 pid: 17193 timeout: 683 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044390.698853:0:20226:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843ca8700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20226:1870705581068288:192.168.202.40@tcp:104: 00010000:00010000:1.0:1784044390.698895:0:20226:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b3982054800/0x89871fc3aba19470 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x89871fc3aba19469 expref: 23 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044390.698903:0:20226:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b3982054800/0x89871fc3aba19470 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x89871fc3aba19469 expref: 23 pid: 17193 timeout: 683 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044390.698913:0:20226:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843caad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20226:1870705581068416:0@lo:104: 00000100:00100000:1.0:1784044390.698952:0:20226:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1784044390.702061:0:20226:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b38410b7600/0x89871fc3aba19312 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x89871fc3aba1930b expref: 23 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044390.702081:0:20226:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b38410b7600/0x89871fc3aba19312 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x89871fc3aba1930b expref: 23 pid: 17194 timeout: 683 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044390.702099:0:20226:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843caa680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20226:1870705581068544:0@lo:104: 00000100:00100000:1.0:1784044390.702191:0:20226:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044390.702248:0:17183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581068416 00000100:00100000:1.0:1784044390.702256:0:17183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581068416 00000100:00100000:1.0:1784044390.702301:0:17183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581068544 00000100:00100000:1.0:1784044390.702304:0:17183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581068544 00000100:00100000:1.0:1784044390.702319:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1784044390.702327:0:17183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843caa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:99a46fb7-9af9-40f1-9c76-329d6781ee81+4:20226:x1870705581068416:12345-0@lo:104: 00010000:00010000:1.0:1784044390.702341:0:17183:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.140@tcp lock: ffff9b38410b6800/0x89871fc3aba19469 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x89871fc3aba19470 expref: -99 pid: 19521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044390.702395:0:17183:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1784044390.702401:0:17183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843caa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:99a46fb7-9af9-40f1-9c76-329d6781ee81+4:20226:x1870705581068416:12345-0@lo:104: Request processed in 74us (3449us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044390.702424:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1784044390.702519:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1784044390.702526:0:17183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843cab100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:99a46fb7-9af9-40f1-9c76-329d6781ee81+3:20226:x1870705581068544:12345-0@lo:104: 00010000:00010000:1.0:1784044390.702534:0:17183:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.140@tcp lock: ffff9b3982055000/0x89871fc3aba1930b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x89871fc3aba19312 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044390.702578:0:17183:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1784044390.702584:0:17183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843cab100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:99a46fb7-9af9-40f1-9c76-329d6781ee81+3:20226:x1870705581068544:12345-0@lo:104: Request processed in 59us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044390.702589:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:1.0:1784044390.702624:0:20226:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b38426fc000/0x89871fc3aba192d3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x89871fc3aba192cc expref: 23 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044390.702633:0:20226:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b38426fc000/0x89871fc3aba192d3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x89871fc3aba192cc expref: 23 pid: 17193 timeout: 683 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044390.702642:0:20226:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843ca8380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20226:1870705581068672:0@lo:104: 00000100:00100000:1.0:1784044390.702664:0:20226:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044390.702681:0:17183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581068672 00000100:00100000:1.0:1784044390.702684:0:17183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581068672 00000100:00100000:1.0:1784044390.702728:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1784044390.702735:0:17183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843ca8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:99a46fb7-9af9-40f1-9c76-329d6781ee81+3:20226:x1870705581068672:12345-0@lo:104: 00010000:00010000:1.0:1784044390.702743:0:17183:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.140@tcp lock: ffff9b3982055200/0x89871fc3aba192cc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x89871fc3aba192d3 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044390.702774:0:17183:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1784044390.702779:0:17183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843ca8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:99a46fb7-9af9-40f1-9c76-329d6781ee81+3:20226:x1870705581068672:12345-0@lo:104: Request processed in 45us (115us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044390.702794:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:1.0:1784044390.702812:0:19100:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1784044390.702818:0:19100:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: ffff9b38410b6800/0x89871fc3aba19469 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x89871fc3aba19470 expref: -99 pid: 19521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044390.702826:0:19100:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38410b6800 already unused, calling callback (ffffffffc113cc20) 10000000:00010000:1.0:1784044390.702831:0:19100:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: ffff9b38410b6800/0x89871fc3aba19469 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x89871fc3aba19470 expref: -99 pid: 19521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044390.702839:0:19100:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9b38410b6800/0x89871fc3aba19469 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x89871fc3aba19470 expref: -99 pid: 19521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784044390.702848:0:19100:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9b38410b6800/0x89871fc3aba19469 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x89871fc3aba19470 expref: -99 pid: 19521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784044390.702854:0:19100:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1784044390.702882:0:19100:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.140@tcp lock: ffff9b38410b6800/0x89871fc3aba19469 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x89871fc3aba19470 expref: -99 pid: 19521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044390.702889:0:19100:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784044390.703072:0:17187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1784044390.703079:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: ffff9b3982055000/0x89871fc3aba1930b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x89871fc3aba19312 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044390.703087:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3982055000 already unused, calling callback (ffffffffc113cc20) 10000000:00010000:0.0:1784044390.703091:0:17187:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: ffff9b3982055000/0x89871fc3aba1930b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x89871fc3aba19312 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044390.703098:0:17187:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9b3982055000/0x89871fc3aba1930b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x89871fc3aba19312 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784044390.703105:0:17187:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9b3982055000/0x89871fc3aba1930b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x89871fc3aba19312 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784044390.703110:0:17187:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1784044390.703134:0:17187:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.140@tcp lock: ffff9b3982055000/0x89871fc3aba1930b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x89871fc3aba19312 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044390.703140:0:17187:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784044390.703226:0:17188:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784044390.705626:0:20228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784044390.705651:0:17188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: ffff9b3982055200/0x89871fc3aba192cc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x89871fc3aba192d3 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044390.705697:0:17188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3982055200 already unused, calling callback (ffffffffc113cc20) 10000000:00010000:2.0:1784044390.705701:0:17188:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: ffff9b3982055200/0x89871fc3aba192cc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x89871fc3aba192d3 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044390.705711:0:17188:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9b3982055200/0x89871fc3aba192cc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x89871fc3aba192d3 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784044390.705719:0:17188:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9b3982055200/0x89871fc3aba192cc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x89871fc3aba192d3 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784044390.705725:0:17188:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1784044390.705767:0:17188:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.140@tcp lock: ffff9b3982055200/0x89871fc3aba192cc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x89871fc3aba192d3 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044390.705774:0:17188:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1784044390.708227:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044390.708293:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044390.708326:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565235712 00000100:00100000:3.0:1784044390.708347:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565235712 00010000:00010000:3.0:1784044390.708386:0:17185:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b38410b6c00/0x89871fc3aba195ff lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6ad7 expref: 13 pid: 17193 timeout: 683 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044390.708423:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565235840 00000100:00100000:3.0:1784044390.708427:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565235840 00010000:00010000:3.0:1784044390.708445:0:17185:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b38410b6400/0x89871fc3aba195c0 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6a67 expref: 14 pid: 17193 timeout: 683 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044390.708463:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 9 00000100:00100000:3.0:1784044390.708472:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3844587b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cf001828-7720-4c65-ba45-a14bcd113197+14:2409:x1870705565235712:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784044390.708489:0:17185:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784044390.708494:0:17185:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b38410b6c00/0x89871fc3aba195ff lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6ad7 expref: 14 pid: 17193 timeout: 683 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044390.708505:0:17185:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b38410b6c00/0x89871fc3aba195ff lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6ad7 expref: 14 pid: 17193 timeout: 683 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044390.708528:0:17185:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784044390.708950:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3844587b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cf001828-7720-4c65-ba45-a14bcd113197+14:2409:x1870705565235712:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 476us (730us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044390.708960:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 9 00000100:00100000:3.0:1784044390.708982:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 10 00000100:00100000:3.0:1784044390.708989:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3844586300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cf001828-7720-4c65-ba45-a14bcd113197+13:2409:x1870705565235840:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784044390.708998:0:17185:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784044390.709003:0:17185:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b38410b6400/0x89871fc3aba195c0 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6a67 expref: 13 pid: 17193 timeout: 683 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044390.709010:0:17185:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b38410b6400/0x89871fc3aba195c0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6a67 expref: 13 pid: 17193 timeout: 683 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044390.709025:0:17185:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784044390.709041:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3844586300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cf001828-7720-4c65-ba45-a14bcd113197+13:2409:x1870705565235840:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 54us (750us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044390.709046:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 10 00010000:00010000:1.0:1784044390.709191:0:19100:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: ffff9b38410b6800/0x89871fc3aba19469 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x89871fc3aba19470 expref: -99 pid: 19521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044390.709199:0:19100:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9b38410b6800/0x89871fc3aba19469 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x89871fc3aba19470 expref: -99 pid: 19521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044390.709217:0:19100:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784044390.709219:0:19100:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784044390.709220:0:19100:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784044390.710079:0:20226:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b38410b6200/0x89871fc3aba192c5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x89871fc3aba192be expref: 23 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044390.710100:0:20226:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b38410b6200/0x89871fc3aba192c5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x89871fc3aba192be expref: 23 pid: 17193 timeout: 683 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044390.710112:0:20226:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843ca9180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20226:1870705581069184:0@lo:104: 00000100:00100000:1.0:1784044390.710171:0:20226:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044390.710221:0:17183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581069184 00000100:00100000:1.0:1784044390.710226:0:17183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581069184 00000100:00100000:1.0:1784044390.710259:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1784044390.710264:0:17183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843ca8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:99a46fb7-9af9-40f1-9c76-329d6781ee81+3:20226:x1870705581069184:12345-0@lo:104: 00010000:00010000:1.0:1784044390.710278:0:17183:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.140@tcp lock: ffff9b3843798400/0x89871fc3aba192be lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x89871fc3aba192c5 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044390.710318:0:17183:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1784044390.710323:0:17183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843ca8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:99a46fb7-9af9-40f1-9c76-329d6781ee81+3:20226:x1870705581069184:12345-0@lo:104: Request processed in 59us (152us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044390.710329:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:1.0:1784044390.710346:0:19100:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784044390.710351:0:19100:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: ffff9b3843798400/0x89871fc3aba192be lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x89871fc3aba192c5 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044390.710358:0:19100:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3843798400 already unused, calling callback (ffffffffc113cc20) 10000000:00010000:1.0:1784044390.710362:0:19100:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: ffff9b3843798400/0x89871fc3aba192be lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x89871fc3aba192c5 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044390.710370:0:19100:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9b3843798400/0x89871fc3aba192be lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x89871fc3aba192c5 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784044390.710377:0:19100:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9b3843798400/0x89871fc3aba192be lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x89871fc3aba192c5 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784044390.710391:0:19100:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1784044390.710414:0:19100:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.140@tcp lock: ffff9b3843798400/0x89871fc3aba192be lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x89871fc3aba192c5 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044390.710523:0:19100:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1784044390.710667:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843ca9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:99a46fb7-9af9-40f1-9c76-329d6781ee81:3640:1870705581068800:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784044390.710714:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1784044390.710794:0:17188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: ffff9b3982055200/0x89871fc3aba192cc lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x89871fc3aba192d3 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044390.710802:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9b3982055200/0x89871fc3aba192cc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x89871fc3aba192d3 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044390.710817:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784044390.710818:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784044390.710820:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784044390.710837:0:20228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784044390.710840:0:20228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784044390.710898:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: ffff9b3982055000/0x89871fc3aba1930b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x89871fc3aba19312 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044390.710906:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9b3982055000/0x89871fc3aba1930b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x89871fc3aba19312 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044390.710916:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784044390.710917:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784044390.710923:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784044390.710935:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3842705f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:99a46fb7-9af9-40f1-9c76-329d6781ee81:3641:1870705581068928:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784044390.710963:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044390.711026:0:20226:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3843703780 going to sleep for 11 seconds 00010000:00010000:0.0:1784044390.711053:0:20226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b38410b6c00/0x89871fc3aba195ff lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6ad7 expref: 12 pid: 17193 timeout: 683 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044390.711063:0:20226:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843cabb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20226:1870705581068160:192.168.202.40@tcp:104: 00010000:00010000:0.0:1784044390.711073:0:20226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b38410b6400/0x89871fc3aba195c0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6a67 expref: 11 pid: 17193 timeout: 683 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044390.711080:0:20226:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843ca8700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20226:1870705581068288:192.168.202.40@tcp:104: 00000100:00100000:0.0:1784044390.711088:0:20226:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843caad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20226:1870705581068416:0@lo:104: 00000100:00100000:0.0:1784044390.711095:0:20226:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843caa680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20226:1870705581068544:0@lo:104: 00000100:00100000:0.0:1784044390.711102:0:20226:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843ca8380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20226:1870705581068672:0@lo:104: 00000100:00100000:0.0:1784044390.711108:0:20226:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843ca9180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20226:1870705581069184:0@lo:104: 00010000:00010000:0.0:1784044390.711144:0:20226:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b397cb19400/0x89871fc3aba19630 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 20226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044390.711205:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843e3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:99a46fb7-9af9-40f1-9c76-329d6781ee81:3638:1870705581069056:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784044390.711230:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044390.711281:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581068800 00000100:00100000:2.0:1784044390.711287:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581068800 00010000:00010000:2.0:1784044390.711312:0:17186:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b3982054800/0x89871fc3aba19470 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x89871fc3aba19469 expref: 24 pid: 17193 timeout: 683 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044390.711341:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581068928 00000100:00100000:2.0:1784044390.711344:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581068928 00010000:00010000:2.0:1784044390.711357:0:17186:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b38410b7600/0x89871fc3aba19312 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x89871fc3aba1930b expref: 25 pid: 17194 timeout: 683 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044390.711366:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581069056 00000100:00100000:2.0:1784044390.711368:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581069056 00010000:00010000:2.0:1784044390.711378:0:17186:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b38426fc000/0x89871fc3aba192d3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x89871fc3aba192cc expref: 26 pid: 17193 timeout: 683 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044390.711391:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1784044390.711398:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3844586a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:99a46fb7-9af9-40f1-9c76-329d6781ee81+26:3640:x1870705581068800:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784044390.711409:0:17186:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784044390.711415:0:17186:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b3982054800/0x89871fc3aba19470 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x89871fc3aba19469 expref: 26 pid: 17193 timeout: 683 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044390.711425:0:17186:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b3982054800/0x89871fc3aba19470 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x89871fc3aba19469 expref: 26 pid: 17193 timeout: 683 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044390.711452:0:17186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b3982054800/0x89871fc3aba19470 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x89871fc3aba19469 expref: 26 pid: 17193 timeout: 683 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044390.711472:0:17186:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784044390.711503:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3844586a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:99a46fb7-9af9-40f1-9c76-329d6781ee81+25:3640:x1870705581068800:12345-0@lo:103:ldlm_bl.0 Request processed in 105us (788us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044390.711510:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1784044390.711525:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1784044390.711531:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3842704700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:99a46fb7-9af9-40f1-9c76-329d6781ee81+24:3641:x1870705581068928:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784044390.711550:0:17186:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784044390.711554:0:17186:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b38410b7600/0x89871fc3aba19312 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x89871fc3aba1930b expref: 24 pid: 17194 timeout: 683 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044390.711563:0:17186:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b38410b7600/0x89871fc3aba19312 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x89871fc3aba1930b expref: 24 pid: 17194 timeout: 683 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044390.711573:0:17186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b38410b7600/0x89871fc3aba19312 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x89871fc3aba1930b expref: 24 pid: 17194 timeout: 683 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044390.711581:0:17186:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784044390.711608:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3842704700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:99a46fb7-9af9-40f1-9c76-329d6781ee81+23:3641:x1870705581068928:12345-0@lo:103:ldlm_bl.0 Request processed in 78us (645us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044390.711614:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1784044390.711625:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1784044390.711629:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397b96c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:99a46fb7-9af9-40f1-9c76-329d6781ee81+22:3638:x1870705581069056:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784044390.711635:0:17186:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784044390.711639:0:17186:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b38426fc000/0x89871fc3aba192d3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x89871fc3aba192cc expref: 22 pid: 17193 timeout: 683 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044390.711646:0:17186:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b38426fc000/0x89871fc3aba192d3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x89871fc3aba192cc expref: 22 pid: 17193 timeout: 683 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044390.711655:0:17186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b38426fc000/0x89871fc3aba192d3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x89871fc3aba192cc expref: 22 pid: 17193 timeout: 683 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044390.711662:0:17186:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784044390.713274:0:19100:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: ffff9b3843798400/0x89871fc3aba192be lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x89871fc3aba192c5 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044390.713290:0:19100:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9b3843798400/0x89871fc3aba192be lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x89871fc3aba192c5 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044390.713315:0:19100:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784044390.713318:0:19100:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784044390.713320:0:19100:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784044390.713490:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843ca9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:99a46fb7-9af9-40f1-9c76-329d6781ee81:3640:1870705581068800:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784044390.714145:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397b96c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:99a46fb7-9af9-40f1-9c76-329d6781ee81+21:3638:x1870705581069056:12345-0@lo:103:ldlm_bl.0 Request processed in 2509us (2908us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044390.714214:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1784044390.714667:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843ca9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:99a46fb7-9af9-40f1-9c76-329d6781ee81:3639:1870705581069312:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784044390.714752:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044390.715075:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581069312 00000100:00100000:3.0:1784044390.715082:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581069312 00010000:00010000:3.0:1784044390.715118:0:17185:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b38410b6200/0x89871fc3aba192c5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x89871fc3aba192be expref: 21 pid: 17193 timeout: 683 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044390.715347:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1784044390.715357:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843caaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:99a46fb7-9af9-40f1-9c76-329d6781ee81+21:3639:x1870705581069312:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784044390.715374:0:17185:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784044390.715381:0:17185:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b38410b6200/0x89871fc3aba192c5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x89871fc3aba192be expref: 21 pid: 17193 timeout: 683 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044390.715395:0:17185:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b38410b6200/0x89871fc3aba192c5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x89871fc3aba192be expref: 21 pid: 17193 timeout: 683 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044390.715414:0:17185:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b38410b6200/0x89871fc3aba192c5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x89871fc3aba192be expref: 21 pid: 17193 timeout: 683 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044390.715443:0:17185:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b397cb19400/0x89871fc3aba19630 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 20226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044390.715467:0:17185:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b397cb19400/0x89871fc3aba19630 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 20226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044390.715485:0:17185:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b397cb19400/0x89871fc3aba19630 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 20226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044390.715494:0:17185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b397cb19400/0x89871fc3aba19630 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044390.715501:0:17185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b397cb19400/0x89871fc3aba19630 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044390.715508:0:17185:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b397cb19400/0x89871fc3aba19630 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044390.715515:0:17185:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b397cb19400 already unused, calling callback (ffffffffc0b56230) 00010000:00010000:3.0:1784044390.715519:0:17185:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b397cb19400/0x89871fc3aba19630 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044390.715528:0:17185:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b397cb19400/0x89871fc3aba19630 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 20226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044390.715545:0:17185:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b397cb19400/0x89871fc3aba19630 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044390.715556:0:17185:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784044390.715600:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843caaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:99a46fb7-9af9-40f1-9c76-329d6781ee81+20:3639:x1870705581069312:12345-0@lo:103:ldlm_bl.0 Request processed in 244us (848us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044390.715608:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1784044390.715831:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843e3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:99a46fb7-9af9-40f1-9c76-329d6781ee81:3638:1870705581069056:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784044390.715878:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3842705f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:99a46fb7-9af9-40f1-9c76-329d6781ee81:3641:1870705581068928:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784044390.715904:0:20226:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b397cb19400/0x89871fc3aba19630 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044390.715913:0:20226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b397cb19400/0x89871fc3aba19630 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044390.715919:0:20226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b397cb19400/0x89871fc3aba19630 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044390.720627:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843ca9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:99a46fb7-9af9-40f1-9c76-329d6781ee81:3639:1870705581069312:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784044391.437351:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1784044392.336505:0:17196:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1784044392.336514:0:17196:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9b3975aa7800 from 13 10000000:01000000:0.0:1784044392.336519:0:17196:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1784044392.336571:0:17196:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b38426fd600/0x89871fc3aba19637 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044392.336583:0:17196:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9b38426fd600/0x89871fc3aba19637 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044392.336593:0:17196:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9b38426fd600/0x89871fc3aba19637 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044392.336620:0:17196:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3842705f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99a46fb7-9af9-40f1-9c76-329d6781ee81:17196:1870705581069440:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1784044392.336712:0:17196:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044392.336755:0:17196:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b38436c7240 going to sleep for 11 seconds 00000100:00100000:0.0:1784044392.337811:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581069440 00000100:00100000:0.0:1784044392.337822:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581069440 00000100:00100000:0.0:1784044392.337887:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1784044392.337896:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397424d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99a46fb7-9af9-40f1-9c76-329d6781ee81+20:17196:x1870705581069440:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784044392.337910:0:17194:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784044392.338704:0:17194:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b38426fde00/0x89871fc3aba1963e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x89871fc3aba19637 expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044392.338736:0:17194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b38426fde00/0x89871fc3aba1963e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x89871fc3aba19637 expref: 21 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044392.338748:0:17194:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b38426fde00/0x89871fc3aba1963e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x89871fc3aba19637 expref: 21 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044392.338757:0:17194:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b38426fde00, rc 0) 00000100:00100000:0.0:1784044392.338822:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397424d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99a46fb7-9af9-40f1-9c76-329d6781ee81+21:17196:x1870705581069440:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 927us (2109us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044392.338828:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1784044392.338886:0:17196:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3842705f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99a46fb7-9af9-40f1-9c76-329d6781ee81:17196:1870705581069440:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784044392.338904:0:17196:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9b38426fd600/0x89871fc3aba19637 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba1963e expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044392.338915:0:17196:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9b38426fd600/0x89871fc3aba19637 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x89871fc3aba1963e expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044392.341114:0:17196:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3842705f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99a46fb7-9af9-40f1-9c76-329d6781ee81:17196:1870705581069568:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784044392.341653:0:17196:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044392.341702:0:17196:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b38436c7240 going to sleep for 11 seconds 00000100:00100000:3.0:1784044392.341734:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581069568 00000100:00100000:3.0:1784044392.341748:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581069568 00000100:00100000:3.0:1784044392.341800:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1784044392.341809:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397424f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99a46fb7-9af9-40f1-9c76-329d6781ee81+21:17196:x1870705581069568:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784044392.341949:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397424f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:99a46fb7-9af9-40f1-9c76-329d6781ee81+21:17196:x1870705581069568:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 140us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044392.341957:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1784044392.342085:0:17196:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3842705f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99a46fb7-9af9-40f1-9c76-329d6781ee81:17196:1870705581069568:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784044392.342124:0:17196:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3842705f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99a46fb7-9af9-40f1-9c76-329d6781ee81:17196:1870705581069696:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784044392.342319:0:17196:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044392.342340:0:17196:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b38436c7240 going to sleep for 11 seconds 00000100:00100000:1.0:1784044392.342708:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581069696 00000100:00100000:1.0:1784044392.342714:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581069696 00000100:00100000:1.0:1784044392.342996:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1784044392.343006:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397424e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99a46fb7-9af9-40f1-9c76-329d6781ee81+21:17196:x1870705581069696:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784044392.343107:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397424e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99a46fb7-9af9-40f1-9c76-329d6781ee81+21:17196:x1870705581069696:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 103us (788us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044392.343115:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1784044392.343722:0:17196:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3842705f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99a46fb7-9af9-40f1-9c76-329d6781ee81:17196:1870705581069696:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1784044392.345774:0:20295:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1784044392.346071:0:17196:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1784044392.346098:0:17196:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1784044392.346111:0:17196:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b38426fd600/0x89871fc3aba19637 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba1963e expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044392.346127:0:17196:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9b38426fd600/0x89871fc3aba19637 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba1963e expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784044392.346554:0:17196:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1784044392.346557:0:17196:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9b3843fd5000 from 13 10000000:01000000:1.0:1784044392.346560:0:17196:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1784044392.346598:0:17196:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b397cb18600/0x89871fc3aba19645 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044392.346605:0:17196:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9b397cb18600/0x89871fc3aba19645 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044392.346616:0:17196:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9b397cb18600/0x89871fc3aba19645 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044392.346641:0:17196:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843ca9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99a46fb7-9af9-40f1-9c76-329d6781ee81:17196:1870705581069824:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784044392.346712:0:17196:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044392.346790:0:17196:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3947487480 going to sleep for 11 seconds 00000100:00100000:0.0:1784044392.346843:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581069824 00000100:00100000:0.0:1784044392.346850:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581069824 00000100:00100000:0.0:1784044392.347055:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1784044392.347066:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397424f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99a46fb7-9af9-40f1-9c76-329d6781ee81+21:17196:x1870705581069824:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784044392.347079:0:17194:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784044392.347091:0:17194:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b38426fcc00/0x89871fc3aba1964c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x89871fc3aba19645 expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044392.347113:0:17194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b38426fcc00/0x89871fc3aba1964c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x89871fc3aba19645 expref: 22 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044392.347125:0:17194:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b38426fcc00/0x89871fc3aba1964c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x89871fc3aba19645 expref: 22 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044392.347144:0:17194:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b38426fcc00, rc 0) 00000100:00100000:0.0:1784044392.347242:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397424f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99a46fb7-9af9-40f1-9c76-329d6781ee81+22:17196:x1870705581069824:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 177us (528us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044392.347320:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1784044392.347438:0:17196:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843ca9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99a46fb7-9af9-40f1-9c76-329d6781ee81:17196:1870705581069824:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784044392.347455:0:17196:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9b397cb18600/0x89871fc3aba19645 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba1964c expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044392.347465:0:17196:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9b397cb18600/0x89871fc3aba19645 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x89871fc3aba1964c expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044392.347546:0:17196:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843e3bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99a46fb7-9af9-40f1-9c76-329d6781ee81:17196:1870705581069952:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784044392.347576:0:17196:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044392.348364:0:17196:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b39510aa180 going to sleep for 11 seconds 00000100:00100000:1.0:1784044392.348426:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581069952 00000100:00100000:1.0:1784044392.348433:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581069952 00000100:00100000:1.0:1784044392.348468:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1784044392.348475:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397424ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99a46fb7-9af9-40f1-9c76-329d6781ee81+22:17196:x1870705581069952:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784044392.348596:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397424ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99a46fb7-9af9-40f1-9c76-329d6781ee81+22:17196:x1870705581069952:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 121us (1019us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044392.348603:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1784044392.348638:0:17196:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843e3bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99a46fb7-9af9-40f1-9c76-329d6781ee81:17196:1870705581069952:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784044392.348684:0:17196:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843cab800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99a46fb7-9af9-40f1-9c76-329d6781ee81:17196:1870705581070080:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784044392.348727:0:17196:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044392.348739:0:17196:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3947487e40 going to sleep for 11 seconds 00000100:00100000:1.0:1784044392.348751:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581070080 00000100:00100000:1.0:1784044392.348753:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581070080 00000100:00100000:1.0:1784044392.348768:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1784044392.348773:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38437a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99a46fb7-9af9-40f1-9c76-329d6781ee81+22:17196:x1870705581070080:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784044392.348839:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38437a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99a46fb7-9af9-40f1-9c76-329d6781ee81+22:17196:x1870705581070080:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 64us (111us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044392.348845:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1784044392.348879:0:17196:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843cab800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99a46fb7-9af9-40f1-9c76-329d6781ee81:17196:1870705581070080:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1784044392.349896:0:20297:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1784044392.350163:0:17196:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1784044392.350213:0:17196:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1784044392.350223:0:17196:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b397cb18600/0x89871fc3aba19645 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba1964c expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044392.350235:0:17196:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9b397cb18600/0x89871fc3aba19645 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba1964c expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784044392.350244:0:17196:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1784044392.350247:0:17196:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9b396f25a800 from 13 10000000:01000000:1.0:1784044392.350373:0:17196:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1784044392.350407:0:17196:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b397cb18c00/0x89871fc3aba19653 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044392.350428:0:17196:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9b397cb18c00/0x89871fc3aba19653 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044392.350438:0:17196:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9b397cb18c00/0x89871fc3aba19653 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044392.350473:0:17196:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843cab800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99a46fb7-9af9-40f1-9c76-329d6781ee81:17196:1870705581070208:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784044392.350524:0:17196:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044392.350546:0:17196:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3947487180 going to sleep for 11 seconds 00000100:00100000:1.0:1784044392.350566:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581070208 00000100:00100000:1.0:1784044392.350571:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581070208 00000100:00100000:1.0:1784044392.350602:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1784044392.350609:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38437a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99a46fb7-9af9-40f1-9c76-329d6781ee81+22:17196:x1870705581070208:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784044392.350621:0:17192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784044392.350633:0:17192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b397cb19a00/0x89871fc3aba1965a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x89871fc3aba19653 expref: -99 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044392.350654:0:17192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b397cb19a00/0x89871fc3aba1965a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x89871fc3aba19653 expref: 23 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044392.350665:0:17192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b397cb19a00/0x89871fc3aba1965a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x89871fc3aba19653 expref: 23 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044392.350686:0:17192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b397cb19a00, rc 0) 00000100:00100000:1.0:1784044392.350720:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38437a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99a46fb7-9af9-40f1-9c76-329d6781ee81+23:17196:x1870705581070208:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 112us (197us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044392.350727:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1784044392.350765:0:17196:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843cab800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99a46fb7-9af9-40f1-9c76-329d6781ee81:17196:1870705581070208:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784044392.350778:0:17196:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9b397cb18c00/0x89871fc3aba19653 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba1965a expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044392.350786:0:17196:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9b397cb18c00/0x89871fc3aba19653 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x89871fc3aba1965a expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044392.350842:0:17196:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843cab800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99a46fb7-9af9-40f1-9c76-329d6781ee81:17196:1870705581070336:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784044392.350867:0:17196:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044392.350879:0:17196:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3947487180 going to sleep for 11 seconds 00000100:00100000:1.0:1784044392.350889:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581070336 00000100:00100000:1.0:1784044392.350892:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581070336 00000100:00100000:1.0:1784044392.350905:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1784044392.350909:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38437a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99a46fb7-9af9-40f1-9c76-329d6781ee81+23:17196:x1870705581070336:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784044392.351604:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38437a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99a46fb7-9af9-40f1-9c76-329d6781ee81+23:17196:x1870705581070336:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 691us (734us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044392.351612:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1784044392.351651:0:17196:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843cab800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99a46fb7-9af9-40f1-9c76-329d6781ee81:17196:1870705581070336:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784044392.351694:0:17196:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843cab800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99a46fb7-9af9-40f1-9c76-329d6781ee81:17196:1870705581070464:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784044392.351737:0:17196:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044392.351752:0:17196:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3947487180 going to sleep for 11 seconds 00000100:00100000:1.0:1784044392.351768:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581070464 00000100:00100000:1.0:1784044392.351772:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581070464 00000100:00100000:1.0:1784044392.351789:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1784044392.351795:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38437a5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99a46fb7-9af9-40f1-9c76-329d6781ee81+23:17196:x1870705581070464:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784044392.351860:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38437a5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99a46fb7-9af9-40f1-9c76-329d6781ee81+23:17196:x1870705581070464:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 64us (122us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044392.351866:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1784044392.351898:0:17196:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843cab800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99a46fb7-9af9-40f1-9c76-329d6781ee81:17196:1870705581070464:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1784044392.354363:0:20298:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1784044392.354629:0:17196:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1784044392.354650:0:17196:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1784044392.354662:0:17196:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b397cb18c00/0x89871fc3aba19653 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba1965a expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044392.354684:0:17196:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9b397cb18c00/0x89871fc3aba19653 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba1965a expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784044392.354696:0:17196:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1784044392.354698:0:17196:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9b397a8e8000 from 13 10000000:01000000:0.0:1784044392.354701:0:17196:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1784044392.354735:0:17196:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b38426fc800/0x89871fc3aba19661 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044392.354744:0:17196:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9b38426fc800/0x89871fc3aba19661 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044392.354756:0:17196:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9b38426fc800/0x89871fc3aba19661 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044392.354778:0:17196:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3842705f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99a46fb7-9af9-40f1-9c76-329d6781ee81:17196:1870705581070592:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1784044392.354845:0:17196:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044392.354931:0:17196:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b38436c7780 going to sleep for 11 seconds 00000100:00100000:1.0:1784044392.355081:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581070592 00000100:00100000:1.0:1784044392.355087:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581070592 00000100:00100000:1.0:1784044392.355243:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1784044392.355317:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38437a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99a46fb7-9af9-40f1-9c76-329d6781ee81+23:17196:x1870705581070592:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784044392.355330:0:17192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784044392.355344:0:17192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b397cb19000/0x89871fc3aba19668 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x89871fc3aba19661 expref: -99 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044392.355366:0:17192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b397cb19000/0x89871fc3aba19668 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x89871fc3aba19661 expref: 24 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044392.355375:0:17192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b397cb19000/0x89871fc3aba19668 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x89871fc3aba19661 expref: 24 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044392.355384:0:17192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b397cb19000, rc 0) 00000100:00100000:1.0:1784044392.355501:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38437a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99a46fb7-9af9-40f1-9c76-329d6781ee81+24:17196:x1870705581070592:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 188us (655us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044392.355507:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1784044392.355591:0:17196:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3842705f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99a46fb7-9af9-40f1-9c76-329d6781ee81:17196:1870705581070592:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784044392.355605:0:17196:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9b38426fc800/0x89871fc3aba19661 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba19668 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044392.355612:0:17196:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9b38426fc800/0x89871fc3aba19661 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x89871fc3aba19668 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044392.355669:0:17196:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843e3b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99a46fb7-9af9-40f1-9c76-329d6781ee81:17196:1870705581070720:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784044392.355703:0:17196:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044392.355796:0:17196:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b39510aae40 going to sleep for 11 seconds 00000100:00100000:0.0:1784044392.355820:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581070720 00000100:00100000:0.0:1784044392.355825:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581070720 00000100:00100000:0.0:1784044392.355849:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1784044392.355856:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38437a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99a46fb7-9af9-40f1-9c76-329d6781ee81+24:17196:x1870705581070720:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784044392.355965:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38437a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99a46fb7-9af9-40f1-9c76-329d6781ee81+24:17196:x1870705581070720:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 110us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044392.355982:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1784044392.355997:0:17196:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843e3b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99a46fb7-9af9-40f1-9c76-329d6781ee81:17196:1870705581070720:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784044392.356029:0:17196:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3844584000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99a46fb7-9af9-40f1-9c76-329d6781ee81:17196:1870705581070848:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784044392.356068:0:17196:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044392.356091:0:17196:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3843df7180 going to sleep for 11 seconds 00000100:00100000:0.0:1784044392.356103:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581070848 00000100:00100000:0.0:1784044392.356106:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581070848 00000100:00100000:0.0:1784044392.356122:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1784044392.356127:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38437a6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99a46fb7-9af9-40f1-9c76-329d6781ee81+24:17196:x1870705581070848:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784044392.356230:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38437a6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99a46fb7-9af9-40f1-9c76-329d6781ee81+24:17196:x1870705581070848:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 102us (161us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044392.356238:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1784044392.356286:0:17196:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3844584000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:99a46fb7-9af9-40f1-9c76-329d6781ee81:17196:1870705581070848:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1784044392.356920:0:20299:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1784044392.356997:0:17196:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1784044392.357019:0:17196:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1784044392.357028:0:17196:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9b38426fc800/0x89871fc3aba19661 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba19668 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044392.357038:0:17196:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9b38426fc800/0x89871fc3aba19661 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x89871fc3aba19668 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044392.357810:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044392.357848:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565235968 00000100:00100000:3.0:1784044392.357855:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565235968 00000100:00100000:3.0:1784044392.357892:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 165 00000100:00100000:3.0:1784044392.357899:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38437a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cf001828-7720-4c65-ba45-a14bcd113197+11:14943:x1870705565235968:12345-192.168.202.40@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784044392.357912:0:17194:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784044392.357929:0:17194:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b3982055c00/0x89871fc3aba1966f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd3dffad52ca6b0f expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044392.357953:0:17194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b3982055c00/0x89871fc3aba1966f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6b0f expref: 12 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044392.357977:0:17194:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b3982055c00/0x89871fc3aba1966f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6b0f expref: 12 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044392.357985:0:17194:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3982055c00, rc 0) 00000100:00100000:3.0:1784044392.358040:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38437a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cf001828-7720-4c65-ba45-a14bcd113197+12:14943:x1870705565235968:12345-192.168.202.40@tcp:101:ll_cfg_requeue.0 Request processed in 141us (234us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044392.358048:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 165 00000100:00100000:1.0:1784044392.361115:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044392.361411:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565236096 00000100:00100000:0.0:1784044392.361427:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565236096 00000100:00100000:0.0:1784044392.361474:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 166 00000100:00100000:0.0:1784044392.361483:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38437a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cf001828-7720-4c65-ba45-a14bcd113197+12:14943:x1870705565236096:12345-192.168.202.40@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784044392.361626:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38437a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cf001828-7720-4c65-ba45-a14bcd113197+12:14943:x1870705565236096:12345-192.168.202.40@tcp:501:ll_cfg_requeue.0 Request processed in 144us (519us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044392.361634:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 166 00000100:00100000:0.0:1784044392.364108:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044392.364204:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565236224 00000100:00100000:2.0:1784044392.364212:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565236224 00000100:00100000:2.0:1784044392.364269:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 167 00000100:00100000:2.0:1784044392.364278:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38437a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cf001828-7720-4c65-ba45-a14bcd113197+12:14943:x1870705565236224:12345-192.168.202.40@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784044392.364413:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38437a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cf001828-7720-4c65-ba45-a14bcd113197+12:14943:x1870705565236224:12345-192.168.202.40@tcp:503:ll_cfg_requeue.0 Request processed in 135us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044392.364429:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 167 00000100:00100000:2.0:1784044392.370500:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1784044392.370707:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565236352 00000100:00100000:1.0:1784044392.370715:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565236352 00000100:00100000:1.0:1784044392.370765:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 168 00000100:00100000:1.0:1784044392.370772:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38437a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cf001828-7720-4c65-ba45-a14bcd113197+12:14943:x1870705565236352:12345-192.168.202.40@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784044392.370787:0:17192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784044392.370805:0:17192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b397cb19800/0x89871fc3aba19676 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd3dffad52ca6b16 expref: -99 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044392.370831:0:17192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b397cb19800/0x89871fc3aba19676 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6b16 expref: 13 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044392.370854:0:17192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b397cb19800/0x89871fc3aba19676 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6b16 expref: 13 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044392.370861:0:17192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b397cb19800, rc 0) 00000100:00100000:1.0:1784044392.370911:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38437a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cf001828-7720-4c65-ba45-a14bcd113197+13:14943:x1870705565236352:12345-192.168.202.40@tcp:101:ll_cfg_requeue.0 Request processed in 140us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044392.370925:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 168 00000100:00100000:1.0:1784044392.375045:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044392.375092:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565236480 00000100:00100000:0.0:1784044392.375102:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565236480 00000100:00100000:0.0:1784044392.375160:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 169 00000100:00100000:0.0:1784044392.375170:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38437a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cf001828-7720-4c65-ba45-a14bcd113197+13:14943:x1870705565236480:12345-192.168.202.40@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784044392.375563:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38437a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cf001828-7720-4c65-ba45-a14bcd113197+13:14943:x1870705565236480:12345-192.168.202.40@tcp:501:ll_cfg_requeue.0 Request processed in 392us (524us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044392.375571:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 169 00000100:00100000:0.0:1784044392.377246:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044392.377443:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565236608 00000100:00100000:2.0:1784044392.377450:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565236608 00000100:00100000:2.0:1784044392.377495:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 170 00000100:00100000:2.0:1784044392.377503:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38437a7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cf001828-7720-4c65-ba45-a14bcd113197+13:14943:x1870705565236608:12345-192.168.202.40@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784044392.377616:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38437a7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cf001828-7720-4c65-ba45-a14bcd113197+13:14943:x1870705565236608:12345-192.168.202.40@tcp:503:ll_cfg_requeue.0 Request processed in 113us (379us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044392.377624:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 170 00010000:00010000:0.0:1784044392.465050:0:20228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784044393.193208:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044393.193264:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044393.193285:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044393.193310:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044393.193328:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044393.193345:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044393.193362:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044393.193380:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044393.193403:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044393.193442:0:18707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565237248 00000100:00100000:2.0:1784044393.193453:0:18707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565237248 00000100:00100000:2.0:1784044393.193512:0:18707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565237760 00000100:00100000:2.0:1784044393.193515:0:18707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565237760 00000100:00100000:2.0:1784044393.193531:0:18707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565237120 00000100:00100000:2.0:1784044393.193533:0:18707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565237120 00000100:00100000:2.0:1784044393.193547:0:18707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565237632 00000100:00100000:2.0:1784044393.193564:0:18707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565237632 00000100:00100000:2.0:1784044393.193587:0:18707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 21 00000100:00100000:2.0:1784044393.193597:0:18707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843e3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ffd836bb-8324-4bbb-bdb8-ace806f205ee+5:2407:x1870705565237248:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:2.0:1784044393.193694:0:18707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843e3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ffd836bb-8324-4bbb-bdb8-ace806f205ee+5:2407:x1870705565237248:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 97us (406us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044393.193701:0:18707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 21 00000100:00100000:2.0:1784044393.193724:0:18707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 22 00000100:00100000:2.0:1784044393.193734:0:18707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843e38700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:35f5085c-0464-4087-9b4b-890cdd0735b4+5:2407:x1870705565237760:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:2.0:1784044393.193768:0:18707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843e38700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:35f5085c-0464-4087-9b4b-890cdd0735b4+5:2407:x1870705565237760:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 36us (437us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044393.193776:0:18707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 22 00000100:00100000:2.0:1784044393.193793:0:18707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 23 00000100:00100000:2.0:1784044393.193803:0:18707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843e3b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ffd836bb-8324-4bbb-bdb8-ace806f205ee+5:2407:x1870705565237120:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:2.0:1784044393.193833:0:18707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843e3b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ffd836bb-8324-4bbb-bdb8-ace806f205ee+5:2407:x1870705565237120:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 31us (469us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044393.193840:0:18707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 23 00000100:00100000:2.0:1784044393.193855:0:18707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 24 00000100:00100000:2.0:1784044393.193863:0:18707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843e3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:35f5085c-0464-4087-9b4b-890cdd0735b4+5:2407:x1870705565237632:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:2.0:1784044393.193891:0:18707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843e3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:35f5085c-0464-4087-9b4b-890cdd0735b4+5:2407:x1870705565237632:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 29us (486us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044393.193899:0:18707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 24 00000100:00100000:2.0:1784044393.193923:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565236992 00000100:00100000:2.0:1784044393.193928:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565236992 00000100:00100000:2.0:1784044393.193959:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565237504 00000100:00100000:2.0:1784044393.193971:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565237504 00000100:00100000:2.0:1784044393.193990:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565236864 00000100:00100000:2.0:1784044393.193993:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565236864 00000100:00100000:2.0:1784044393.194005:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565237376 00000100:00100000:2.0:1784044393.194008:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565237376 00000100:00100000:2.0:1784044393.194023:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 68 00000100:00100000:2.0:1784044393.194029:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843e3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ffd836bb-8324-4bbb-bdb8-ace806f205ee+5:2407:x1870705565236992:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:2.0:1784044393.194062:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843e3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ffd836bb-8324-4bbb-bdb8-ace806f205ee+5:2407:x1870705565236992:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 33us (798us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044393.194069:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 68 00000100:00100000:2.0:1784044393.194081:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 69 00000100:00100000:2.0:1784044393.194088:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843e3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35f5085c-0464-4087-9b4b-890cdd0735b4+5:2407:x1870705565237504:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:2.0:1784044393.194110:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843e3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35f5085c-0464-4087-9b4b-890cdd0735b4+5:2407:x1870705565237504:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 23us (799us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044393.194117:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 69 00000100:00100000:2.0:1784044393.194126:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 70 00000100:00100000:2.0:1784044393.194132:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843e3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ffd836bb-8324-4bbb-bdb8-ace806f205ee+6:2407:x1870705565236864:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:2.0:1784044393.194153:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843e3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ffd836bb-8324-4bbb-bdb8-ace806f205ee+6:2407:x1870705565236864:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 22us (808us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044393.194159:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 70 00000100:00100000:2.0:1784044393.194170:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 71 00000100:00100000:2.0:1784044393.194204:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843e39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35f5085c-0464-4087-9b4b-890cdd0735b4+6:2407:x1870705565237376:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:2.0:1784044393.194230:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843e39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35f5085c-0464-4087-9b4b-890cdd0735b4+6:2407:x1870705565237376:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 28us (849us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044393.194237:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 71 00000100:00080000:2.0:1784044393.194275:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1784044393.194280:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1784044393.194283:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1784044393.194285:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784044393.194717:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565236736 00000100:00100000:0.0:1784044393.194724:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565236736 00000100:00100000:0.0:1784044393.194766:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 171 00000100:00100000:0.0:1784044393.194773:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38437a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cf001828-7720-4c65-ba45-a14bcd113197+13:2407:x1870705565236736:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:0.0:1784044393.194799:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38437a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cf001828-7720-4c65-ba45-a14bcd113197+13:2407:x1870705565236736:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 27us (1626us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044393.194806:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 171 00010000:00010000:0.0:1784044393.486450:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784044393.549523:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3844584000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1870705581070976:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784044393.549595:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044393.549695:0:18709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581070976 00000100:00100000:1.0:1784044393.549703:0:18709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581070976 00000100:00100000:1.0:1784044393.549771:0:18709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1784044393.549781:0:18709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3842706a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1870705581070976:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1784044393.549810:0:18709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00080000:2.0:1784044393.549885:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784044393.550113:0:18709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3842706a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1870705581070976:12345-0@lo:13:osp-pre-0-0.0 Request processed in 332us (516us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044393.550216:0:18709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1784044393.550309:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3844584000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1870705581070976:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1784044394.509816:0:19100:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784044394.519935:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044394.520073:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565237888 00000100:00100000:2.0:1784044394.520098:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565237888 00000100:00100000:2.0:1784044394.520230:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 22 00000100:00100000:2.0:1784044394.520242:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3844587b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ffd836bb-8324-4bbb-bdb8-ace806f205ee+6:15611:x1870705565237888:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1784044394.520262:0:17199:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784044394.520287:0:17199:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b39586eea00/0x89871fc3aba1967d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcd3dffad52ca6b1d expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044394.520359:0:17199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b39586ee200/0x89871fc3aba19684 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044394.520374:0:17199:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b39586ee200/0x89871fc3aba19684 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044394.520385:0:17199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b39586ee200/0x89871fc3aba19684 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044394.520399:0:17199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b39586ef800/0x89871fc3aba1968b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044394.520406:0:17199:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b39586ef800/0x89871fc3aba1968b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044394.520412:0:17199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b39586ef800/0x89871fc3aba1968b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044394.520491:0:17199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b39586ee000/0x89871fc3aba19692 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044394.520511:0:17199:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b39586ee000/0x89871fc3aba19692 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044394.520518:0:17199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b39586ee000/0x89871fc3aba19692 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784044394.520549:0:17199:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1784044394.520553:0:17199:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1784044394.520584:0:17199:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b39586ee000/0x89871fc3aba19692 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044394.520594:0:17199:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b39586ee200/0x89871fc3aba19684 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044394.520601:0:17199:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b39586ee200/0x89871fc3aba19684 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044394.520607:0:17199:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b39586ee200/0x89871fc3aba19684 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044394.520613:0:17199:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b39586ee200 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:2.0:1784044394.520617:0:17199:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b39586ee200/0x89871fc3aba19684 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044394.520624:0:17199:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b39586ee200/0x89871fc3aba19684 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044394.520636:0:17199:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b3974d3ad00) 00010000:00010000:2.0:1784044394.520639:0:17199:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784044394.520644:0:17199:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b39586ee200/0x89871fc3aba19684 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044394.520671:0:17199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b39586ee200/0x89871fc3aba19684 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044394.520686:0:17199:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b39586ef800/0x89871fc3aba1968b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044394.520691:0:17199:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b39586ef800/0x89871fc3aba1968b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044394.520698:0:17199:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b39586ef800/0x89871fc3aba1968b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044394.520702:0:17199:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b39586ef800 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:2.0:1784044394.520706:0:17199:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b39586ef800/0x89871fc3aba1968b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044394.520711:0:17199:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b39586ef800/0x89871fc3aba1968b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044394.520720:0:17199:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9b397b61a000) 00010000:00010000:2.0:1784044394.520722:0:17199:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784044394.520725:0:17199:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b39586ef800/0x89871fc3aba1968b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044394.520731:0:17199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b39586ef800/0x89871fc3aba1968b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044394.520765:0:17199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b39586eea00/0x89871fc3aba1967d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6b1d expref: 8 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044394.520789:0:17199:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b39586ee000/0x89871fc3aba19692 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6b1d expref: 7 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044394.520796:0:17199:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9b397b61af00) 00010000:00010000:2.0:1784044394.520799:0:17199:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1784044394.520801:0:17199:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b39586ee000, rc 0) 00000100:00100000:2.0:1784044394.520883:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3844587b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ffd836bb-8324-4bbb-bdb8-ace806f205ee+7:15611:x1870705565237888:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 Request processed in 644us (967us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044394.520890:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 22 00000100:00100000:0.0:1784044394.525526:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1784044394.526960:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565238016 00000100:00100000:1.0:1784044394.526976:0:17212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565238016 00000100:00100000:1.0:1784044394.527059:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 5 00000100:00100000:1.0:1784044394.527071:0:17212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3842705f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:ffd836bb-8324-4bbb-bdb8-ace806f205ee+7:15611:x1870705565238016:12345-192.168.202.40@tcp:900:lhsmtool_posix.0 00000100:00100000:1.0:1784044394.527170:0:17212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3842705f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:ffd836bb-8324-4bbb-bdb8-ace806f205ee+7:15611:x1870705565238016:12345-192.168.202.40@tcp:900:lhsmtool_posix.0 Request processed in 101us (1659us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044394.527223:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 5 00000100:00100000:0.0:1784044394.535218:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044394.535644:0:18572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565238272 00000100:00100000:2.0:1784044394.535666:0:18572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565238272 00000100:00100000:2.0:1784044394.535756:0:18572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 23 00000100:00100000:2.0:1784044394.535769:0:18572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3842704700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ffd836bb-8324-4bbb-bdb8-ace806f205ee+7:15611:x1870705565238272:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1784044394.535804:0:18572:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784044394.535835:0:18572:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b39586eea00/0x89871fc3aba19699 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcd3dffad52ca6b24 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044394.535948:0:18572:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b39586ef800/0x89871fc3aba196a0 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044394.535967:0:18572:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b39586ef800/0x89871fc3aba196a0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044394.535982:0:18572:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b39586ef800/0x89871fc3aba196a0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044394.536310:0:18572:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b39586ee200/0x89871fc3aba196a7 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044394.536355:0:18572:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b39586ee200/0x89871fc3aba196a7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044394.536369:0:18572:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b39586ee200/0x89871fc3aba196a7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044394.536519:0:18572:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b39586ee600/0x89871fc3aba196ae lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044394.536528:0:18572:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b39586ee600/0x89871fc3aba196ae lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044394.536536:0:18572:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b39586ee600/0x89871fc3aba196ae lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18572 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784044394.536548:0:18572:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:2.0:1784044394.536737:0:18572:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b39586ef800/0x89871fc3aba196a0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044394.536745:0:18572:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b39586ef800/0x89871fc3aba196a0 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 18572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044394.536753:0:18572:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b39586ef800/0x89871fc3aba196a0 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044394.536760:0:18572:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b39586ef800 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:2.0:1784044394.536765:0:18572:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b39586ef800/0x89871fc3aba196a0 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044394.536775:0:18572:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b39586ef800/0x89871fc3aba196a0 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 18572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044394.536801:0:18572:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9b397b61af00) 00010000:00010000:2.0:1784044394.536804:0:18572:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784044394.536809:0:18572:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b39586ef800/0x89871fc3aba196a0 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044394.536815:0:18572:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b39586ef800/0x89871fc3aba196a0 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044394.536828:0:18572:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b39586ee200/0x89871fc3aba196a7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044394.536833:0:18572:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b39586ee200/0x89871fc3aba196a7 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044394.536838:0:18572:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b39586ee200/0x89871fc3aba196a7 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044394.536843:0:18572:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b39586ee200 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:2.0:1784044394.536845:0:18572:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b39586ee200/0x89871fc3aba196a7 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044394.536851:0:18572:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b39586ee200/0x89871fc3aba196a7 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044394.536857:0:18572:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9b397b61a000) 00010000:00010000:2.0:1784044394.536859:0:18572:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784044394.536862:0:18572:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b39586ee200/0x89871fc3aba196a7 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044394.536867:0:18572:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b39586ee200/0x89871fc3aba196a7 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044394.538310:0:18572:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b39586eea00/0x89871fc3aba19699 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6b24 expref: 10 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044394.538342:0:18572:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b39586ee600/0x89871fc3aba196ae lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6b24 expref: 9 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044394.538351:0:18572:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9b397b61a700) 00010000:00010000:2.0:1784044394.538353:0:18572:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784044394.538357:0:18572:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b39586ee600, rc 0) 00000100:00100000:2.0:1784044394.538438:0:18572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3842704700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ffd836bb-8324-4bbb-bdb8-ace806f205ee+9:15611:x1870705565238272:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 Request processed in 2671us (3264us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1784044394.538448:0:18572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 23 00000100:00100000:3.0:1784044394.543270:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044394.543912:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565238400 00000100:00100000:0.0:1784044394.543929:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565238400 00000100:00100000:0.0:1784044394.544016:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 24 00000100:00100000:0.0:1784044394.544030:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3844586300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ffd836bb-8324-4bbb-bdb8-ace806f205ee+9:15611:x1870705565238400:12345-192.168.202.40@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1784044394.544229:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3844586300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ffd836bb-8324-4bbb-bdb8-ace806f205ee+9:15611:x1870705565238400:12345-192.168.202.40@tcp:59:lhsmtool_posix.0 Request processed in 202us (975us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044394.544239:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 24 00000100:00100000:0.0:1784044394.556261:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044394.556519:0:19739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565238528 00000100:00100000:3.0:1784044394.556531:0:19739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565238528 00000100:00100000:3.0:1784044394.556618:0:19739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 25 00000100:00100000:3.0:1784044394.556633:0:19739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3842707100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ffd836bb-8324-4bbb-bdb8-ace806f205ee+5:15611:x1870705565238528:12345-192.168.202.40@tcp:59:lhsmtool_posix.0 00000004:00080000:3.0:1784044394.561851:0:19739:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 5140us 00000100:00100000:1.0:1784044394.573616:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784044394.573673:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3842707800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1870705581071104:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1784044394.573774:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044394.573843:0:18710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581071104 00000100:00100000:1.0:1784044394.573857:0:18710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581071104 00000100:00100000:1.0:1784044394.573944:0:18710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1784044394.573955:0:18710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843cab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1870705581071104:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1784044394.573991:0:18710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1784044394.574047:0:18710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843cab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1870705581071104:12345-0@lo:13:osp-pre-0-1.0 Request processed in 93us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044394.574056:0:18710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:1.0:1784044394.574085:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784044394.574129:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3842707800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1870705581071104:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1784044394.595979:0:19739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3842707100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ffd836bb-8324-4bbb-bdb8-ace806f205ee+5:15611:x1870705565238528:12345-192.168.202.40@tcp:59:lhsmtool_posix.0 Request processed in 39334us (39719us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044394.595999:0:19739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 25 00000100:00100000:3.0:1784044394.625231:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044394.625947:0:18572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565238656 00000100:00100000:2.0:1784044394.625962:0:18572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565238656 00000100:00100000:2.0:1784044394.626061:0:18572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 26 00000100:00100000:2.0:1784044394.626077:0:18572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3844586a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ffd836bb-8324-4bbb-bdb8-ace806f205ee+9:15617:x1870705565238656:12345-192.168.202.40@tcp:101:lfs.0 00010000:00010000:2.0:1784044394.626108:0:18572:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784044394.626141:0:18572:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b39586eea00/0x89871fc3aba196bc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcd3dffad52ca6b2b expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044394.626261:0:18572:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b39586ee200/0x89871fc3aba196c3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044394.626280:0:18572:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b39586ee200/0x89871fc3aba196c3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044394.626296:0:18572:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b39586ee200/0x89871fc3aba196c3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044394.627632:0:18572:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc000/0x89871fc3aba196ca lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044394.627648:0:18572:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc000/0x89871fc3aba196ca lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044394.627672:0:18572:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc000/0x89871fc3aba196ca lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044394.627752:0:18572:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b39586ee200/0x89871fc3aba196c3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044394.627760:0:18572:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b39586ee200/0x89871fc3aba196c3 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044394.627767:0:18572:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b39586ee200/0x89871fc3aba196c3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044394.627776:0:18572:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b39586ee200 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:0.0:1784044394.627781:0:18572:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b39586ee200/0x89871fc3aba196c3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044394.627790:0:18572:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b39586ee200/0x89871fc3aba196c3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044394.627806:0:18572:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b3974d3ad00) 00010000:00010000:0.0:1784044394.627810:0:18572:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784044394.627816:0:18572:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b39586ee200/0x89871fc3aba196c3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044394.627823:0:18572:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b39586ee200/0x89871fc3aba196c3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044394.627854:0:18572:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc000/0x89871fc3aba196ca lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044394.627861:0:18572:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc000/0x89871fc3aba196ca lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044394.627867:0:18572:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc000/0x89871fc3aba196ca lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044394.627873:0:18572:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38426fc000 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:0.0:1784044394.627876:0:18572:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc000/0x89871fc3aba196ca lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044394.627883:0:18572:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc000/0x89871fc3aba196ca lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044394.627892:0:18572:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9b3975b83400) 00010000:00010000:0.0:1784044394.627894:0:18572:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784044394.627897:0:18572:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc000/0x89871fc3aba196ca lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044394.627903:0:18572:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc000/0x89871fc3aba196ca lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044394.627961:0:18572:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b39586eea00/0x89871fc3aba196bc lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6b2b expref: 10 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044394.627974:0:18572:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b3974d3ad00) 00010000:00010000:0.0:1784044394.627977:0:18572:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784044394.627987:0:18572:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b39586eea00/0x89871fc3aba196bc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6b2b expref: 10 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044394.628000:0:18572:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b39586eea00, rc 0) 00000100:00100000:0.0:1784044394.628211:0:18572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3844586a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ffd836bb-8324-4bbb-bdb8-ace806f205ee+9:15617:x1870705565238656:12345-192.168.202.40@tcp:101:lfs.0 Request processed in 2040us (2948us total) trans 0 rc 301/301 00000100:00100000:0.0:1784044394.628222:0:18572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 26 00000100:00100000:3.0:1784044394.636746:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044394.638716:0:17209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565238784 00000100:00100000:0.0:1784044394.638742:0:17209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565238784 00000100:00100000:0.0:1784044394.638832:0:17209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 0 00000100:00100000:0.0:1784044394.638846:0:17209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3844584000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:ffd836bb-8324-4bbb-bdb8-ace806f205ee+9:15617:x1870705565238784:12345-192.168.202.40@tcp:700:lfs.0 00000100:00100000:0.0:1784044394.639341:0:17209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3844584000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:ffd836bb-8324-4bbb-bdb8-ace806f205ee+9:15617:x1870705565238784:12345-192.168.202.40@tcp:700:lfs.0 Request processed in 496us (2611us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044394.639351:0:17209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 0 00000100:00100000:2.0:1784044394.641509:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044394.641603:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565239040 00000100:00100000:3.0:1784044394.641615:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565239040 00000100:00100000:3.0:1784044394.641730:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 27 00000100:00100000:3.0:1784044394.641741:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843e38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ffd836bb-8324-4bbb-bdb8-ace806f205ee+9:15617:x1870705565239040:12345-192.168.202.40@tcp:36:lfs.0 00010000:00010000:3.0:1784044394.641818:0:17199:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784044394.641863:0:17199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6e00/0x89871fc3aba195ea lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6a98 expref: 9 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044394.641888:0:17199:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b3974d3ad00) 00010000:00010000:3.0:1784044394.641915:0:17199:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784044394.642005:0:17199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3982054c00/0x89871fc3aba196d1 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044394.642021:0:17199:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b397cb18800/0x89871fc3aba19629 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6b08 expref: 5 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044394.642031:0:17199:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3982054c00/0x89871fc3aba196d1 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044394.642074:0:17199:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b397cb18800/0x89871fc3aba19629 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6b08 expref: 5 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044394.642089:0:17199:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b397cb18800/0x89871fc3aba19629 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6b08 expref: 5 pid: 17199 timeout: 687 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044394.642106:0:17199:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843735180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17199:1870705581071232:192.168.202.40@tcp:104: 00000100:00100000:3.0:1784044394.645035:0:17199:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b3842748d80 going to sleep for 11 seconds 00000100:00100000:3.0:1784044394.649159:0:17199:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843735180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17199:1870705581071232:192.168.202.40@tcp:104: 00010000:00010000:3.0:1784044394.649514:0:17199:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b3982054c00/0x89871fc3aba196d1 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044394.651848:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044394.651965:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565239168 00000100:00100000:2.0:1784044394.651977:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565239168 00010000:00010000:2.0:1784044394.652036:0:17186:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b397cb18800/0x89871fc3aba19629 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6b08 expref: 6 pid: 17199 timeout: 687 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044394.652087:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 15 00000100:00100000:2.0:1784044394.652098:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843735180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:35f5085c-0464-4087-9b4b-890cdd0735b4+6:2409:x1870705565239168:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784044394.652276:0:17186:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784044394.652288:0:17186:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b397cb18800/0x89871fc3aba19629 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6b08 expref: 6 pid: 17199 timeout: 687 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044394.652374:0:17186:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b397cb18800/0x89871fc3aba19629 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6b08 expref: 6 pid: 17199 timeout: 687 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044394.652473:0:17186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b397cb18800/0x89871fc3aba19629 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6b08 expref: 6 pid: 17199 timeout: 687 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044394.652497:0:17186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b3974d3ad00) 00010000:00010000:2.0:1784044394.652504:0:17186:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9b3982054c00/0x89871fc3aba196d1 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044394.652517:0:17186:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3982054c00/0x89871fc3aba196d1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044394.652527:0:17186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3982054c00/0x89871fc3aba196d1 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044394.652647:0:17186:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784044394.652742:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843735180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:35f5085c-0464-4087-9b4b-890cdd0735b4+5:2409:x1870705565239168:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 645us (912us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044394.652754:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 15 00010000:00010000:3.0:1784044394.654051:0:17199:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b3982054c00/0x89871fc3aba196d1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044394.654069:0:17199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3982054c00/0x89871fc3aba196d1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044394.654104:0:17199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3982055a00/0x89871fc3aba196d8 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044394.654476:0:17199:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3982055a00/0x89871fc3aba196d8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044394.654491:0:17199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3982055a00/0x89871fc3aba196d8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044394.658518:0:17199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3982054800/0x89871fc3aba196df lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044394.658541:0:17199:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3982054800/0x89871fc3aba196df lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044394.658744:0:17199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3982054800/0x89871fc3aba196df lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784044394.658796:0:17199:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000095157cf1 reply state 0000000049d97894 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff9b3982054800/0x89871fc3aba196df lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044394.658826:0:17199:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3982054800/0x89871fc3aba196df lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044394.658835:0:17199:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9b396f2a8d00) 00010000:00010000:3.0:1784044394.658839:0:17199:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1784044394.658843:0:17199:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1784044394.658850:0:17199:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1784044394.658860:0:17199:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3982054c00/0x89871fc3aba196d1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044394.658868:0:17199:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3982054c00/0x89871fc3aba196d1 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044394.658876:0:17199:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3982054c00/0x89871fc3aba196d1 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044394.658897:0:17199:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3982054c00 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:3.0:1784044394.658902:0:17199:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3982054c00/0x89871fc3aba196d1 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044394.658910:0:17199:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3982054c00/0x89871fc3aba196d1 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044394.658923:0:17199:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b3974d3ad00) 00010000:00010000:3.0:1784044394.658925:0:17199:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784044394.658929:0:17199:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3982054c00/0x89871fc3aba196d1 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044394.658935:0:17199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3982054c00/0x89871fc3aba196d1 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784044394.658964:0:17199:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000095157cf1 reply state 0000000049d97894 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff9b3982055a00/0x89871fc3aba196d8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044394.658972:0:17199:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3982055a00/0x89871fc3aba196d8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044394.658977:0:17199:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9b396f2a8100) 00010000:00010000:3.0:1784044394.658979:0:17199:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1784044394.658981:0:17199:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:3.0:1784044394.659112:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843e38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ffd836bb-8324-4bbb-bdb8-ace806f205ee+10:15617:x1870705565239040:12345-192.168.202.40@tcp:36:lfs.0 Request processed in 17368us (17712us total) trans 8589934594 rc 0/0 00000100:00100000:3.0:1784044394.659122:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 27 00000100:00100000:3.0:1784044394.756049:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044394.756255:0:19739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565239296 00000100:00100000:0.0:1784044394.756269:0:19739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565239296 00000100:00100000:0.0:1784044394.756395:0:19739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 28 00000100:00100000:0.0:1784044394.756408:0:19739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843734a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ffd836bb-8324-4bbb-bdb8-ace806f205ee+10:15625:x1870705565239296:12345-192.168.202.40@tcp:101:lctl.0 00010000:00010000:0.0:1784044394.756446:0:19739:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784044394.756489:0:19739:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc000/0x89871fc3aba196e6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcd3dffad52ca6b32 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044394.756570:0:19739:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd400/0x89871fc3aba196ed lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19739 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044394.756583:0:19739:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd400/0x89871fc3aba196ed lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19739 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044394.756610:0:19739:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd400/0x89871fc3aba196ed lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19739 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784044394.756680:0:19739:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1784044394.756684:0:19739:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1784044394.756722:0:19739:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd400/0x89871fc3aba196ed lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19739 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044394.756745:0:19739:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc000/0x89871fc3aba196e6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6b32 expref: 12 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044394.756762:0:19739:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd400/0x89871fc3aba196ed lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6b32 expref: 11 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044394.756769:0:19739:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b3975b83400) 00010000:00010000:0.0:1784044394.756772:0:19739:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1784044394.756775:0:19739:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b38426fd400, rc 0) 00000100:00100000:0.0:1784044394.756847:0:19739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843734a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ffd836bb-8324-4bbb-bdb8-ace806f205ee+11:15625:x1870705565239296:12345-192.168.202.40@tcp:101:lctl.0 Request processed in 443us (822us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044394.756852:0:19739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 28 00000100:00100000:0.0:1784044394.782576:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044394.782700:0:18572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565239424 00000100:00100000:3.0:1784044394.782708:0:18572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565239424 00000100:00100000:3.0:1784044394.782769:0:18572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 29 00000100:00100000:3.0:1784044394.782775:0:18572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3842707480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35f5085c-0464-4087-9b4b-890cdd0735b4+5:15626:x1870705565239424:12345-192.168.202.40@tcp:101:lfs.0 00010000:00010000:3.0:1784044394.782792:0:18572:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784044394.782809:0:18572:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3982054c00/0x89871fc3aba196f4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcd3dffad52ca6b39 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044394.782870:0:18572:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3982055200/0x89871fc3aba196fb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044394.782882:0:18572:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3982055200/0x89871fc3aba196fb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044394.782891:0:18572:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3982055200/0x89871fc3aba196fb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18572 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784044394.782929:0:18572:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1784044394.782932:0:18572:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1784044394.782945:0:18572:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b3982055200/0x89871fc3aba196fb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044394.782961:0:18572:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3982054c00/0x89871fc3aba196f4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6b39 expref: 7 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044394.782976:0:18572:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3982055200/0x89871fc3aba196fb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6b39 expref: 6 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044394.782982:0:18572:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b3975b83400) 00010000:00010000:3.0:1784044394.782984:0:18572:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1784044394.782986:0:18572:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b3982055200, rc 0) 00000100:00100000:3.0:1784044394.783072:0:18572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3842707480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35f5085c-0464-4087-9b4b-890cdd0735b4+6:15626:x1870705565239424:12345-192.168.202.40@tcp:101:lfs.0 Request processed in 297us (503us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044394.783082:0:18572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 29 00000100:00100000:1.0:1784044394.792139:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044394.792456:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565239552 00000100:00100000:3.0:1784044394.792475:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565239552 00000100:00100000:3.0:1784044394.792618:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 30 00000100:00100000:3.0:1784044394.792630:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843ca9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35f5085c-0464-4087-9b4b-890cdd0735b4+6:15626:x1870705565239552:12345-192.168.202.40@tcp:101:lfs.0 00010000:00010000:3.0:1784044394.792667:0:17199:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784044394.792695:0:17199:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3982054c00/0x89871fc3aba19702 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcd3dffad52ca6b40 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044394.792774:0:17199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3982055000/0x89871fc3aba19709 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044394.792789:0:17199:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3982055000/0x89871fc3aba19709 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044394.792801:0:17199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3982055000/0x89871fc3aba19709 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044394.792814:0:17199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6e00/0x89871fc3aba19710 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044394.792983:0:17199:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6e00/0x89871fc3aba19710 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044394.792992:0:17199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6e00/0x89871fc3aba19710 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044394.793085:0:17199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6200/0x89871fc3aba19717 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044394.793113:0:17199:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6200/0x89871fc3aba19717 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044394.793119:0:17199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6200/0x89871fc3aba19717 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784044394.793314:0:17199:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1784044394.793319:0:17199:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1784044394.793342:0:17199:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6200/0x89871fc3aba19717 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044394.793354:0:17199:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3982055000/0x89871fc3aba19709 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044394.793361:0:17199:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3982055000/0x89871fc3aba19709 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044394.793368:0:17199:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3982055000/0x89871fc3aba19709 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044394.793374:0:17199:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3982055000 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:3.0:1784044394.793378:0:17199:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3982055000/0x89871fc3aba19709 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044394.793387:0:17199:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3982055000/0x89871fc3aba19709 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044394.793399:0:17199:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b3975b83400) 00010000:00010000:3.0:1784044394.793402:0:17199:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784044394.793408:0:17199:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3982055000/0x89871fc3aba19709 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044394.793602:0:17199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3982055000/0x89871fc3aba19709 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044394.793616:0:17199:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6e00/0x89871fc3aba19710 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044394.793620:0:17199:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6e00/0x89871fc3aba19710 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044394.793623:0:17199:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6e00/0x89871fc3aba19710 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044394.793626:0:17199:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38410b6e00 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:3.0:1784044394.793628:0:17199:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6e00/0x89871fc3aba19710 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044394.793631:0:17199:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6e00/0x89871fc3aba19710 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044394.793636:0:17199:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9b396f2a8100) 00010000:00010000:3.0:1784044394.793638:0:17199:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784044394.793640:0:17199:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6e00/0x89871fc3aba19710 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044394.793643:0:17199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6e00/0x89871fc3aba19710 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044394.793687:0:17199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3982054c00/0x89871fc3aba19702 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6b40 expref: 8 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044394.793719:0:17199:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6200/0x89871fc3aba19717 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6b40 expref: 7 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044394.793727:0:17199:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9b396f2a8d00) 00010000:00010000:3.0:1784044394.793730:0:17199:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1784044394.793732:0:17199:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b38410b6200, rc 0) 00000100:00100000:3.0:1784044394.793867:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843ca9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35f5085c-0464-4087-9b4b-890cdd0735b4+7:15626:x1870705565239552:12345-192.168.202.40@tcp:101:lfs.0 Request processed in 1239us (1746us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044394.793875:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 30 00000100:00100000:0.0:1784044394.796593:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1784044394.796711:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565239680 00000100:00100000:1.0:1784044394.796731:0:17212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565239680 00000100:00100000:1.0:1784044394.796940:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 6 00000100:00100000:1.0:1784044394.796952:0:17212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3842707800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:35f5085c-0464-4087-9b4b-890cdd0735b4+5:15626:x1870705565239680:12345-192.168.202.40@tcp:900:lfs.0 00000100:00100000:1.0:1784044394.797166:0:17212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3842707800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:35f5085c-0464-4087-9b4b-890cdd0735b4+5:15626:x1870705565239680:12345-192.168.202.40@tcp:900:lfs.0 Request processed in 216us (581us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044394.797351:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 6 00000100:00100000:0.0:1784044394.802227:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044394.802483:0:19739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565239936 00000100:00100000:3.0:1784044394.802494:0:19739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565239936 00000100:00100000:3.0:1784044394.802567:0:19739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 31 00000100:00100000:3.0:1784044394.802577:0:19739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843cadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35f5085c-0464-4087-9b4b-890cdd0735b4+7:15626:x1870705565239936:12345-192.168.202.40@tcp:101:lfs.0 00010000:00010000:3.0:1784044394.802602:0:19739:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784044394.802626:0:19739:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7600/0x89871fc3aba1971e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcd3dffad52ca6b47 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784044394.802783:0:19739:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1784044394.802914:0:19739:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7600/0x89871fc3aba1971e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6b47 expref: 9 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044394.802930:0:19739:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b3975b83400) 00010000:00010000:3.0:1784044394.802933:0:19739:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1784044394.802936:0:19739:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7600/0x89871fc3aba1971e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6b47 expref: 9 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044394.802971:0:19739:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b38410b7600, rc 0) 00000100:00100000:3.0:1784044394.804264:0:19739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843cadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35f5085c-0464-4087-9b4b-890cdd0735b4+8:15626:x1870705565239936:12345-192.168.202.40@tcp:101:lfs.0 Request processed in 1674us (2077us total) trans 8589934595 rc 301/301 00000100:00100000:3.0:1784044394.804275:0:19739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 31 00000100:00100000:3.0:1784044394.806489:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044394.806687:0:18572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565240192 00000100:00100000:0.0:1784044394.806699:0:18572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565240192 00000100:00100000:0.0:1784044394.806761:0:18572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 32 00000100:00100000:0.0:1784044394.806770:0:18572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843737800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35f5085c-0464-4087-9b4b-890cdd0735b4+8:15626:x1870705565240192:12345-192.168.202.40@tcp:36:lfs.0 00010000:00010000:0.0:1784044394.806856:0:18572:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784044394.806889:0:18572:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6200/0x89871fc3aba19717 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6b40 expref: 8 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044394.806907:0:18572:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9b396f2a8d00) 00010000:00010000:0.0:1784044394.806911:0:18572:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784044394.806934:0:18572:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc400/0x89871fc3aba1972c lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044394.806947:0:18572:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc400/0x89871fc3aba1972c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044394.806955:0:18572:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc400/0x89871fc3aba1972c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18572 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784044394.807326:0:18572:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000007bd378a2 reply state 00000000c82da5b3 transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc400/0x89871fc3aba1972c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044394.807343:0:18572:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc400/0x89871fc3aba1972c lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044394.807348:0:18572:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9b396f2a8d00) 00010000:00010000:0.0:1784044394.807350:0:18572:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:0.0:1784044394.807353:0:18572:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1784044394.807362:0:18572:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1784044394.807566:0:18572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843737800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35f5085c-0464-4087-9b4b-890cdd0735b4+9:15626:x1870705565240192:12345-192.168.202.40@tcp:36:lfs.0 Request processed in 795us (1085us total) trans 8589934596 rc 0/0 00000100:00100000:0.0:1784044394.807573:0:18572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 32 00000100:00100000:0.0:1784044394.817729:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044394.818302:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565240448 00000100:00100000:3.0:1784044394.818316:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565240448 00000100:00100000:3.0:1784044394.818514:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 2 00000100:00100000:3.0:1784044394.818529:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843cae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:35f5085c-0464-4087-9b4b-890cdd0735b4+9:15626:x1870705565240448:12345-192.168.202.40@tcp:35:lfs.0 00000100:00100000:3.0:1784044394.819580:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843cae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:35f5085c-0464-4087-9b4b-890cdd0735b4+10:15626:x1870705565240448:12345-192.168.202.40@tcp:35:lfs.0 Request processed in 1049us (1859us total) trans 8589934597 rc 0/0 00000100:00100000:3.0:1784044394.819589:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 2 00000100:00100000:2.0:1784044394.830434:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044394.831644:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565240704 00000100:00100000:3.0:1784044394.831693:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565240704 00000100:00100000:3.0:1784044394.831849:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 33 00000100:00100000:3.0:1784044394.831861:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38436a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35f5085c-0464-4087-9b4b-890cdd0735b4+10:15626:x1870705565240704:12345-192.168.202.40@tcp:101:lfs.0 00010000:00010000:3.0:1784044394.831897:0:17199:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784044394.831928:0:17199:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7600/0x89871fc3aba19733 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcd3dffad52ca6b4e expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044394.832045:0:17199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6e00/0x89871fc3aba1973a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044394.832063:0:17199:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6e00/0x89871fc3aba1973a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044394.832102:0:17199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6e00/0x89871fc3aba1973a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044394.832112:0:17199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6800/0x89871fc3aba19741 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044394.832117:0:17199:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6800/0x89871fc3aba19741 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044394.832122:0:17199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6800/0x89871fc3aba19741 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784044394.832281:0:17199:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1784044394.832379:0:17199:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6e00/0x89871fc3aba1973a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044394.832386:0:17199:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6e00/0x89871fc3aba1973a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044394.832392:0:17199:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6e00/0x89871fc3aba1973a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044394.832405:0:17199:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38410b6e00 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:3.0:1784044394.832410:0:17199:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6e00/0x89871fc3aba1973a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044394.832419:0:17199:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6e00/0x89871fc3aba1973a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044394.832432:0:17199:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b3975b83400) 00010000:00010000:3.0:1784044394.832434:0:17199:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784044394.832444:0:17199:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6e00/0x89871fc3aba1973a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044394.832448:0:17199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6e00/0x89871fc3aba1973a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044394.832459:0:17199:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6800/0x89871fc3aba19741 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044394.832462:0:17199:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6800/0x89871fc3aba19741 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044394.832466:0:17199:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6800/0x89871fc3aba19741 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044394.832470:0:17199:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38410b6800 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:3.0:1784044394.832471:0:17199:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6800/0x89871fc3aba19741 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044394.832474:0:17199:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6800/0x89871fc3aba19741 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044394.832478:0:17199:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9b396f2a8100) 00010000:00010000:3.0:1784044394.832479:0:17199:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784044394.832481:0:17199:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6800/0x89871fc3aba19741 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044394.832484:0:17199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6800/0x89871fc3aba19741 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044394.832514:0:17199:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7600/0x89871fc3aba19733 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6b4e expref: 12 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044394.832530:0:17199:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b3975b83400) 00010000:00010000:3.0:1784044394.832532:0:17199:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1784044394.832534:0:17199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7600/0x89871fc3aba19733 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6b4e expref: 12 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044394.832541:0:17199:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b38410b7600, rc 0) 00000100:00100000:3.0:1784044394.832607:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38436a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35f5085c-0464-4087-9b4b-890cdd0735b4+11:15626:x1870705565240704:12345-192.168.202.40@tcp:101:lfs.0 Request processed in 750us (2191us total) trans 8589934598 rc 301/301 00000100:00100000:3.0:1784044394.832613:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 33 00000100:00100000:1.0:1784044394.839676:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044394.841379:0:19739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565240832 00000100:00100000:3.0:1784044394.841397:0:19739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565240832 00000100:00100000:3.0:1784044394.841479:0:19739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 34 00000100:00100000:3.0:1784044394.841488:0:19739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843cab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35f5085c-0464-4087-9b4b-890cdd0735b4+11:15626:x1870705565240832:12345-192.168.202.40@tcp:101:lfs.0 00010000:00010000:3.0:1784044394.841515:0:19739:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784044394.841540:0:19739:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7600/0x89871fc3aba1974f lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcd3dffad52ca6b55 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044394.841669:0:19739:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6800/0x89871fc3aba19756 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19739 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044394.841692:0:19739:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6800/0x89871fc3aba19756 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19739 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044394.841709:0:19739:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6800/0x89871fc3aba19756 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19739 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784044394.841743:0:19739:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1784044394.841765:0:19739:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1784044394.841798:0:19739:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6800/0x89871fc3aba19756 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19739 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044394.841832:0:19739:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7600/0x89871fc3aba1974f lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6b55 expref: 13 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044394.841854:0:19739:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6800/0x89871fc3aba19756 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6b55 expref: 12 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044394.841865:0:19739:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9b396f2a8d00) 00010000:00010000:3.0:1784044394.841875:0:19739:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1784044394.841880:0:19739:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b38410b6800, rc 0) 00000100:00100000:3.0:1784044394.841978:0:19739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843cab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35f5085c-0464-4087-9b4b-890cdd0735b4+12:15626:x1870705565240832:12345-192.168.202.40@tcp:101:lfs.0 Request processed in 489us (2329us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044394.841988:0:19739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 34 00000100:00100000:0.0:1784044394.845670:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1784044394.845833:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565240960 00000100:00100000:1.0:1784044394.845848:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565240960 00000100:00100000:1.0:1784044394.845921:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 3 00000100:00100000:1.0:1784044394.845932:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843caed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:35f5085c-0464-4087-9b4b-890cdd0735b4+12:15626:x1870705565240960:12345-192.168.202.40@tcp:37:lfs.0 00000100:00100000:1.0:1784044394.849938:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843caed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:35f5085c-0464-4087-9b4b-890cdd0735b4+12:15626:x1870705565240960:12345-192.168.202.40@tcp:37:lfs.0 Request processed in 3989us (4277us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044394.849965:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 3 00000100:00100000:2.0:1784044394.852129:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044394.852342:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565241216 00000100:00100000:3.0:1784044394.852356:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565241216 00000100:00100000:3.0:1784044394.852416:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4 00000100:00100000:3.0:1784044394.852426:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397b8ddc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:35f5085c-0464-4087-9b4b-890cdd0735b4+12:15626:x1870705565241216:12345-192.168.202.40@tcp:35:lfs.0 00000100:00100000:0.0:1784044394.854018:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397b8ddc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:35f5085c-0464-4087-9b4b-890cdd0735b4+13:15626:x1870705565241216:12345-192.168.202.40@tcp:35:lfs.0 Request processed in 1574us (1885us total) trans 8589934599 rc 0/0 00000100:00100000:0.0:1784044394.854041:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4 00000040:00080000:3.0:1784044394.895493:0:17236:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1784044394.895589:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1784044394.895802:0:18572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565241344 00000100:00100000:1.0:1784044394.895816:0:18572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565241344 00000100:00100000:1.0:1784044394.895897:0:18572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 35 00000100:00100000:1.0:1784044394.895911:0:18572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843cae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ffd836bb-8324-4bbb-bdb8-ace806f205ee+11:15632:x1870705565241344:12345-192.168.202.40@tcp:101:bash.0 00010000:00010000:1.0:1784044394.895942:0:18572:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784044394.895978:0:18572:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b397cb18e00/0x89871fc3aba1975d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcd3dffad52ca6b5c expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044394.896085:0:18572:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b397cb19400/0x89871fc3aba19764 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044394.896106:0:18572:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b397cb19400/0x89871fc3aba19764 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044394.896133:0:18572:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b397cb19400/0x89871fc3aba19764 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044394.896148:0:18572:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b397cb18800/0x89871fc3aba1976b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044394.896155:0:18572:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b397cb18800/0x89871fc3aba1976b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044394.896163:0:18572:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b397cb18800/0x89871fc3aba1976b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044394.896551:0:18572:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b397cb19200/0x89871fc3aba19772 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044394.896586:0:18572:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b397cb19200/0x89871fc3aba19772 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044394.896594:0:18572:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b397cb19200/0x89871fc3aba19772 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18572 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784044394.896643:0:18572:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1784044394.896647:0:18572:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1784044394.896702:0:18572:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b397cb19200/0x89871fc3aba19772 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044394.896716:0:18572:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b397cb19400/0x89871fc3aba19764 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044394.896725:0:18572:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b397cb19400/0x89871fc3aba19764 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044394.896733:0:18572:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b397cb19400/0x89871fc3aba19764 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044394.896741:0:18572:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b397cb19400 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:1.0:1784044394.896747:0:18572:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b397cb19400/0x89871fc3aba19764 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044394.896757:0:18572:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b397cb19400/0x89871fc3aba19764 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044394.896773:0:18572:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b3975b83400) 00010000:00010000:1.0:1784044394.896776:0:18572:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784044394.896782:0:18572:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b397cb19400/0x89871fc3aba19764 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044394.896799:0:18572:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b397cb19400/0x89871fc3aba19764 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044394.896817:0:18572:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b397cb18800/0x89871fc3aba1976b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044394.896824:0:18572:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b397cb18800/0x89871fc3aba1976b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 18572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044394.896830:0:18572:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b397cb18800/0x89871fc3aba1976b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044394.896836:0:18572:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b397cb18800 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:1.0:1784044394.896839:0:18572:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b397cb18800/0x89871fc3aba1976b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044394.896845:0:18572:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b397cb18800/0x89871fc3aba1976b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 18572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044394.896853:0:18572:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9b396f2a8100) 00010000:00010000:1.0:1784044394.896856:0:18572:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784044394.896860:0:18572:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b397cb18800/0x89871fc3aba1976b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044394.896866:0:18572:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b397cb18800/0x89871fc3aba1976b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044394.896898:0:18572:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b397cb18e00/0x89871fc3aba1975d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6b5c expref: 13 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044394.896925:0:18572:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b397cb19200/0x89871fc3aba19772 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6b5c expref: 12 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044394.896933:0:18572:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9b396f2a8d00) 00010000:00010000:1.0:1784044394.896935:0:18572:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1784044394.896939:0:18572:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b397cb19200, rc 0) 00000100:00100000:1.0:1784044394.897150:0:18572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843cae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ffd836bb-8324-4bbb-bdb8-ace806f205ee+12:15632:x1870705565241344:12345-192.168.202.40@tcp:101:bash.0 Request processed in 1242us (1567us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044394.897160:0:18572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 35 00000100:00100000:2.0:1784044394.903956:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044394.904252:0:17211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565241472 00000100:00100000:0.0:1784044394.904266:0:17211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565241472 00000100:00100000:0.0:1784044394.904586:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 7 00000100:00100000:0.0:1784044394.904601:0:17211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38436a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:ffd836bb-8324-4bbb-bdb8-ace806f205ee+5:15632:x1870705565241472:12345-192.168.202.40@tcp:900:bash.0 00000100:00100000:0.0:1784044394.904756:0:17211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38436a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:ffd836bb-8324-4bbb-bdb8-ace806f205ee+5:15632:x1870705565241472:12345-192.168.202.40@tcp:900:bash.0 Request processed in 159us (825us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044394.904766:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 7 00000100:00100000:2.0:1784044394.908698:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044394.908792:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565241728 00000100:00100000:3.0:1784044394.908804:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565241728 00000100:00100000:3.0:1784044394.908876:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 36 00000100:00100000:3.0:1784044394.908888:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3945931500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ffd836bb-8324-4bbb-bdb8-ace806f205ee+12:15632:x1870705565241728:12345-192.168.202.40@tcp:101:bash.0 00010000:00010000:3.0:1784044394.908918:0:17199:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784044394.908958:0:17199:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7600/0x89871fc3aba19779 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcd3dffad52ca6b63 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044394.909123:0:17199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6e00/0x89871fc3aba19780 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044394.909139:0:17199:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6800/0x89871fc3aba19756 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6b55 expref: 12 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044394.909147:0:17199:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6e00/0x89871fc3aba19780 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044394.909223:0:17199:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6800/0x89871fc3aba19756 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6b55 expref: 12 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044394.909240:0:17199:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6800/0x89871fc3aba19756 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6b55 expref: 12 pid: 19739 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044394.909256:0:17199:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397a8a5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17199:1870705581071360:192.168.202.40@tcp:104: 00000100:00100000:2.0:1784044394.909472:0:17199:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b39453209c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784044394.915939:0:17199:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397a8a5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17199:1870705581071360:192.168.202.40@tcp:104: 00010000:00010000:2.0:1784044394.916056:0:17199:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6e00/0x89871fc3aba19780 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044394.917780:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044394.918250:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565241856 00000100:00100000:3.0:1784044394.918262:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565241856 00010000:00010000:3.0:1784044394.919847:0:17185:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6800/0x89871fc3aba19756 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6b55 expref: 13 pid: 19739 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044394.919935:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16 00000100:00100000:3.0:1784044394.919962:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843ca9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:35f5085c-0464-4087-9b4b-890cdd0735b4+13:2410:x1870705565241856:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784044394.919985:0:17185:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784044394.919994:0:17185:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6800/0x89871fc3aba19756 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6b55 expref: 13 pid: 19739 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044394.920044:0:17185:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6800/0x89871fc3aba19756 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6b55 expref: 13 pid: 19739 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044394.920080:0:17185:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6800/0x89871fc3aba19756 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6b55 expref: 13 pid: 19739 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044394.920106:0:17185:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9b396f2a8d00) 00010000:00010000:3.0:1784044394.920381:0:17185:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6e00/0x89871fc3aba19780 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044394.921752:0:17185:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6e00/0x89871fc3aba19780 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044394.921771:0:17185:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6e00/0x89871fc3aba19780 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044394.921837:0:17185:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784044394.921941:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843ca9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:35f5085c-0464-4087-9b4b-890cdd0735b4+12:2410:x1870705565241856:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 1991us (4168us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044394.921954:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16 00010000:00010000:2.0:1784044394.922276:0:17199:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6e00/0x89871fc3aba19780 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044394.922287:0:17199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6e00/0x89871fc3aba19780 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044394.922325:0:17199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b39586efe00/0x89871fc3aba19787 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044394.922338:0:17199:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b39586efe00/0x89871fc3aba19787 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044394.922348:0:17199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b39586efe00/0x89871fc3aba19787 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044394.922994:0:17199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b39586ef600/0x89871fc3aba1978e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044394.923027:0:17199:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b39586ef600/0x89871fc3aba1978e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044394.923036:0:17199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b39586ef600/0x89871fc3aba1978e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784044394.923052:0:17199:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1784044394.923092:0:17199:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6e00/0x89871fc3aba19780 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044394.923097:0:17199:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6e00/0x89871fc3aba19780 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044394.923103:0:17199:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6e00/0x89871fc3aba19780 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044394.923107:0:17199:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38410b6e00 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:2.0:1784044394.923742:0:17199:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6e00/0x89871fc3aba19780 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044394.923756:0:17199:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6e00/0x89871fc3aba19780 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044394.923773:0:17199:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9b396f2a8d00) 00010000:00010000:2.0:1784044394.923776:0:17199:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784044394.923782:0:17199:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6e00/0x89871fc3aba19780 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044394.923789:0:17199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6e00/0x89871fc3aba19780 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784044394.923806:0:17199:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000009c7cab6a reply state 00000000523eda81 transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff9b39586efe00/0x89871fc3aba19787 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044394.923832:0:17199:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b39586efe00/0x89871fc3aba19787 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044394.923839:0:17199:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9b397b61a000) 00010000:00010000:2.0:1784044394.923842:0:17199:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1784044394.923846:0:17199:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1784044394.923907:0:17199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7600/0x89871fc3aba19779 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6b63 expref: 15 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044394.923926:0:17199:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b39586ef600/0x89871fc3aba1978e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6b63 expref: 14 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044394.923934:0:17199:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b397b61a900) 00010000:00010000:2.0:1784044394.923936:0:17199:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:2.0:1784044394.923940:0:17199:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b39586ef600, rc 0) 00000100:00100000:2.0:1784044394.924037:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3945931500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ffd836bb-8324-4bbb-bdb8-ace806f205ee+15:15632:x1870705565241728:12345-192.168.202.40@tcp:101:bash.0 Request processed in 15149us (15351us total) trans 8589934600 rc 0/0 00000100:00100000:2.0:1784044394.924047:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 36 00000100:00100000:1.0:1784044394.938771:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044394.938886:0:19739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565241984 00000100:00100000:3.0:1784044394.938899:0:19739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565241984 00000100:00100000:3.0:1784044394.938993:0:19739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 37 00000100:00100000:3.0:1784044394.939017:0:19739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843ca9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ffd836bb-8324-4bbb-bdb8-ace806f205ee+15:15632:x1870705565241984:12345-192.168.202.40@tcp:101:bash.0 00010000:00010000:3.0:1784044394.939054:0:19739:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784044394.939082:0:19739:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6800/0x89871fc3aba1979c lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcd3dffad52ca6b6a expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044394.939294:0:19739:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6400/0x89871fc3aba197a3 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19739 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044394.939313:0:19739:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6400/0x89871fc3aba197a3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19739 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044394.939327:0:19739:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6400/0x89871fc3aba197a3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19739 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784044394.939539:0:19739:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1784044394.939544:0:19739:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1784044394.939576:0:19739:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6400/0x89871fc3aba197a3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19739 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044394.939590:0:19739:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6400/0x89871fc3aba197a3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19739 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044394.939626:0:19739:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6800/0x89871fc3aba1979c lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6b6a expref: 17 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044394.939665:0:19739:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6400/0x89871fc3aba197a3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6b6a expref: 16 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044394.939677:0:19739:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b397b61a900) 00010000:00010000:3.0:1784044394.939680:0:19739:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784044394.939685:0:19739:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b38410b6400, rc 0) 00000100:00100000:3.0:1784044394.939762:0:19739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843ca9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ffd836bb-8324-4bbb-bdb8-ace806f205ee+16:15632:x1870705565241984:12345-192.168.202.40@tcp:101:bash.0 Request processed in 759us (1008us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044394.939772:0:19739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 37 00000100:00100000:3.0:1784044394.945459:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1784044394.945614:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565242240 00000100:00100000:1.0:1784044394.945626:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565242240 00000100:00100000:1.0:1784044394.945695:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 5 00000100:00100000:1.0:1784044394.945704:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397a8a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ffd836bb-8324-4bbb-bdb8-ace806f205ee+16:15632:x1870705565242240:12345-192.168.202.40@tcp:35:bash.0 00000100:00100000:1.0:1784044394.946065:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397a8a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ffd836bb-8324-4bbb-bdb8-ace806f205ee+17:15632:x1870705565242240:12345-192.168.202.40@tcp:35:bash.0 Request processed in 361us (618us total) trans 8589934601 rc 0/0 00000100:00100000:1.0:1784044394.946078:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 5 00000100:00100000:0.0:1784044395.049479:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044395.049718:0:18572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565242496 00000100:00100000:2.0:1784044395.049733:0:18572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565242496 00000100:00100000:2.0:1784044395.049850:0:18572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 38 00000100:00100000:2.0:1784044395.049866:0:18572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843caed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ffd836bb-8324-4bbb-bdb8-ace806f205ee+17:15642:x1870705565242496:12345-192.168.202.40@tcp:101:lfs.0 00010000:00010000:2.0:1784044395.049901:0:18572:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784044395.049935:0:18572:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b39586ef400/0x89871fc3aba197aa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcd3dffad52ca6b71 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1784044395.049960:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00200000:2.0:1784044395.050527:0:18572:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1784044395.050694:0:18572:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b39586ef400/0x89871fc3aba197aa lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6b71 expref: 19 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044395.050712:0:18572:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b3975b83400) 00010000:00010000:2.0:1784044395.050715:0:18572:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1784044395.050721:0:18572:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b39586ef400/0x89871fc3aba197aa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6b71 expref: 19 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044395.050738:0:18572:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b39586ef400, rc 0) 00000100:00100000:2.0:1784044395.050840:0:18572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843caed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ffd836bb-8324-4bbb-bdb8-ace806f205ee+18:15642:x1870705565242496:12345-192.168.202.40@tcp:101:lfs.0 Request processed in 980us (1377us total) trans 8589934602 rc 301/301 00000100:00100000:2.0:1784044395.050848:0:18572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 38 00000100:00100000:2.0:1784044395.053970:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1784044395.055065:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565242752 00000100:00100000:1.0:1784044395.055082:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565242752 00000100:00100000:1.0:1784044395.055159:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 6 00000100:00100000:1.0:1784044395.055169:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3945932680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ffd836bb-8324-4bbb-bdb8-ace806f205ee+18:15642:x1870705565242752:12345-192.168.202.40@tcp:35:lfs.0 00000100:00100000:1.0:1784044395.055616:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3945932680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ffd836bb-8324-4bbb-bdb8-ace806f205ee+19:15642:x1870705565242752:12345-192.168.202.40@tcp:35:lfs.0 Request processed in 445us (1661us total) trans 8589934603 rc 0/0 00000100:00100000:1.0:1784044395.056091:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 6 00000100:00100000:3.0:1784044395.099545:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044395.099625:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565243008 00000100:00100000:2.0:1784044395.099661:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565243008 00000100:00100000:2.0:1784044395.099756:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 39 00000100:00100000:2.0:1784044395.099771:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397a8a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ffd836bb-8324-4bbb-bdb8-ace806f205ee+19:15645:x1870705565243008:12345-192.168.202.40@tcp:101:lfs.0 00010000:00010000:2.0:1784044395.099804:0:17199:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784044395.099831:0:17199:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b39586ef400/0x89871fc3aba197b8 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcd3dffad52ca6b78 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044395.100000:0:17199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b39586ee400/0x89871fc3aba197bf lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044395.100018:0:17199:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b39586ee400/0x89871fc3aba197bf lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044395.100032:0:17199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b39586ee400/0x89871fc3aba197bf lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784044395.100071:0:17199:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1784044395.100257:0:17199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b39586ef400/0x89871fc3aba197b8 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6b78 expref: 22 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044395.100280:0:17199:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b39586ee400/0x89871fc3aba197bf lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6b78 expref: 21 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044395.100301:0:17199:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b397b61a900) 00010000:00010000:2.0:1784044395.100304:0:17199:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784044395.100308:0:17199:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b39586ee400, rc 0) 00000100:00100000:2.0:1784044395.100396:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397a8a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ffd836bb-8324-4bbb-bdb8-ace806f205ee+21:15645:x1870705565243008:12345-192.168.202.40@tcp:101:lfs.0 Request processed in 628us (862us total) trans 8589934604 rc 0/0 00000100:00100000:2.0:1784044395.100405:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 39 00000100:00100000:2.0:1784044395.105366:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044395.105765:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565243136 00000100:00100000:3.0:1784044395.105779:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565243136 00000100:00100000:3.0:1784044395.105867:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 40 00000100:00100000:3.0:1784044395.105881:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3945931c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ffd836bb-8324-4bbb-bdb8-ace806f205ee+21:15645:x1870705565243136:12345-192.168.202.40@tcp:54:lfs.0 00000100:00100000:0.0:1784044395.106224:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044395.106256:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565243264 00000100:00100000:2.0:1784044395.106263:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565243264 00000100:00100000:2.0:1784044395.106314:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 0 00000100:00100000:2.0:1784044395.106323:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843cace00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ffd836bb-8324-4bbb-bdb8-ace806f205ee+22:2410:x1870705565243264:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784044395.106337:0:17201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6800/0x89871fc3aba197cd lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044395.106338:0:17186:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784044395.106368:0:17186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b39586ee400/0x89871fc3aba197bf lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6b78 expref: 22 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044395.108572:0:17201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6800/0x89871fc3aba197cd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044395.108759:0:17186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b397b61a900) 00010000:00010000:2.0:1784044395.108769:0:17186:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784044395.108771:0:17201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6800/0x89871fc3aba197cd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044395.108913:0:17201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6800/0x89871fc3aba197cd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044395.108924:0:17201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6800/0x89871fc3aba197cd lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044395.108933:0:17201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6800/0x89871fc3aba197cd lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044395.108936:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843cace00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ffd836bb-8324-4bbb-bdb8-ace806f205ee+21:2410:x1870705565243264:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 2563us (2664us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044395.108974:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 0 00010000:00010000:3.0:1784044395.109140:0:17201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38410b6800 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:3.0:1784044395.109146:0:17201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6800/0x89871fc3aba197cd lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044395.109155:0:17201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6800/0x89871fc3aba197cd lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044395.109169:0:17201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b397b61a900) 00010000:00010000:3.0:1784044395.109214:0:17201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1784044395.109219:0:17201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6800/0x89871fc3aba197cd lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044395.109227:0:17201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6800/0x89871fc3aba197cd lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044395.109284:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3945931c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ffd836bb-8324-4bbb-bdb8-ace806f205ee+20:15645:x1870705565243136:12345-192.168.202.40@tcp:54:lfs.0 Request processed in 3406us (3934us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044395.109293:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 40 00000100:00100000:2.0:1784044395.112904:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1784044395.113227:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565243520 00000100:00100000:1.0:1784044395.113244:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565243520 00000100:00100000:1.0:1784044395.113326:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 7 00000100:00100000:1.0:1784044395.113341:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3945931180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ffd836bb-8324-4bbb-bdb8-ace806f205ee+20:15645:x1870705565243520:12345-192.168.202.40@tcp:35:lfs.0 00000100:00100000:1.0:1784044395.115934:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3945931180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ffd836bb-8324-4bbb-bdb8-ace806f205ee+21:15645:x1870705565243520:12345-192.168.202.40@tcp:35:lfs.0 Request processed in 2579us (3755us total) trans 8589934605 rc 0/0 00000100:00100000:1.0:1784044395.115965:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 7 00000100:00100000:1.0:1784044395.354491:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044395.354753:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565243776 00000100:00100000:0.0:1784044395.354770:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565243776 00000100:00100000:0.0:1784044395.354872:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 41 00000100:00100000:0.0:1784044395.354888:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843ca9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ffd836bb-8324-4bbb-bdb8-ace806f205ee+21:15676:x1870705565243776:12345-192.168.202.40@tcp:101:cat.0 00010000:00010000:0.0:1784044395.354926:0:17200:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784044395.354953:0:17200:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd000/0x89871fc3aba197d4 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcd3dffad52ca6b7f expref: -99 pid: 17200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044395.355125:0:17200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd200/0x89871fc3aba197db lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044395.355143:0:17200:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd200/0x89871fc3aba197db lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044395.355154:0:17200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd200/0x89871fc3aba197db lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784044395.355214:0:17200:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1784044395.355393:0:17200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd000/0x89871fc3aba197d4 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6b7f expref: 24 pid: 17200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044395.355411:0:17200:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd200/0x89871fc3aba197db lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6b7f expref: 23 pid: 17200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044395.355419:0:17200:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b397b61a900) 00010000:00010000:0.0:1784044395.355421:0:17200:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784044395.355425:0:17200:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b38426fd200, rc 0) 00000100:00100000:0.0:1784044395.355498:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843ca9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ffd836bb-8324-4bbb-bdb8-ace806f205ee+23:15676:x1870705565243776:12345-192.168.202.40@tcp:101:cat.0 Request processed in 615us (1024us total) trans 8589934606 rc 0/0 00000100:00100000:0.0:1784044395.355504:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 41 00000100:00100000:0.0:1784044395.363559:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044395.363626:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044395.363761:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565244032 00000100:00100000:2.0:1784044395.363776:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565244032 00000100:00100000:2.0:1784044395.363858:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 8 00000100:00100000:2.0:1784044395.363871:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843cad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ffd836bb-8324-4bbb-bdb8-ace806f205ee+23:15676:x1870705565244032:12345-192.168.202.40@tcp:35:cat.0 00000100:00100000:2.0:1784044395.364315:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843cad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ffd836bb-8324-4bbb-bdb8-ace806f205ee+24:15676:x1870705565244032:12345-192.168.202.40@tcp:35:cat.0 Request processed in 445us (770us total) trans 8589934607 rc 0/0 00000100:00100000:2.0:1784044395.364324:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 8 00000100:00100000:3.0:1784044395.364456:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565244160 00000100:00100000:3.0:1784044395.364462:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565244160 00000100:00100000:3.0:1784044395.364517:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 1 00000100:00100000:3.0:1784044395.364525:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843cad880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ffd836bb-8324-4bbb-bdb8-ace806f205ee+24:2410:x1870705565244160:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784044395.364538:0:17185:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784044395.364568:0:17185:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd200/0x89871fc3aba197db lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6b7f expref: 24 pid: 17200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044395.364589:0:17185:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b397b61a900) 00010000:00010000:3.0:1784044395.364595:0:17185:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784044395.364616:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843cad880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ffd836bb-8324-4bbb-bdb8-ace806f205ee+23:2410:x1870705565244160:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 93us (991us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044395.364623:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 1 00000100:00100000:2.0:1784044395.421739:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044395.421900:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565244416 00000100:00100000:0.0:1784044395.421914:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565244416 00000100:00100000:0.0:1784044395.422044:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 42 00000100:00100000:0.0:1784044395.422056:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3945930000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ffd836bb-8324-4bbb-bdb8-ace806f205ee+23:15682:x1870705565244416:12345-192.168.202.40@tcp:101:dd.0 00010000:00010000:0.0:1784044395.422090:0:17199:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784044395.422128:0:17199:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd000/0x89871fc3aba197e9 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcd3dffad52ca6b86 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044395.422323:0:17199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc000/0x89871fc3aba197f0 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044395.422342:0:17199:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b39586ef600/0x89871fc3aba1978e lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6b63 expref: 24 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044395.422369:0:17199:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6400/0x89871fc3aba197a3 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6b6a expref: 24 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044395.422379:0:17199:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc000/0x89871fc3aba197f0 lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044395.422423:0:17199:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6400/0x89871fc3aba197a3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6b6a expref: 24 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044395.422438:0:17199:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6400/0x89871fc3aba197a3 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6b6a expref: 24 pid: 19739 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044395.422453:0:17199:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843cac380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17199:1870705581071488:192.168.202.40@tcp:104: 00010000:00010000:0.0:1784044395.422562:0:17199:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b39586ef600/0x89871fc3aba1978e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6b63 expref: 24 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044395.422571:0:17199:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b39586ef600/0x89871fc3aba1978e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6b63 expref: 24 pid: 17199 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044395.422580:0:17199:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843cafb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17199:1870705581071616:192.168.202.40@tcp:104: 00000100:00100000:0.0:1784044395.422600:0:17199:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b397414e900 going to sleep for 11 seconds 00000100:00100000:1.0:1784044395.426568:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044395.426600:0:17199:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843cac380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17199:1870705581071488:192.168.202.40@tcp:104: 00000100:00100000:1.0:1784044395.426616:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044395.426623:0:17199:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843cafb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17199:1870705581071616:192.168.202.40@tcp:104: 00010000:00010000:0.0:1784044395.426676:0:17199:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc000/0x89871fc3aba197f0 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044395.426735:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565244544 00000100:00100000:2.0:1784044395.426745:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565244544 00000100:00100000:3.0:1784044395.426782:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565244672 00000100:00100000:3.0:1784044395.426788:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565244672 00010000:00010000:2.0:1784044395.426796:0:17186:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6400/0x89871fc3aba197a3 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6b6a expref: 26 pid: 19739 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044395.426816:0:17185:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b39586ef600/0x89871fc3aba1978e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6b63 expref: 26 pid: 17199 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044395.426847:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 17 00000100:00100000:2.0:1784044395.426858:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843ca9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ffd836bb-8324-4bbb-bdb8-ace806f205ee+26:2409:x1870705565244544:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784044395.426879:0:17186:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1784044395.426881:0:17184:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00010000:00010000:2.0:1784044395.426890:0:17186:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6400/0x89871fc3aba197a3 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6b6a expref: 26 pid: 19739 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044395.426893:0:17184:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:2.0:1784044395.426909:0:17186:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6400/0x89871fc3aba197a3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6b6a expref: 26 pid: 19739 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044395.426938:0:17186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6400/0x89871fc3aba197a3 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6b6a expref: 26 pid: 19739 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044395.426971:0:17186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b397b61a900) 00010000:00010000:2.0:1784044395.426977:0:17186:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc000/0x89871fc3aba197f0 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044395.426988:0:17186:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc000/0x89871fc3aba197f0 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044395.426996:0:17186:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784044395.427111:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843ca9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ffd836bb-8324-4bbb-bdb8-ace806f205ee+25:2409:x1870705565244544:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 253us (557us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044395.428071:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 18 00000100:00100000:3.0:1784044395.428092:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397b96d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ffd836bb-8324-4bbb-bdb8-ace806f205ee+25:2409:x1870705565244672:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784044395.428104:0:17185:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784044395.428111:0:17185:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b39586ef600/0x89871fc3aba1978e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6b63 expref: 25 pid: 17199 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044395.428126:0:17185:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b39586ef600/0x89871fc3aba1978e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6b63 expref: 25 pid: 17199 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044395.428145:0:17185:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b39586ef600/0x89871fc3aba1978e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6b63 expref: 25 pid: 17199 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044395.428159:0:17185:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b397b61a900) 00010000:00010000:3.0:1784044395.428164:0:17185:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc000/0x89871fc3aba197f0 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044395.428186:0:17185:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc000/0x89871fc3aba197f0 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044395.428194:0:17185:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc000/0x89871fc3aba197f0 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044395.428222:0:17185:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784044395.428263:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397b96d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ffd836bb-8324-4bbb-bdb8-ace806f205ee+24:2409:x1870705565244672:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 174us (1647us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044395.428270:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 18 00010000:00010000:3.0:1784044395.428423:0:17199:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc000/0x89871fc3aba197f0 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044395.428432:0:17199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc000/0x89871fc3aba197f0 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784044395.428500:0:17199:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000100:00100000:2.0:1784044395.428719:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 17 00010000:00010000:3.0:1784044395.428726:0:17199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd000/0x89871fc3aba197e9 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6b86 expref: 25 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044395.428749:0:17199:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc000/0x89871fc3aba197f0 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6b86 expref: 23 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044395.428757:0:17199:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b397b61a900) 00010000:00010000:3.0:1784044395.428760:0:17199:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1784044395.428763:0:17199:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b38426fc000, rc 0) 00000100:00100000:3.0:1784044395.428802:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3945930000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ffd836bb-8324-4bbb-bdb8-ace806f205ee+23:15682:x1870705565244416:12345-192.168.202.40@tcp:101:dd.0 Request processed in 6747us (7078us total) trans 8589934608 rc 0/0 00000100:00100000:3.0:1784044395.428809:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 42 00000100:00100000:0.0:1784044395.434455:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044395.435846:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565244800 00000100:00100000:3.0:1784044395.435864:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565244800 00000100:00100000:3.0:1784044395.435960:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 43 00000100:00100000:3.0:1784044395.435972:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843cafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ffd836bb-8324-4bbb-bdb8-ace806f205ee+23:15682:x1870705565244800:12345-192.168.202.40@tcp:101:dd.0 00010000:00010000:3.0:1784044395.436014:0:17201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784044395.436043:0:17201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6800/0x89871fc3aba197fe lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcd3dffad52ca6b8d expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044395.436092:0:17201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6c00/0x89871fc3aba19805 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044395.436111:0:17201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6c00/0x89871fc3aba19805 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044395.436152:0:17201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6c00/0x89871fc3aba19805 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044395.436321:0:17201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6800/0x89871fc3aba197fe lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6b8d expref: 25 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044395.436344:0:17201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6c00/0x89871fc3aba19805 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6b8d expref: 24 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044395.436353:0:17201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b397b61a900) 00010000:00010000:3.0:1784044395.436357:0:17201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1784044395.436362:0:17201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b38410b6c00, rc 0) 00000100:00100000:3.0:1784044395.436458:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843cafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ffd836bb-8324-4bbb-bdb8-ace806f205ee+24:15682:x1870705565244800:12345-192.168.202.40@tcp:101:dd.0 Request processed in 487us (2017us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044395.436467:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 43 00000100:00100000:2.0:1784044395.444824:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044395.446776:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565245056 00000100:00100000:0.0:1784044395.446800:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565245056 00000100:00100000:0.0:1784044395.446978:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 44 00000100:00100000:0.0:1784044395.447001:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3945932a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ffd836bb-8324-4bbb-bdb8-ace806f205ee+24:15682:x1870705565245056:12345-192.168.202.40@tcp:36:dd.0 00010000:00010000:0.0:1784044395.447696:0:17200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd000/0x89871fc3aba1980c lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044395.447722:0:17200:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd000/0x89871fc3aba1980c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044395.447737:0:17200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd000/0x89871fc3aba1980c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1784044395.447798:0:17200:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:0.0:1784044395.447829:0:17200:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000a656cb83 reply state 000000002907103a transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd000/0x89871fc3aba1980c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044395.447844:0:17200:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd000/0x89871fc3aba1980c lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044395.447852:0:17200:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b397b61a900) 00010000:00010000:0.0:1784044395.447855:0:17200:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1784044395.447861:0:17200:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1784044395.448517:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3945932a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ffd836bb-8324-4bbb-bdb8-ace806f205ee+27:15682:x1870705565245056:12345-192.168.202.40@tcp:36:dd.0 Request processed in 1512us (3703us total) trans 8589934610 rc 0/0 00000100:00100000:0.0:1784044395.448529:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 44 00000020:00080000:0.0:1784044395.448552:0:17200:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1784044395.456577:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044395.458014:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565245184 00000100:00100000:3.0:1784044395.458029:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565245184 00000100:00100000:3.0:1784044395.458249:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 45 00000100:00100000:3.0:1784044395.458260:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3945930a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ffd836bb-8324-4bbb-bdb8-ace806f205ee+27:15682:x1870705565245184:12345-192.168.202.40@tcp:101:dd.0 00010000:00010000:3.0:1784044395.458294:0:17199:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784044395.458322:0:17199:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6800/0x89871fc3aba19813 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcd3dffad52ca6b94 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044395.458410:0:17199:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6800/0x89871fc3aba19813 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6b94 expref: 28 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044395.458429:0:17199:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6800/0x89871fc3aba19813 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6b94 expref: 28 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044395.458472:0:17199:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b397b61a900) 00010000:00010000:3.0:1784044395.458477:0:17199:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1784044395.458482:0:17199:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b38410b6800, rc 0) 00000100:00100000:3.0:1784044395.458564:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3945930a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ffd836bb-8324-4bbb-bdb8-ace806f205ee+28:15682:x1870705565245184:12345-192.168.202.40@tcp:101:dd.0 Request processed in 306us (2002us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044395.458570:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 45 00000100:00100000:2.0:1784044395.468136:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044395.468232:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565245440 00000100:00100000:3.0:1784044395.468246:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565245440 00000100:00100000:3.0:1784044395.468322:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 2 00000100:00100000:3.0:1784044395.468335:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3945933b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ffd836bb-8324-4bbb-bdb8-ace806f205ee+28:15682:x1870705565245440:12345-192.168.202.40@tcp:103:dd.0 00010000:00010000:3.0:1784044395.468356:0:17185:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784044395.468390:0:17185:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6800/0x89871fc3aba19813 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6b94 expref: 28 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044395.468415:0:17185:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b397b61a900) 00010000:00010000:3.0:1784044395.468422:0:17185:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784044395.468501:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3945933b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ffd836bb-8324-4bbb-bdb8-ace806f205ee+27:15682:x1870705565245440:12345-192.168.202.40@tcp:103:dd.0 Request processed in 169us (378us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044395.468509:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 2 00000040:00080000:3.0:1784044395.469933:0:17952:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1784044395.469951:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044395.470052:0:19739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565245568 00000100:00100000:2.0:1784044395.470058:0:19739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565245568 00000100:00100000:2.0:1784044395.470228:0:19739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 46 00000100:00100000:2.0:1784044395.470240:0:19739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843ca8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ffd836bb-8324-4bbb-bdb8-ace806f205ee+27:15682:x1870705565245568:12345-192.168.202.40@tcp:58:dd.0 00010000:00010000:2.0:1784044395.470709:0:19739:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b39586eea00/0x89871fc3aba1981a lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19739 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044395.470727:0:19739:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b39586eea00/0x89871fc3aba1981a lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19739 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044395.470737:0:19739:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b39586eea00/0x89871fc3aba1981a lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19739 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1784044395.471584:0:19739:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1784044395.471773:0:19739:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:2.0:1784044395.471884:0:19739:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:2.0:1784044395.472001:0:19739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843ca8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ffd836bb-8324-4bbb-bdb8-ace806f205ee+27:15682:x1870705565245568:12345-192.168.202.40@tcp:58:dd.0 Request processed in 1757us (2045us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044395.472013:0:19739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 46 00000100:00100000:0.0:1784044395.474604:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044395.474677:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565245696 00000100:00100000:3.0:1784044395.474690:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565245696 00000100:00100000:3.0:1784044395.474765:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 47 00000100:00100000:3.0:1784044395.474777:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843cac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ffd836bb-8324-4bbb-bdb8-ace806f205ee+27:15682:x1870705565245696:12345-192.168.202.40@tcp:101:dd.0 00010000:00010000:3.0:1784044395.474804:0:17200:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784044395.474850:0:17200:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6800/0x89871fc3aba19821 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcd3dffad52ca6b9b expref: -99 pid: 17200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044395.474927:0:17200:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b39586eea00/0x89871fc3aba1981a lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 19739 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044395.474940:0:17200:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6800/0x89871fc3aba19821 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6b9b expref: 28 pid: 17200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044395.474964:0:17200:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9b39586eea00/0x89871fc3aba1981a lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 19739 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044395.474979:0:17200:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6800/0x89871fc3aba19821 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6b9b expref: 28 pid: 17200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044395.474995:0:17200:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b397b61a900) 00010000:00010000:3.0:1784044395.474998:0:17200:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1784044395.475002:0:17200:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6800/0x89871fc3aba19821 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6b9b expref: 28 pid: 17200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044395.475011:0:17200:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b38410b6800, rc 0) 00000100:00100000:3.0:1784044395.475091:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843cac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ffd836bb-8324-4bbb-bdb8-ace806f205ee+28:15682:x1870705565245696:12345-192.168.202.40@tcp:101:dd.0 Request processed in 315us (498us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044395.475100:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 47 00010000:00010000:2.0:1784044395.534881:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784044395.597820:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1784044395.597861:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397a8a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1870705581071744:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1784044395.597950:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044395.598066:0:18710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581071744 00000100:00100000:2.0:1784044395.598074:0:18710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581071744 00000100:00100000:2.0:1784044395.598136:0:18710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1784044395.598146:0:18710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3945932d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1870705581071744:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1784044395.598211:0:18710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1784044395.598374:0:18710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3945932d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1870705581071744:12345-0@lo:13:osp-pre-1-1.0 Request processed in 229us (424us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044395.598381:0:18710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:2.0:1784044395.598404:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784044395.598420:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843735180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1870705581071872:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1784044395.598508:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044395.598560:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397a8a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1870705581071744:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1784044395.598828:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581071872 00000100:00100000:3.0:1784044395.598833:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581071872 00000100:00100000:3.0:1784044395.598864:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1784044395.598871:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3947eea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1870705581071872:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1784044395.598896:0:17206:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1784044395.598950:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3947eea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1870705581071872:12345-0@lo:41:osp-pre-1-0.0 Request processed in 80us (504us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044395.598958:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1784044395.598978:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1784044395.598996:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397a8a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1870705581072000:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784044395.599168:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843735180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1870705581071872:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1784044395.599396:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843caf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1870705581072256:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1784044395.599436:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044395.599465:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044395.599520:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581072256 00000100:00100000:0.0:1784044395.599527:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581072256 00000100:00100000:0.0:1784044395.599570:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1784044395.599579:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843cace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1870705581072256:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1784044395.599614:0:17206:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:0.0:1784044395.599672:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843cace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1870705581072256:12345-0@lo:41:osp-pre-0-1.0 Request processed in 93us (208us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044395.599679:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1784044395.599714:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843caf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1870705581072256:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1784044395.600127:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3947ee9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:99a46fb7-9af9-40f1-9c76-329d6781ee81:3641:1870705581072128:0@lo:400:kworker.0 00000100:00100000:3.0:1784044395.600170:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044395.600236:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581072128 00000100:00100000:1.0:1784044395.600243:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581072128 00000100:00100000:0.0:1784044395.600398:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843c54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1870705581072384:0@lo:400:kworker.0 00000100:00100000:2.0:1784044395.600437:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843c55500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1870705581072512:0@lo:400:kworker.0 00000100:00100000:0.0:1784044395.600450:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044395.600483:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3639:1870705581072896:0@lo:400:kworker.0 00000100:00100000:1.0:1784044395.600486:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1784044395.600495:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38437a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99a46fb7-9af9-40f1-9c76-329d6781ee81+24:3641:x1870705581072128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784044395.600511:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044395.600535:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38437a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:99a46fb7-9af9-40f1-9c76-329d6781ee81+24:3641:x1870705581072128:12345-0@lo:400:kworker.0 Request processed in 42us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044395.600535:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1784044395.600541:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3639:1870705581072768:0@lo:400:kworker.0 00000100:00100000:1.0:1784044395.600542:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1784044395.600562:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044395.600581:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3639:1870705581073280:0@lo:400:kworker.0 00000100:00100000:1.0:1784044395.600596:0:18572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581072896 00000100:00100000:1.0:1784044395.600600:0:18572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581072896 00000100:00100000:0.0:1784044395.600607:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044395.600640:0:18572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581072768 00000100:00100000:1.0:1784044395.600661:0:18572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581072768 00000100:00100000:0.0:1784044395.600662:0:18707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581072384 00000100:00100000:0.0:1784044395.600665:0:18707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581072384 00000100:00100000:2.0:1784044395.600685:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044395.600714:0:18707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1784044395.600736:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1870705581073024:0@lo:400:kworker.0 00000100:00100000:0.0:1784044395.600736:0:18707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843caf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1870705581072384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784044395.600767:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044395.600794:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1784044395.600796:0:18572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581073280 00000100:00100000:1.0:1784044395.600802:0:18572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581073280 00000100:00100000:0.0:1784044395.600812:0:18707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843caf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1870705581072384:12345-0@lo:400:kworker.0 Request processed in 87us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044395.600825:0:18707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1784044395.600831:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843c56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1870705581072640:0@lo:400:kworker.0 00000100:00100000:1.0:1784044395.600836:0:18572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581072512 00000100:00100000:1.0:1784044395.600841:0:18572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581072512 00000100:00100000:1.0:1784044395.600862:0:18572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581073024 00000100:00100000:1.0:1784044395.600866:0:18572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581073024 00000100:00100000:0.0:1784044395.600872:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843c54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1870705581072384:0@lo:400:kworker.0 00000100:00100000:2.0:1784044395.600890:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044395.600898:0:18572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1784044395.600905:0:19739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1784044395.600910:0:18572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843cad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1870705581072896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784044395.600913:0:19739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3842705c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1870705581072768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784044395.600931:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3640:1870705581073152:0@lo:400:kworker.0 00000100:00100000:1.0:1784044395.601003:0:18572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843cad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1870705581072896:12345-0@lo:400:kworker.0 Request processed in 95us (489us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044395.601016:0:18572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1784044395.601029:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044395.601035:0:18572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1784044395.601048:0:18572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38427b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1870705581073280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784044395.601081:0:18706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581072640 00000100:00100000:2.0:1784044395.601090:0:18706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581072640 00000100:00100000:2.0:1784044395.601245:0:18706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1784044395.601254:0:18706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843ce5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1870705581072640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784044395.601385:0:18706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843ce5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1870705581072640:12345-0@lo:400:kworker.0 Request processed in 126us (493us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044395.601392:0:18706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1784044395.601436:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843c56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1870705581072640:0@lo:400:kworker.0 00000100:00080000:2.0:1784044395.601533:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1784044395.601538:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1784044395.601541:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784044395.601552:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581073152 00000100:00100000:2.0:1784044395.601556:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581073152 00000100:00080000:2.0:1784044395.601572:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784044395.601589:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1784044395.601595:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843ce7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1870705581072512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784044395.601631:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843ce7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1870705581072512:12345-0@lo:400:kworker.0 Request processed in 35us (954us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044395.601637:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1784044395.601673:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843c55500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1870705581072512:0@lo:400:kworker.0 00000100:00100000:2.0:1784044395.601689:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1784044395.601696:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843ce6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1870705581073024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784044395.601737:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843ce6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1870705581073024:12345-0@lo:400:kworker.0 Request processed in 42us (972us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044395.601743:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00010000:00080000:2.0:1784044395.601766:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b3843d4f100 x1870705581073024/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044411 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784044395.601776:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1870705581073024:0@lo:400:kworker.0 00000100:00100000:0.0:1784044395.601880:0:19739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3842705c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1870705581072768:12345-0@lo:400:kworker.0 Request processed in 964us (1312us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044395.601890:0:19739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1784044395.601914:0:19739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1784044395.601923:0:19739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39759b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1870705581073152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784044395.602186:0:18572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38427b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1870705581073280:12345-0@lo:400:kworker.0 Request processed in 1130us (1566us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044395.602195:0:18572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1784044395.602257:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3639:1870705581072768:0@lo:400:kworker.0 00010000:00080000:1.0:1784044395.602274:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b3843d4e680 x1870705581073280/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044411 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784044395.602283:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3639:1870705581073280:0@lo:400:kworker.0 00000100:00100000:1.0:1784044395.602296:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3639:1870705581072896:0@lo:400:kworker.0 00000100:00100000:1.0:1784044395.602345:0:18710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581072000 00000100:00100000:1.0:1784044395.602351:0:18710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581072000 00000100:00080000:2.0:1784044395.602880:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784044395.602906:0:18710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1784044395.602920:0:18710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397a8a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1870705581072000:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1784044395.602944:0:18710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1784044395.603004:0:18710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397a8a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1870705581072000:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (3571us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044395.603025:0:18710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1784044395.603846:0:19739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39759b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1870705581073152:12345-0@lo:400:kworker.0 Request processed in 1920us (2828us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044395.603860:0:19739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1784044395.605323:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3640:1870705581073152:0@lo:400:kworker.0 00000100:00100000:3.0:1784044395.608436:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3947ee9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:99a46fb7-9af9-40f1-9c76-329d6781ee81:3641:1870705581072128:0@lo:400:kworker.0 00000100:00100000:3.0:1784044395.609133:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397a8a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1870705581072000:0@lo:13:osp-pre-1-0.0 00000040:00080000:3.0:1784044395.917601:0:17236:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1784044395.917615:0:17236:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1784044395.917680:0:17236:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1784044395.917694:0:17236:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1784044395.917844:0:17236:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b397a8a7100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17236:1870705581073408:192.168.202.40@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1784044395.917954:0:17236:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b39453209c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784044395.938570:0:17236:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b397a8a7100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17236:1870705581073408:192.168.202.40@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1784044395.943814:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044395.944026:0:18572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565245824 00000100:00100000:2.0:1784044395.944037:0:18572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565245824 00000100:00100000:2.0:1784044395.944114:0:18572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 48 00000100:00100000:2.0:1784044395.944126:0:18572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843caa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ffd836bb-8324-4bbb-bdb8-ace806f205ee+28:15683:x1870705565245824:12345-192.168.202.40@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1784044395.944164:0:18572:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1784044395.944333:0:18572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843caa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ffd836bb-8324-4bbb-bdb8-ace806f205ee+28:15683:x1870705565245824:12345-192.168.202.40@tcp:53:lhsmtool_posix.0 Request processed in 209us (527us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044395.944341:0:18572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 48 00000100:00100000:0.0:1784044395.949620:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044395.955758:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565245952 00000100:00100000:2.0:1784044395.955778:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565245952 00000100:00100000:2.0:1784044395.955865:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 49 00000100:00100000:2.0:1784044395.955878:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38427b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ffd836bb-8324-4bbb-bdb8-ace806f205ee+28:15683:x1870705565245952:12345-192.168.202.40@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1784044395.955961:0:17199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b39586ef800/0x89871fc3aba19828 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044395.955978:0:17199:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b39586ef800/0x89871fc3aba19828 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044395.956010:0:17199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b39586ef800/0x89871fc3aba19828 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044395.956560:0:17199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b39586efc00/0x89871fc3aba1982f lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044395.956573:0:17199:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b39586efc00/0x89871fc3aba1982f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044395.956581:0:17199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b39586efc00/0x89871fc3aba1982f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044395.956612:0:17199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b39586ee200/0x89871fc3aba19836 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044395.956621:0:17199:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b39586ee200/0x89871fc3aba19836 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044395.956628:0:17199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b39586ee200/0x89871fc3aba19836 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784044395.956693:0:17199:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1784044395.956698:0:17199:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1784044395.956710:0:17199:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b39586ee200/0x89871fc3aba19836 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044395.956722:0:17199:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b39586ef800/0x89871fc3aba19828 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044395.956728:0:17199:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b39586ef800/0x89871fc3aba19828 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044395.956746:0:17199:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b39586ef800/0x89871fc3aba19828 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044395.956752:0:17199:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b39586ef800 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:2.0:1784044395.956756:0:17199:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b39586ef800/0x89871fc3aba19828 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044395.956764:0:17199:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b39586ef800/0x89871fc3aba19828 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044395.956776:0:17199:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9b397b61a700) 00010000:00010000:2.0:1784044395.956779:0:17199:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784044395.956783:0:17199:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b39586ef800/0x89871fc3aba19828 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044395.956788:0:17199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b39586ef800/0x89871fc3aba19828 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044395.956802:0:17199:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b39586efc00/0x89871fc3aba1982f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044395.956808:0:17199:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b39586efc00/0x89871fc3aba1982f lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044395.956814:0:17199:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b39586efc00/0x89871fc3aba1982f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044395.956819:0:17199:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b39586efc00 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:2.0:1784044395.956822:0:17199:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b39586efc00/0x89871fc3aba1982f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044395.956835:0:17199:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b39586efc00/0x89871fc3aba1982f lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044395.956842:0:17199:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff9b397b61a600) 00010000:00010000:2.0:1784044395.956844:0:17199:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784044395.956847:0:17199:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b39586efc00/0x89871fc3aba1982f lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044395.956852:0:17199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b39586efc00/0x89871fc3aba1982f lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044395.956866:0:17199:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b39586ee200/0x89871fc3aba19836 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044395.956872:0:17199:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b39586ee200/0x89871fc3aba19836 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044395.956877:0:17199:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b39586ee200/0x89871fc3aba19836 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044395.956882:0:17199:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b39586ee200 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:2.0:1784044395.956884:0:17199:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b39586ee200/0x89871fc3aba19836 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044395.956890:0:17199:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b39586ee200/0x89871fc3aba19836 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044395.956896:0:17199:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b397b61a900) 00010000:00010000:2.0:1784044395.956898:0:17199:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784044395.956901:0:17199:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b39586ee200/0x89871fc3aba19836 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044395.956916:0:17199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b39586ee200/0x89871fc3aba19836 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044395.957070:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38427b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ffd836bb-8324-4bbb-bdb8-ace806f205ee+28:15683:x1870705565245952:12345-192.168.202.40@tcp:34:lhsmtool_posix.0 Request processed in 1191us (7457us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044395.957079:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 49 00000100:00100000:1.0:1784044395.962939:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044395.963870:0:19739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565246208 00000100:00100000:0.0:1784044395.963883:0:19739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565246208 00000100:00100000:0.0:1784044395.963985:0:19739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 50 00000100:00100000:0.0:1784044395.963998:0:19739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843caad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ffd836bb-8324-4bbb-bdb8-ace806f205ee+28:15683:x1870705565246208:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1784044395.964023:0:19739:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784044395.964044:0:19739:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd200/0x89871fc3aba1983d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcd3dffad52ca6ba2 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044395.964300:0:19739:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3940030e00/0x89871fc3aba19844 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 19739 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044395.964338:0:19739:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3940030e00/0x89871fc3aba19844 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 19739 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044395.964352:0:19739:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3940030e00/0x89871fc3aba19844 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 19739 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784044395.964365:0:19739:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1784044395.964624:0:19739:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3940030e00/0x89871fc3aba19844 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 19739 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044395.964632:0:19739:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3940030e00/0x89871fc3aba19844 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 19739 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044395.964639:0:19739:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3940030e00/0x89871fc3aba19844 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 19739 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044395.964655:0:19739:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3940030e00 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:0.0:1784044395.964659:0:19739:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3940030e00/0x89871fc3aba19844 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 19739 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044395.964674:0:19739:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3940030e00/0x89871fc3aba19844 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 19739 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044395.964687:0:19739:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b397b61a900) 00010000:00010000:0.0:1784044395.964690:0:19739:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1784044395.964695:0:19739:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3940030e00/0x89871fc3aba19844 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 19739 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044395.964701:0:19739:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3940030e00/0x89871fc3aba19844 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 19739 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044395.964756:0:19739:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd200/0x89871fc3aba1983d lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6ba2 expref: 30 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044395.964781:0:19739:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9b397b61a700) 00010000:00010000:0.0:1784044395.964784:0:19739:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1784044395.964788:0:19739:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd200/0x89871fc3aba1983d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6ba2 expref: 30 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044395.964799:0:19739:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b38426fd200, rc 0) 00000100:00100000:0.0:1784044395.964937:0:19739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843caad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ffd836bb-8324-4bbb-bdb8-ace806f205ee+29:15683:x1870705565246208:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 Request processed in 942us (2007us total) trans 8589934611 rc 301/301 00000100:00100000:0.0:1784044395.964945:0:19739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 50 00000100:00100000:1.0:1784044395.971978:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044395.972086:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565246336 00000100:00100000:3.0:1784044395.972097:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565246336 00000100:00100000:3.0:1784044395.972627:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 51 00000100:00100000:3.0:1784044395.972650:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843ca8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ffd836bb-8324-4bbb-bdb8-ace806f205ee+29:15683:x1870705565246336:12345-192.168.202.40@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1784044395.972702:0:17201:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1784044395.972842:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843ca8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ffd836bb-8324-4bbb-bdb8-ace806f205ee+29:15683:x1870705565246336:12345-192.168.202.40@tcp:53:lhsmtool_posix.0 Request processed in 204us (873us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044395.972851:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 51 00000100:00100000:1.0:1784044395.977885:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044395.978287:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565246592 00000100:00100000:2.0:1784044395.978297:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565246592 00000100:00100000:2.0:1784044395.978367:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 52 00000100:00100000:2.0:1784044395.978388:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843cabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ffd836bb-8324-4bbb-bdb8-ace806f205ee+29:15683:x1870705565246592:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1784044395.978424:0:17199:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784044395.978448:0:17199:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b39586ee200/0x89871fc3aba19852 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcd3dffad52ca6ba9 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1784044395.978885:0:17199:0:(osp_internal.h:570:osp_update_last_fid()) Gap in objids: start=[0x2c0000401:0x6:0x0], count =28 00000004:00080000:2.0:1784044395.978893:0:17199:0:(osp_object.c:1645:osp_create()) Writing gap [0x2c0000401:0x6:0x0]+28 in llog 00000004:00080000:2.0:1784044395.978919:0:17199:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x22:0x0], index 1: 0 00010000:00010000:2.0:1784044395.979069:0:17199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b39586efc00/0x89871fc3aba19859 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044395.979084:0:17199:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b39586efc00/0x89871fc3aba19859 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044395.979095:0:17199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b39586efc00/0x89871fc3aba19859 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044395.980013:0:17199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b39586ee200/0x89871fc3aba19852 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6ba9 expref: 32 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044395.980068:0:17199:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b39586efc00/0x89871fc3aba19859 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6ba9 expref: 31 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044395.980080:0:17199:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9b397b61a600) 00010000:00010000:2.0:1784044395.980084:0:17199:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784044395.980087:0:17199:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b39586efc00, rc 0) 00000100:00100000:2.0:1784044395.980290:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843cabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ffd836bb-8324-4bbb-bdb8-ace806f205ee+31:15683:x1870705565246592:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 Request processed in 1913us (2414us total) trans 8589934612 rc 0/0 00000100:00100000:2.0:1784044395.980300:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 52 00000100:00100000:1.0:1784044395.988520:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044395.988678:0:19739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565246848 00000100:00100000:0.0:1784044395.988689:0:19739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565246848 00000100:00100000:0.0:1784044395.988752:0:19739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 53 00000100:00100000:0.0:1784044395.988763:0:19739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843caaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ffd836bb-8324-4bbb-bdb8-ace806f205ee+31:15683:x1870705565246848:12345-192.168.202.40@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1784044395.988836:0:19739:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784044395.988875:0:19739:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b39586efc00/0x89871fc3aba19859 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6ba9 expref: 31 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044395.988900:0:19739:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9b397b61a600) 00010000:00010000:0.0:1784044395.988919:0:19739:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784044395.988948:0:19739:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3940030000/0x89871fc3aba19867 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19739 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044395.988964:0:19739:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3940030000/0x89871fc3aba19867 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19739 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044395.988979:0:19739:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3940030000/0x89871fc3aba19867 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19739 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044395.989064:0:19739:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3940031e00/0x89871fc3aba1986e lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x848bc098 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19739 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044395.989072:0:19739:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b3940031e00/0x89871fc3aba1986e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x848bc098 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19739 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044395.989079:0:19739:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b3940031e00/0x89871fc3aba1986e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x848bc098 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19739 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044395.989139:0:19739:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3940030000/0x89871fc3aba19867 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19739 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044395.989152:0:19739:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3940030000/0x89871fc3aba19867 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 19739 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044395.989159:0:19739:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3940030000/0x89871fc3aba19867 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19739 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044395.989166:0:19739:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3940030000 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:0.0:1784044395.989170:0:19739:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3940030000/0x89871fc3aba19867 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19739 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044395.989250:0:19739:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3940030000/0x89871fc3aba19867 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 19739 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044395.989259:0:19739:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9b396f2a8d00) 00010000:00010000:0.0:1784044395.989269:0:19739:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784044395.989273:0:19739:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3940030000/0x89871fc3aba19867 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19739 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044395.989279:0:19739:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3940030000/0x89871fc3aba19867 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19739 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044395.989311:0:19739:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3940031e00/0x89871fc3aba1986e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x848bc098 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19739 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044395.989317:0:19739:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3940031e00/0x89871fc3aba1986e lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x848bc098 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19739 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044395.989330:0:19739:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3940031e00/0x89871fc3aba1986e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x848bc098 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19739 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044395.989335:0:19739:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3940031e00 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:0.0:1784044395.989338:0:19739:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3940031e00/0x89871fc3aba1986e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x848bc098 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19739 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044395.989344:0:19739:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3940031e00/0x89871fc3aba1986e lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x848bc098 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19739 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044395.989359:0:19739:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x848bc098 (ffff9b3975b83300) 00010000:00010000:0.0:1784044395.989362:0:19739:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784044395.989365:0:19739:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3940031e00/0x89871fc3aba1986e lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x848bc098 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19739 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044395.989371:0:19739:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3940031e00/0x89871fc3aba1986e lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x848bc098 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19739 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044395.989531:0:19739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843caaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ffd836bb-8324-4bbb-bdb8-ace806f205ee+30:15683:x1870705565246848:12345-192.168.202.40@tcp:36:lhsmtool_posix.0 Request processed in 768us (1020us total) trans 0 rc -2/-2 00000100:00100000:0.0:1784044395.989539:0:19739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 53 00000100:00100000:0.0:1784044395.993735:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044395.994065:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565246976 00000100:00100000:3.0:1784044395.994075:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565246976 00000100:00100000:3.0:1784044396.000375:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 54 00000100:00100000:3.0:1784044396.000401:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38427b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ffd836bb-8324-4bbb-bdb8-ace806f205ee+30:15683:x1870705565246976:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1784044396.000537:0:17201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784044396.000564:0:17201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7e00/0x89871fc3aba19875 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcd3dffad52ca6bb0 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044396.000600:0:17201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6400/0x89871fc3aba1987c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044396.000613:0:17201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6400/0x89871fc3aba1987c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044396.000625:0:17201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6400/0x89871fc3aba1987c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044396.000746:0:17201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7e00/0x89871fc3aba19875 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6bb0 expref: 32 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044396.000764:0:17201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6400/0x89871fc3aba1987c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6bb0 expref: 31 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044396.000771:0:17201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9b396f2a8800) 00010000:00010000:3.0:1784044396.000774:0:17201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1784044396.000778:0:17201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b38410b6400, rc 0) 00000100:00100000:3.0:1784044396.000839:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38427b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ffd836bb-8324-4bbb-bdb8-ace806f205ee+31:15683:x1870705565246976:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 Request processed in 452us (7115us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044396.000846:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 54 00000100:00100000:1.0:1784044396.005763:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044396.006084:0:18572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565247232 00000100:00100000:3.0:1784044396.006095:0:18572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565247232 00000100:00100000:3.0:1784044396.006422:0:18572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 55 00000100:00100000:3.0:1784044396.006436:0:18572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843ca9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ffd836bb-8324-4bbb-bdb8-ace806f205ee+31:15683:x1870705565247232:12345-192.168.202.40@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1784044396.006520:0:18572:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7600/0x89871fc3aba19883 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044396.006537:0:18572:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7600/0x89871fc3aba19883 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044396.006549:0:18572:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7600/0x89871fc3aba19883 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18572 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1784044396.006792:0:18572:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].2, 88 off8344 00000004:00080000:3.0:1784044396.006802:0:18572:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 589177626557ns, next at 590177624137ns, rc = 0 00000004:00010000:3.0:1784044396.006899:0:18572:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000001d059945 reply state 000000000b79eba7 transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7600/0x89871fc3aba19883 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044396.006913:0:18572:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7600/0x89871fc3aba19883 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044396.006920:0:18572:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9b396f2a8800) 00010000:00010000:3.0:1784044396.006923:0:18572:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1784044396.006926:0:18572:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1784044396.007065:0:18572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843ca9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ffd836bb-8324-4bbb-bdb8-ace806f205ee+33:15683:x1870705565247232:12345-192.168.202.40@tcp:36:lhsmtool_posix.0 Request processed in 632us (1318us total) trans 8589934613 rc 0/0 00000100:00100000:3.0:1784044396.007074:0:18572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 55 00000100:00100000:1.0:1784044396.010950:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044396.011030:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565247360 00000100:00100000:2.0:1784044396.011039:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565247360 00000100:00100000:2.0:1784044396.011093:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 56 00000100:00100000:2.0:1784044396.011110:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843ca9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ffd836bb-8324-4bbb-bdb8-ace806f205ee+33:15683:x1870705565247360:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1784044396.011133:0:17200:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784044396.011159:0:17200:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b39586ee200/0x89871fc3aba1988a lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcd3dffad52ca6bb7 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044396.011240:0:17200:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b39586ee200/0x89871fc3aba1988a lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6bb7 expref: 34 pid: 17200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044396.011255:0:17200:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b39586ee200/0x89871fc3aba1988a lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6bb7 expref: 34 pid: 17200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044396.011276:0:17200:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9b396f2a8800) 00010000:00010000:2.0:1784044396.011279:0:17200:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1784044396.011296:0:17200:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b39586ee200, rc 0) 00000100:00100000:2.0:1784044396.011350:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843ca9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ffd836bb-8324-4bbb-bdb8-ace806f205ee+34:15683:x1870705565247360:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 Request processed in 248us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044396.011357:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 56 00000100:00100000:1.0:1784044396.015745:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044396.015859:0:18707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565247488 00000100:00100000:0.0:1784044396.015881:0:18707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565247488 00000100:00100000:0.0:1784044396.015962:0:18707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 27 00000100:00100000:0.0:1784044396.015974:0:18707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843735180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ffd836bb-8324-4bbb-bdb8-ace806f205ee+5:2409:x1870705565247488:12345-192.168.202.40@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1784044396.016294:0:18707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843735180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ffd836bb-8324-4bbb-bdb8-ace806f205ee+6:2409:x1870705565247488:12345-192.168.202.40@tcp:2:lhsmtool_posix.0 Request processed in 321us (560us total) trans 8589934595 rc 0/0 00000100:00100000:0.0:1784044396.016302:0:18707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 27 00000100:00080000:2.0:1784044396.016730:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784044396.019842:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044396.019941:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565247744 00000100:00100000:2.0:1784044396.019950:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565247744 00000100:00100000:2.0:1784044396.020010:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 9 00000100:00100000:2.0:1784044396.020022:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39412e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ffd836bb-8324-4bbb-bdb8-ace806f205ee+34:15683:x1870705565247744:12345-192.168.202.40@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1784044396.020297:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39412e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ffd836bb-8324-4bbb-bdb8-ace806f205ee+35:15683:x1870705565247744:12345-192.168.202.40@tcp:35:lhsmtool_posix.0 Request processed in 277us (464us total) trans 8589934614 rc 0/0 00000100:00100000:2.0:1784044396.020307:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 9 00000100:00100000:3.0:1784044396.023272:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044396.023663:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565248000 00000100:00100000:2.0:1784044396.023679:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565248000 00000100:00100000:2.0:1784044396.023773:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 57 00000100:00100000:2.0:1784044396.023784:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397a8a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ffd836bb-8324-4bbb-bdb8-ace806f205ee+35:15683:x1870705565248000:12345-192.168.202.40@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1784044396.023930:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397a8a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ffd836bb-8324-4bbb-bdb8-ace806f205ee+35:15683:x1870705565248000:12345-192.168.202.40@tcp:57:lhsmtool_posix.0 Request processed in 141us (660us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044396.023937:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 57 00000100:00100000:1.0:1784044396.027735:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044396.028372:0:18572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565248128 00000100:00100000:3.0:1784044396.028499:0:18572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565248128 00000100:00100000:2.0:1784044396.028713:0:18572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 58 00000100:00100000:2.0:1784044396.028725:0:18572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39412ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ffd836bb-8324-4bbb-bdb8-ace806f205ee+35:15683:x1870705565248128:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1784044396.028748:0:18572:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784044396.028771:0:18572:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b39586ef800/0x89871fc3aba19891 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcd3dffad52ca6bbe expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044396.028847:0:18572:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b39586ef000/0x89871fc3aba19898 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 18572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044396.028869:0:18572:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b39586ef000/0x89871fc3aba19898 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 18572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044396.028881:0:18572:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b39586ef000/0x89871fc3aba19898 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 18572 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784044396.028927:0:18572:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1784044396.028947:0:18572:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b39586ef000/0x89871fc3aba19898 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 18572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044396.028973:0:18572:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b39586ef800/0x89871fc3aba19891 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6bbe expref: 37 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044396.028992:0:18572:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b39586ef000/0x89871fc3aba19898 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6bbe expref: 36 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044396.029001:0:18572:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9b396f2a8800) 00010000:00010000:2.0:1784044396.029004:0:18572:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1784044396.029008:0:18572:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b39586ef000, rc 0) 00000100:00100000:2.0:1784044396.029227:0:18572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39412ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ffd836bb-8324-4bbb-bdb8-ace806f205ee+36:15683:x1870705565248128:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 Request processed in 504us (1501us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044396.029235:0:18572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 58 00000100:00100000:1.0:1784044396.033041:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044396.033372:0:18933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565248256 00000100:00100000:2.0:1784044396.033392:0:18933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565248256 00000100:00100000:2.0:1784044396.033605:0:18933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 28 00000100:00100000:2.0:1784044396.033617:0:18933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39412eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ffd836bb-8324-4bbb-bdb8-ace806f205ee+6:2407:x1870705565248256:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1784044396.033634:0:18933:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784044396.033681:0:18933:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000223ad1ac/0x89871fc3aba1989f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcd3dffad52ca6bc5 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784044396.033708:0:18933:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a565b6b, blocks: 0x0 00010000:00010000:2.0:1784044396.033743:0:18933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=589s v=(0 0) 00010000:00010000:2.0:1784044396.033748:0:18933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784044396.033759:0:18933:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000223ad1ac/0x89871fc3aba1989f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6bc5 expref: 7 pid: 18933 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044396.033779:0:18933:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000223ad1ac/0x89871fc3aba1989f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6bc5 expref: 7 pid: 18933 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044396.033791:0:18933:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b39586ef600, rc 0) 00000100:00100000:2.0:1784044396.033853:0:18933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39412eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ffd836bb-8324-4bbb-bdb8-ace806f205ee+7:2407:x1870705565248256:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 Request processed in 239us (826us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044396.033860:0:18933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 28 00000100:00100000:1.0:1784044396.038743:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044396.038852:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565248512 00000100:00100000:0.0:1784044396.038861:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565248512 00000100:00100000:0.0:1784044396.038928:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 59 00000100:00100000:0.0:1784044396.038938:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39412eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ffd836bb-8324-4bbb-bdb8-ace806f205ee+36:15683:x1870705565248512:12345-192.168.202.40@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1784044396.039092:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39412eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ffd836bb-8324-4bbb-bdb8-ace806f205ee+36:15683:x1870705565248512:12345-192.168.202.40@tcp:57:lhsmtool_posix.0 Request processed in 155us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044396.039109:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 59 00000100:00100000:1.0:1784044396.043784:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044396.043879:0:19739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565248640 00000100:00100000:0.0:1784044396.043888:0:19739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565248640 00000100:00100000:0.0:1784044396.043988:0:19739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 60 00000100:00100000:0.0:1784044396.043999:0:19739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39412e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ffd836bb-8324-4bbb-bdb8-ace806f205ee+36:15683:x1870705565248640:12345-192.168.202.40@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1784044396.051591:0:17179:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000004:00080000:2.0:1784044396.051623:0:17179:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000001:00080000:2.0:1784044396.051775:0:17179:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000100:00100000:0.0:1784044396.051840:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784044396.051864:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b38427b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1870705581073536:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1784044396.051933:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044396.052093:0:19739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39412e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ffd836bb-8324-4bbb-bdb8-ace806f205ee+19:15683:x1870705565248640:12345-192.168.202.40@tcp:44:lhsmtool_posix.0 Request processed in 8093us (8317us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044396.052103:0:19739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 60 00000100:00100000:2.0:1784044396.052466:0:18707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581073536 00000100:00100000:2.0:1784044396.052473:0:18707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581073536 00000100:00100000:2.0:1784044396.052512:0:18707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1784044396.052520:0:18707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38427b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1870705581073536:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1784044396.052631:0:18707:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1784044396.052634:0:18707:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1784044396.052636:0:18707:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1784044396.052638:0:18707:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb ctime from disk: 1784044395 -> 1784044395 00002000:00010000:2.0:1784044396.052663:0:18707:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1784044396.052699:0:18707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38427b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3638:x1870705581073536:12345-0@lo:2:osp-syn-1-0.0 Request processed in 180us (765us total) trans 8589934596 rc 0/0 00000100:00100000:2.0:1784044396.052706:0:18707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000004:00080000:2.0:1784044396.052739:0:3638:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b38427b6a00/2, rc 0, transno 8589934596 00000100:00100000:2.0:1784044396.052744:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b38427b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1870705581073536:0@lo:2:osp-syn-1-0.0 00010000:00010000:3.0:1784044396.053074:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3982055a00/0x89871fc3aba196d8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044396.053085:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3982055a00/0x89871fc3aba196d8 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044396.053093:0:3625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3982055a00/0x89871fc3aba196d8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044396.053099:0:3625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3982055a00 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:3.0:1784044396.053103:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3982055a00/0x89871fc3aba196d8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044396.053111:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3982055a00/0x89871fc3aba196d8 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044396.053126:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9b396f2a8100) 00010000:00010000:3.0:1784044396.053129:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784044396.053133:0:3625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3982055a00/0x89871fc3aba196d8 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044396.053140:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3982055a00/0x89871fc3aba196d8 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044396.053160:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b3982054800/0x89871fc3aba196df lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044396.053166:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b3982054800/0x89871fc3aba196df lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044396.053171:0:3625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b3982054800/0x89871fc3aba196df lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044396.053225:0:3625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3982054800 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:3.0:1784044396.053229:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3982054800/0x89871fc3aba196df lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044396.053235:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b3982054800/0x89871fc3aba196df lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044396.053244:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9b396f2a8d00) 00010000:00010000:3.0:1784044396.053246:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784044396.053249:0:3625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b3982054800/0x89871fc3aba196df lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044396.053255:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b3982054800/0x89871fc3aba196df lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044396.053269:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b39586efe00/0x89871fc3aba19787 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044396.053275:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b39586efe00/0x89871fc3aba19787 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044396.053281:0:3625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b39586efe00/0x89871fc3aba19787 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044396.053303:0:3625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b39586efe00 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:3.0:1784044396.053307:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b39586efe00/0x89871fc3aba19787 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044396.053313:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b39586efe00/0x89871fc3aba19787 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044396.053330:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9b397b61a000) 00010000:00010000:3.0:1784044396.053333:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784044396.053335:0:3625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b39586efe00/0x89871fc3aba19787 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044396.053341:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b39586efe00/0x89871fc3aba19787 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044396.053357:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd000/0x89871fc3aba1980c lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044396.053363:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd000/0x89871fc3aba1980c lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044396.053368:0:3625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd000/0x89871fc3aba1980c lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044396.053373:0:3625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38426fd000 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:3.0:1784044396.053376:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd000/0x89871fc3aba1980c lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044396.053382:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd000/0x89871fc3aba1980c lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044396.053390:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b397b61a900) 00010000:00010000:3.0:1784044396.053392:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784044396.053395:0:3625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd000/0x89871fc3aba1980c lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044396.053401:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fd000/0x89871fc3aba1980c lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044396.056162:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7600/0x89871fc3aba19883 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044396.056170:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7600/0x89871fc3aba19883 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044396.056192:0:3625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7600/0x89871fc3aba19883 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044396.056198:0:3625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38410b7600 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:3.0:1784044396.056211:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7600/0x89871fc3aba19883 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044396.056219:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7600/0x89871fc3aba19883 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044396.056235:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9b396f2a8800) 00010000:00010000:3.0:1784044396.056238:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1784044396.056243:0:3625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7600/0x89871fc3aba19883 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044396.056249:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7600/0x89871fc3aba19883 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044396.056893:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc400/0x89871fc3aba1972c lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044396.056920:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc400/0x89871fc3aba1972c lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 18572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044396.056925:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc400/0x89871fc3aba1972c lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044396.056930:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b38426fc400 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:0.0:1784044396.056933:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc400/0x89871fc3aba1972c lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044396.056940:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc400/0x89871fc3aba1972c lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 18572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044396.056950:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9b396f2a8d00) 00010000:00010000:0.0:1784044396.056953:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:0.0:1784044396.056957:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc400/0x89871fc3aba1972c lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044396.056963:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38426fc400/0x89871fc3aba1972c lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18572 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044396.061255:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044396.061393:0:18708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565248768 00000100:00100000:3.0:1784044396.061405:0:18708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565248768 00000100:00100000:3.0:1784044396.061479:0:18708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 30 00000100:00100000:3.0:1784044396.061491:0:18708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39412e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ffd836bb-8324-4bbb-bdb8-ace806f205ee+7:2409:x1870705565248768:12345-192.168.202.40@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1784044396.061599:0:18708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39412e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ffd836bb-8324-4bbb-bdb8-ace806f205ee+7:2409:x1870705565248768:12345-192.168.202.40@tcp:16:lhsmtool_posix.0 Request processed in 110us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044396.061624:0:18708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 30 00000100:00100000:0.0:1784044396.070329:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044396.072945:0:18572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565249024 00000100:00100000:2.0:1784044396.072961:0:18572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565249024 00000100:00100000:2.0:1784044396.073083:0:18572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 61 00000100:00100000:2.0:1784044396.073095:0:18572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38427b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ffd836bb-8324-4bbb-bdb8-ace806f205ee+15:15683:x1870705565249024:12345-192.168.202.40@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1784044396.073151:0:18572:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784044396.073196:0:18572:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b39586ef000/0x89871fc3aba19898 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6bbe expref: 15 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044396.073227:0:18572:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9b396f2a8800) 00010000:00010000:2.0:1784044396.073232:0:18572:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784044396.073262:0:18572:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b39586ef800/0x89871fc3aba198a6 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044396.073276:0:18572:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b39586ef800/0x89871fc3aba198a6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044396.073298:0:18572:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b39586ef800/0x89871fc3aba198a6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18572 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784044396.073428:0:18572:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000003353e15 reply state 0000000007c6697e transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff9b39586ef800/0x89871fc3aba198a6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044396.073741:0:18572:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b39586ef800/0x89871fc3aba198a6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044396.073764:0:18572:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9b396f2a8800) 00010000:00010000:2.0:1784044396.073767:0:18572:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1784044396.073769:0:18572:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1784044396.073875:0:18572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38427b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ffd836bb-8324-4bbb-bdb8-ace806f205ee+16:15683:x1870705565249024:12345-192.168.202.40@tcp:36:lhsmtool_posix.0 Request processed in 781us (3558us total) trans 8589934615 rc 0/0 00000100:00100000:2.0:1784044396.073883:0:18572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 61 00000100:00100000:1.0:1784044396.087125:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044396.087372:0:18707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565249152 00000100:00100000:2.0:1784044396.087382:0:18707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565249152 00000100:00100000:2.0:1784044396.087466:0:18707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 31 00000100:00100000:2.0:1784044396.087477:0:18707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39412eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ffd836bb-8324-4bbb-bdb8-ace806f205ee+7:15683:x1870705565249152:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1784044396.087494:0:18707:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784044396.087513:0:18707:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000050e869a7/0x89871fc3aba198ad lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcd3dffad52ca6bcc expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044396.087545:0:18707:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000223ad1ac/0x89871fc3aba1989f lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6bc5 expref: 8 pid: 18933 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044396.087554:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784044396.087558:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784044396.087564:0:18707:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000050e869a7/0x89871fc3aba198ad lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6bcc expref: 8 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044396.087598:0:18707:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000223ad1ac/0x89871fc3aba1989f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6bc5 expref: 8 pid: 18933 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044396.087612:0:18707:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000223ad1ac/0x89871fc3aba1989f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6bc5 expref: 8 pid: 18933 timeout: 689 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044396.087653:0:18707:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39759b7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:18707:1870705581073664:192.168.202.40@tcp:104: 00000100:00100000:2.0:1784044396.087746:0:18707:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b38433c2a80 going to sleep for 11 seconds 00000100:00100000:2.0:1784044396.090900:0:18707:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39759b7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:18707:1870705581073664:192.168.202.40@tcp:104: 00010000:00010000:2.0:1784044396.090939:0:18707:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000050e869a7/0x89871fc3aba198ad lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6bcc expref: 8 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044396.090959:0:18707:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b39586ef000, rc 0) 00000100:00100000:2.0:1784044396.091025:0:18707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39412eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ffd836bb-8324-4bbb-bdb8-ace806f205ee+8:15683:x1870705565249152:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 Request processed in 3549us (3910us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044396.091035:0:18707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 31 00000100:00100000:1.0:1784044396.101751:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044396.104802:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565249280 00000100:00100000:0.0:1784044396.104819:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565249280 00010000:00010000:0.0:1784044396.104878:0:17184:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000223ad1ac/0x89871fc3aba1989f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6bc5 expref: 8 pid: 18933 timeout: 689 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044396.104936:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 19 00000100:00100000:0.0:1784044396.104947:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d80000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ffd836bb-8324-4bbb-bdb8-ace806f205ee+8:2410:x1870705565249280:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784044396.104985:0:17184:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784044396.105011:0:17184:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000223ad1ac/0x89871fc3aba1989f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6bc5 expref: 8 pid: 18933 timeout: 689 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044396.105027:0:17184:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000223ad1ac/0x89871fc3aba1989f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6bc5 expref: 8 pid: 18933 timeout: 689 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044396.105055:0:17184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000223ad1ac/0x89871fc3aba1989f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6bc5 expref: 8 pid: 18933 timeout: 689 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044396.105076:0:17184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784044396.105081:0:17184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784044396.105089:0:17184:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000050e869a7/0x89871fc3aba198ad lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6bcc expref: 7 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044396.105111:0:17184:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000050e869a7/0x89871fc3aba198ad lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6bcc expref: 7 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044396.105158:0:17184:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000050e869a7/0x89871fc3aba198ad lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6bcc expref: 7 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044396.105518:0:17184:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b38427b5f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:17184:1870705581073792:192.168.202.40@tcp:105: 00000100:00100000:0.0:1784044396.105624:0:17184:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b397414ec00 going to sleep for 11 seconds 00000100:00100000:0.0:1784044396.120801:0:17184:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b38427b5f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:17184:1870705581073792:192.168.202.40@tcp:105: 00010000:00010000:0.0:1784044396.120834:0:17184:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784044396.120921:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d80000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ffd836bb-8324-4bbb-bdb8-ace806f205ee+7:2410:x1870705565249280:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 15975us (19180us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044396.120933:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 19 00000100:00100000:3.0:1784044396.122318:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044396.122399:0:18708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565249408 00000100:00100000:2.0:1784044396.122407:0:18708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565249408 00000100:00100000:2.0:1784044396.122529:0:18708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 32 00000100:00100000:2.0:1784044396.122540:0:18708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397a8a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ffd836bb-8324-4bbb-bdb8-ace806f205ee+7:2409:x1870705565249408:12345-192.168.202.40@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1784044396.122700:0:18708:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1784044396.122705:0:18708:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb mtime from disk: 0 -> 1784044395 00002000:00010000:2.0:1784044396.122707:0:18708:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb atime from disk: 0 -> 1784044394 00002000:00010000:2.0:1784044396.122709:0:18708:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb ctime from disk: 1784044395 -> 1784044395 00002000:00010000:2.0:1784044396.122711:0:18708:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1784044396.122817:0:18708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397a8a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ffd836bb-8324-4bbb-bdb8-ace806f205ee+8:2409:x1870705565249408:12345-192.168.202.40@tcp:2:lhsmtool_posix.0 Request processed in 278us (505us total) trans 8589934597 rc 0/0 00000100:00100000:2.0:1784044396.122825:0:18708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 32 00000100:00100000:3.0:1784044396.127935:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1784044396.128010:0:18706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565249536 00000100:00100000:0.0:1784044396.128022:0:18706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565249536 00000100:00100000:0.0:1784044396.128088:0:18706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 33 00000100:00100000:0.0:1784044396.128099:0:18706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397a8a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ffd836bb-8324-4bbb-bdb8-ace806f205ee+8:2410:x1870705565249536:12345-192.168.202.40@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1784044396.128148:0:18706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000075608ee/0x89871fc3aba198b4 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044396.128368:0:18706:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000050e869a7/0x89871fc3aba198ad lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6bcc expref: 8 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044396.128377:0:18706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784044396.128390:0:18706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1784044396.128395:0:18706:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000075608ee/0x89871fc3aba198b4 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044396.128432:0:18706:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000050e869a7/0x89871fc3aba198ad lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6bcc expref: 8 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044396.128455:0:18706:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000050e869a7/0x89871fc3aba198ad lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6bcc expref: 8 pid: 18707 timeout: 689 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044396.128469:0:18706:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b38427b5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:18706:1870705581073920:192.168.202.40@tcp:104: 00000100:00100000:0.0:1784044396.128548:0:18706:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b397414ec00 going to sleep for 11 seconds 00000100:00100000:0.0:1784044396.131374:0:18706:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b38427b5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:18706:1870705581073920:192.168.202.40@tcp:104: 00010000:00010000:0.0:1784044396.131418:0:18706:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000075608ee/0x89871fc3aba198b4 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044396.135547:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044396.135727:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565249664 00000100:00100000:3.0:1784044396.135738:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565249664 00010000:00010000:3.0:1784044396.135786:0:17185:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000050e869a7/0x89871fc3aba198ad lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6bcc expref: 9 pid: 18707 timeout: 689 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044396.135867:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 20 00000100:00100000:3.0:1784044396.135878:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39759b7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ffd836bb-8324-4bbb-bdb8-ace806f205ee+9:2410:x1870705565249664:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784044396.135895:0:17185:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784044396.135922:0:17185:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000050e869a7/0x89871fc3aba198ad lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6bcc expref: 9 pid: 18707 timeout: 689 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044396.135936:0:17185:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000050e869a7/0x89871fc3aba198ad lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6bcc expref: 9 pid: 18707 timeout: 689 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044396.135961:0:17185:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000050e869a7/0x89871fc3aba198ad lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6bcc expref: 9 pid: 18707 timeout: 689 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044396.135976:0:17185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1784044396.135980:0:17185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1784044396.135986:0:17185:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000075608ee/0x89871fc3aba198b4 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044396.136007:0:17185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000075608ee/0x89871fc3aba198b4 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044396.136045:0:17185:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784044396.136116:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39759b7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ffd836bb-8324-4bbb-bdb8-ace806f205ee+8:2410:x1870705565249664:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 239us (580us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044396.136124:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 20 00010000:00010000:0.0:1784044396.136306:0:18706:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000075608ee/0x89871fc3aba198b4 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044396.136317:0:18706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000075608ee/0x89871fc3aba198b4 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044396.136337:0:18706:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000075608ee/0x89871fc3aba198b4 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044396.136351:0:18706:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000075608ee/0x89871fc3aba198b4 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044396.136358:0:18706:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000075608ee/0x89871fc3aba198b4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044396.136365:0:18706:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b3940031200 already unused, calling callback (ffffffffc0b56230) 00010000:00010000:0.0:1784044396.136370:0:18706:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000075608ee/0x89871fc3aba198b4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044396.136500:0:18706:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000075608ee/0x89871fc3aba198b4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044396.136526:0:18706:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000075608ee/0x89871fc3aba198b4 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044396.136533:0:18706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000075608ee/0x89871fc3aba198b4 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044396.136585:0:18706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397a8a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ffd836bb-8324-4bbb-bdb8-ace806f205ee+7:2410:x1870705565249536:12345-192.168.202.40@tcp:1:lhsmtool_posix.0 Request processed in 8488us (8662us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044396.136595:0:18706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 33 00000100:00100000:1.0:1784044396.149984:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044396.150061:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565249920 00000100:00100000:2.0:1784044396.150068:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565249920 00000100:00100000:2.0:1784044396.150123:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 62 00000100:00100000:2.0:1784044396.150134:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ffd836bb-8324-4bbb-bdb8-ace806f205ee+16:15683:x1870705565249920:12345-192.168.202.40@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1784044396.150399:0:17201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b39586ee400/0x89871fc3aba198bb lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044396.150414:0:17201:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6c00/0x89871fc3aba19805 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6b8d expref: 16 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044396.150422:0:17201:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b39586ee400/0x89871fc3aba198bb lrc: 4/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044396.150502:0:17201:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6c00/0x89871fc3aba19805 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6b8d expref: 16 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044396.150513:0:17201:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6c00/0x89871fc3aba19805 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6b8d expref: 16 pid: 17201 timeout: 689 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044396.150525:0:17201:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39759b4380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17201:1870705581074048:192.168.202.40@tcp:104: 00000100:00100000:2.0:1784044396.151313:0:17201:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b38433c2480 going to sleep for 11 seconds 00000100:00100000:1.0:1784044396.155037:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044396.155225:0:20342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565250048 00000100:00100000:3.0:1784044396.155237:0:20342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565250048 00010000:00010000:3.0:1784044396.155301:0:20342:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6c00/0x89871fc3aba19805 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6b8d expref: 17 pid: 17201 timeout: 689 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044396.155338:0:20342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 21 00000100:00100000:3.0:1784044396.155351:0:20342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d80380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ffd836bb-8324-4bbb-bdb8-ace806f205ee+17:2410:x1870705565250048:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784044396.155367:0:20342:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784044396.155375:0:20342:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6c00/0x89871fc3aba19805 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6b8d expref: 17 pid: 17201 timeout: 689 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044396.155401:0:20342:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6c00/0x89871fc3aba19805 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6b8d expref: 17 pid: 17201 timeout: 689 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044396.155427:0:20342:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b397b61a900) 00010000:00010000:3.0:1784044396.155434:0:20342:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6800/0x89871fc3aba19821 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6b9b expref: 17 pid: 17200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044396.155471:0:20342:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9b39586ee400/0x89871fc3aba198bb lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044396.155480:0:20342:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b39586ee400/0x89871fc3aba198bb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044396.155488:0:20342:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b39586ee400/0x89871fc3aba198bb lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044396.155509:0:20342:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784044396.155568:0:20342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d80380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ffd836bb-8324-4bbb-bdb8-ace806f205ee+17:2410:x1870705565250048:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 220us (542us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044396.155577:0:20342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 21 00010000:00010000:2.0:1784044396.156991:0:17201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6c00/0x89871fc3aba19805 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6b8d expref: 16 pid: 17201 timeout: 689 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044396.157018:0:17201:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39759b4380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17201:1870705581074048:192.168.202.40@tcp:104: 00010000:00010000:2.0:1784044396.157045:0:17201:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b39586ee400/0x89871fc3aba198bb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044396.157077:0:17201:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b39586ee400/0x89871fc3aba198bb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044396.157083:0:17201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b39586ee400/0x89871fc3aba198bb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044396.157579:0:17201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b39586ef000/0x89871fc3aba198c2 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044396.157594:0:17201:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b39586ee200/0x89871fc3aba1988a lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6bb7 expref: 16 pid: 17200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044396.157602:0:17201:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b39586ef000/0x89871fc3aba198c2 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044396.157652:0:17201:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b39586ee200/0x89871fc3aba1988a lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6bb7 expref: 16 pid: 17200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044396.157671:0:17201:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b39586ee200/0x89871fc3aba1988a lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6bb7 expref: 16 pid: 17200 timeout: 689 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044396.157686:0:17201:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39759b4380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17201:1870705581074176:192.168.202.40@tcp:104: 00000100:00100000:2.0:1784044396.157787:0:17201:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b38433c2a80 going to sleep for 11 seconds 00000100:00100000:1.0:1784044396.160871:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044396.160986:0:17201:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39759b4380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17201:1870705581074176:192.168.202.40@tcp:104: 00010000:00010000:2.0:1784044396.161015:0:17201:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b39586ef000/0x89871fc3aba198c2 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044396.161146:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565250176 00000100:00100000:3.0:1784044396.161154:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565250176 00010000:00010000:3.0:1784044396.161225:0:17186:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b39586ee200/0x89871fc3aba1988a lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6bb7 expref: 17 pid: 17200 timeout: 689 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044396.161261:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 22 00000100:00100000:3.0:1784044396.161270:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d81f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ffd836bb-8324-4bbb-bdb8-ace806f205ee+17:2407:x1870705565250176:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784044396.161421:0:17186:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784044396.161430:0:17186:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b39586ee200/0x89871fc3aba1988a lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6bb7 expref: 17 pid: 17200 timeout: 689 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044396.161511:0:17186:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b39586ee200/0x89871fc3aba1988a lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6bb7 expref: 17 pid: 17200 timeout: 689 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044396.161550:0:17186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b39586ee200/0x89871fc3aba1988a lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6bb7 expref: 17 pid: 17200 timeout: 689 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044396.161566:0:17186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9b396f2a8800) 00010000:00010000:3.0:1784044396.161571:0:17186:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9b39586ef000/0x89871fc3aba198c2 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044396.161580:0:17186:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b39586ef000/0x89871fc3aba198c2 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044396.161588:0:17186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b39586ef000/0x89871fc3aba198c2 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044396.161617:0:17186:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784044396.161723:0:17201:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b39586ef000/0x89871fc3aba198c2 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044396.161735:0:17201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b39586ef000/0x89871fc3aba198c2 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1784044396.161856:0:17201:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:2.0:1784044396.161968:0:17201:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:2.0:1784044396.161998:0:17201:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:2.0:1784044396.162076:0:17201:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39759b4380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:17201:1870705581074304:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1784044396.162128:0:17201:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044396.162168:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581074304 00000100:00100000:2.0:1784044396.162201:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581074304 00000100:00100000:2.0:1784044396.162235:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1784044396.162243:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39759b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17201:x1870705581074304:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1784044396.162318:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39759b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17201:x1870705581074304:12345-0@lo:1000:mdt00_002.0 Request processed in 75us (189us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044396.162326:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1784044396.162352:0:17201:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b38433c2600 going to sleep for 11 seconds 00000100:00100000:2.0:1784044396.162374:0:17201:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39759b4380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:17201:1870705581074304:0@lo:1000:mdt00_002.0 00000001:00080000:2.0:1784044396.162659:0:17201:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:2.0:1784044396.162699:0:17201:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39759b4380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:17201:1870705581074432:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1784044396.162730:0:17201:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044396.162752:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581074432 00000100:00100000:2.0:1784044396.162755:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581074432 00000100:00100000:2.0:1784044396.162778:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1784044396.162784:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39759b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17201:x1870705581074432:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1784044396.162881:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39759b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:17201:x1870705581074432:12345-0@lo:1000:mdt00_002.0 Request processed in 96us (150us total) trans 8589934598 rc 0/0 00000100:00100000:2.0:1784044396.162895:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1784044396.162913:0:17201:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b38433c2540 going to sleep for 11 seconds 00000100:00100000:2.0:1784044396.162929:0:17201:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39759b4380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:17201:1870705581074432:0@lo:1000:mdt00_002.0 00010000:00010000:2.0:1784044396.162954:0:17201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b39586ef000/0x89871fc3aba198c2 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044396.162962:0:17201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b39586ef000/0x89871fc3aba198c2 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044396.162969:0:17201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b39586ef000/0x89871fc3aba198c2 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044396.162975:0:17201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b39586ef000 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:2.0:1784044396.162979:0:17201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b39586ef000/0x89871fc3aba198c2 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044396.162986:0:17201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b39586ef000/0x89871fc3aba198c2 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044396.162998:0:17201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9b396f2a8800) 00010000:00010000:2.0:1784044396.163001:0:17201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1784044396.163005:0:17201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b39586ef000/0x89871fc3aba198c2 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044396.163011:0:17201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b39586ef000/0x89871fc3aba198c2 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044396.163039:0:17201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b39586eea00/0x89871fc3aba1981a lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 19739 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044396.163045:0:17201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b39586eea00/0x89871fc3aba1981a lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 19739 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044396.163057:0:17201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b39586eea00/0x89871fc3aba1981a lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 19739 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044396.163062:0:17201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b39586eea00 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:2.0:1784044396.163065:0:17201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b39586eea00/0x89871fc3aba1981a lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 19739 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044396.163072:0:17201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b39586eea00/0x89871fc3aba1981a lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 19739 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044396.163080:0:17201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b397b61a900) 00010000:00010000:2.0:1784044396.163082:0:17201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1784044396.163088:0:17201:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6800/0x89871fc3aba19821 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6b9b expref: 20 pid: 17200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044396.163099:0:17201:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6800/0x89871fc3aba19821 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6b9b expref: 20 pid: 17200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044396.163108:0:17201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6800/0x89871fc3aba19821 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6b9b expref: 20 pid: 17200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044396.163156:0:17201:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6800/0x89871fc3aba19821 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6b9b expref: 20 pid: 17200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044396.163167:0:17201:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d4c000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17201:1870705581074560:192.168.202.40@tcp:105: 00000100:00100000:3.0:1784044396.163278:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d81f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ffd836bb-8324-4bbb-bdb8-ace806f205ee+20:2407:x1870705565250176:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 2008us (2418us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044396.163287:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 22 00000100:00100000:2.0:1784044396.163692:0:17201:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b38433c2cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1784044396.170583:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1784044396.170690:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565250304 00000100:00100000:1.0:1784044396.170700:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565250304 00000100:00100000:1.0:1784044396.170762:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 10 00000100:00100000:1.0:1784044396.170773:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397b8df850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ffd836bb-8324-4bbb-bdb8-ace806f205ee+20:15682:x1870705565250304:12345-192.168.202.40@tcp:49:dd.0 00000100:00100000:1.0:1784044396.171210:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397b8df850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ffd836bb-8324-4bbb-bdb8-ace806f205ee+20:15682:x1870705565250304:12345-192.168.202.40@tcp:49:dd.0 Request processed in 401us (597us total) trans 0 rc 0/0 00000100:00100000:1.0:1784044396.171237:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 10 00000100:00100000:2.0:1784044396.171602:0:17201:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d4c000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17201:1870705581074560:192.168.202.40@tcp:105: 00010000:00010000:2.0:1784044396.171637:0:17201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b39586eea00/0x89871fc3aba1981a lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 19739 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044396.171658:0:17201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b39586eea00/0x89871fc3aba1981a lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 19739 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044396.171691:0:17201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b39586ef000/0x89871fc3aba198c9 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044396.171706:0:17201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b39586ef000/0x89871fc3aba198c9 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044396.171718:0:17201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b39586ef000/0x89871fc3aba198c9 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044396.171728:0:17201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b39586ef000/0x89871fc3aba198c9 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044396.171734:0:17201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b39586ef000/0x89871fc3aba198c9 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044396.171740:0:17201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b39586ef000/0x89871fc3aba198c9 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044396.171746:0:17201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b39586ef000 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:2.0:1784044396.171749:0:17201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b39586ef000/0x89871fc3aba198c9 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044396.171755:0:17201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b39586ef000/0x89871fc3aba198c9 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044396.171765:0:17201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b397b61a900) 00010000:00010000:2.0:1784044396.171773:0:17201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784044396.171777:0:17201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b39586ef000/0x89871fc3aba198c9 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044396.171783:0:17201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b39586ef000/0x89871fc3aba198c9 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044396.171795:0:17201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b39586ee400/0x89871fc3aba198bb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044396.171801:0:17201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b39586ee400/0x89871fc3aba198bb lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044396.171807:0:17201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b39586ee400/0x89871fc3aba198bb lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044396.171812:0:17201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b39586ee400 already unused, calling callback (ffffffffc174d4f0) 00010000:00010000:2.0:1784044396.171815:0:17201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b39586ee400/0x89871fc3aba198bb lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044396.171821:0:17201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b39586ee400/0x89871fc3aba198bb lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044396.171829:0:17201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b397b61a900) 00010000:00010000:2.0:1784044396.171831:0:17201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1784044396.171834:0:17201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b39586ee400/0x89871fc3aba198bb lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044396.171839:0:17201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b39586ee400/0x89871fc3aba198bb lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784044396.171989:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ffd836bb-8324-4bbb-bdb8-ace806f205ee+19:15683:x1870705565249920:12345-192.168.202.40@tcp:57:lhsmtool_posix.0 Request processed in 21856us (22013us total) trans 8589934620 rc 0/0 00000100:00100000:2.0:1784044396.172007:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 62 00000020:00080000:2.0:1784044396.172011:0:17201:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1784044396.172228:0:17236:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1784044396.172233:0:17236:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1784044396.172250:0:17236:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1784044396.172256:0:17236:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1784044396.177741:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1784044396.177796:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1784044396.177826:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565250688 00000100:00100000:1.0:1784044396.177837:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565250688 00000100:00100000:1.0:1784044396.177905:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 11 00000100:00100000:1.0:1784044396.177917:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ffd836bb-8324-4bbb-bdb8-ace806f205ee+19:15683:x1870705565250688:12345-192.168.202.40@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1784044396.178244:0:17203:0:(mdd_object.c:4016:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1784044396.178279:0:17203:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:1.0:1784044396.178314:0:17203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b397cb18800/0x89871fc3aba198d0 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044396.178331:0:17203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b397cb18800/0x89871fc3aba198d0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 17203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044396.178342:0:17203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b397cb18800/0x89871fc3aba198d0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 17203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044396.178352:0:17203:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b397cb18800/0x89871fc3aba198d0 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 17203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044396.178358:0:17203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b397cb18800/0x89871fc3aba198d0 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 17203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044396.178364:0:17203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b397cb18800/0x89871fc3aba198d0 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 17203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044396.178381:0:17203:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1784044396.178478:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ffd836bb-8324-4bbb-bdb8-ace806f205ee+21:15683:x1870705565250688:12345-192.168.202.40@tcp:35:lhsmtool_posix.0 Request processed in 563us (681us total) trans 8589934622 rc 0/0 00000100:00100000:1.0:1784044396.178503:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 11 00000020:00080000:1.0:1784044396.178508:0:17203:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1784044396.178531:0:20228:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784044396.178537:0:20228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b397cb18800/0x89871fc3aba198d0 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 17203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044396.178544:0:20228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b397cb18800 already unused, calling callback (ffffffffc0b56230) 00010000:00010000:1.0:1784044396.178549:0:20228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b397cb18800/0x89871fc3aba198d0 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 17203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044396.178556:0:20228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b397cb18800/0x89871fc3aba198d0 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 17203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044396.178572:0:20228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9b396f2a8800) 00010000:00010000:1.0:1784044396.178575:0:20228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1784044396.178580:0:20228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b397cb18800/0x89871fc3aba198d0 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 17203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044396.178586:0:20228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b397cb18800/0x89871fc3aba198d0 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 17203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044396.178596:0:20228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784044396.178598:0:20228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784044396.178599:0:20228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784044396.179864:0:19739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565250432 00000100:00100000:3.0:1784044396.179874:0:19739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565250432 00000100:00100000:3.0:1784044396.179934:0:19739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 63 00000100:00100000:3.0:1784044396.179944:0:19739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ffd836bb-8324-4bbb-bdb8-ace806f205ee+21:15682:x1870705565250432:12345-192.168.202.40@tcp:101:dd.0 00010000:00010000:3.0:1784044396.179962:0:19739:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784044396.179979:0:19739:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7600/0x89871fc3aba198d7 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcd3dffad52ca6bd3 expref: -99 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044396.180011:0:19739:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6e00/0x89871fc3aba198de lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19739 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044396.180041:0:19739:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6e00/0x89871fc3aba198de lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19739 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044396.180051:0:19739:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6e00/0x89871fc3aba198de lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19739 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044396.180259:0:19739:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b7600/0x89871fc3aba198d7 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6bd3 expref: 23 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044396.180277:0:19739:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b38410b6e00/0x89871fc3aba198de lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xcd3dffad52ca6bd3 expref: 22 pid: 19739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784044396.180297:0:19739:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b397b61a900) 00010000:00010000:3.0:1784044396.180300:0:19739:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1784044396.180303:0:19739:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b38410b6e00, rc 0) 00000100:00100000:3.0:1784044396.180359:0:19739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ffd836bb-8324-4bbb-bdb8-ace806f205ee+22:15682:x1870705565250432:12345-192.168.202.40@tcp:101:dd.0 Request processed in 416us (2631us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044396.180366:0:19739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 63 00000100:00100000:1.0:1784044396.371975:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1784044396.372169:0:18711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565250816 00000100:00100000:2.0:1784044396.372206:0:18711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565250816 00000100:00100000:2.0:1784044396.372271:0:18711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 0 00000100:00100000:2.0:1784044396.372292:0:18711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d83800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ffd836bb-8324-4bbb-bdb8-ace806f205ee+7:2409:x1870705565250816:12345-192.168.202.40@tcp:4:dd.0 00002000:00010000:2.0:1784044396.372344:0:18711:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x22:0x0] initial LVB size: 0, mtime: 0x6a565b6b, atime: 0x6a565b6a, ctime: 0x6a565b6b, blocks: 0x0 00010000:00010000:2.0:1784044396.372353:0:18711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003673cdfe/0x89871fc3aba198e5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044396.372370:0:18711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=589s v=(0 0) 00010000:00010000:2.0:1784044396.372374:0:18711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784044396.372706:0:18711:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003673cdfe/0x89871fc3aba198e5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784044396.372728:0:18711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003673cdfe/0x89871fc3aba198e5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784044396.374577:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1784044396.374877:0:18713:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:1.0:1784044396.374889:0:18713:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:3.0:1784044396.379796:0:18713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565250944 00000100:00100000:3.0:1784044396.379815:0:18713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565250944 00000100:00100000:1.0:1784044396.381090:0:20343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 1 00000100:00100000:1.0:1784044396.381111:0:20343:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397a8a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ffd836bb-8324-4bbb-bdb8-ace806f205ee+8:2409:x1870705565250944:12345-192.168.202.40@tcp:4:dd.0 00010000:00010000:1.0:1784044396.381150:0:20343:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e981007e/0x89871fc3aba198ec lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044396.381198:0:20343:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784044396.381203:0:20343:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784044396.381221:0:20343:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e981007e/0x89871fc3aba198ec lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044396.381239:0:20343:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e981007e/0x89871fc3aba198ec lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1784044396.492252:0:19522:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934599 is committed 00000001:00080000:3.0:1784044396.492272:0:19522:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934598 is committed 00002000:00010000:0.0:1784044396.523872:0:20343:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 0 -> 7654321 00002000:00010000:0.0:1784044396.523883:0:20343:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 0 -> 14952 00010000:00010000:0.0:1784044396.523904:0:20343:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e981007e/0x89871fc3aba198ec lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044396.523919:0:20343:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e981007e/0x89871fc3aba198ec lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044396.523928:0:20343:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e981007e/0x89871fc3aba198ec lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044396.523937:0:20343:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b397cb18800 already unused, calling callback (ffffffffc0b56230) 00010000:00010000:0.0:1784044396.523964:0:20343:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e981007e/0x89871fc3aba198ec lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044396.523975:0:20343:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e981007e/0x89871fc3aba198ec lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044396.523998:0:20343:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e981007e/0x89871fc3aba198ec lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784044396.524005:0:20343:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e981007e/0x89871fc3aba198ec lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784044396.524119:0:20343:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397a8a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ffd836bb-8324-4bbb-bdb8-ace806f205ee+9:2409:x1870705565250944:12345-192.168.202.40@tcp:4:dd.0 Request processed in 143010us (149546us total) trans 8589934599 rc 0/0 00000100:00100000:0.0:1784044396.524134:0:20343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 1 00000001:00080000:2.0:1784044396.540603:0:19522:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934600 is committed 00010000:00010000:1.0:1784044396.540822:0:18711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003673cdfe/0x89871fc3aba198e5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044396.540837:0:18711:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003673cdfe/0x89871fc3aba198e5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044396.540847:0:18711:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003673cdfe/0x89871fc3aba198e5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044396.540854:0:18711:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b39586ee400 already unused, calling callback (ffffffffc0b56230) 00010000:00010000:1.0:1784044396.540859:0:18711:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003673cdfe/0x89871fc3aba198e5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044396.540868:0:18711:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003673cdfe/0x89871fc3aba198e5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044396.540898:0:18711:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003673cdfe/0x89871fc3aba198e5 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784044396.540927:0:18711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003673cdfe/0x89871fc3aba198e5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784044396.541064:0:18711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d83800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ffd836bb-8324-4bbb-bdb8-ace806f205ee+5:2409:x1870705565250816:12345-192.168.202.40@tcp:4:dd.0 Request processed in 168779us (169095us total) trans 8589934600 rc 0/0 00000100:00100000:1.0:1784044396.541074:0:18711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 0 00010000:00010000:0.0:1784044396.557499:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784044397.587253:0:19100:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784044398.333257:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044398.333664:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044398.333693:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044398.333717:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044398.333736:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044398.333773:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044398.333792:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044398.333812:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044398.333843:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1784044398.333885:0:18933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565251584 00000100:00100000:3.0:1784044398.333895:0:18933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565251584 00000100:00100000:3.0:1784044398.333947:0:18933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565252096 00000100:00100000:3.0:1784044398.333950:0:18933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565252096 00000100:00100000:3.0:1784044398.333962:0:18933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565251456 00000100:00100000:3.0:1784044398.333964:0:18933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565251456 00000100:00100000:3.0:1784044398.333975:0:18933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565251968 00000100:00100000:3.0:1784044398.333977:0:18933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565251968 00000100:00100000:3.0:1784044398.333992:0:18933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 27 00000100:00100000:3.0:1784044398.334001:0:18933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397a8a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ffd836bb-8324-4bbb-bdb8-ace806f205ee+5:2408:x1870705565251584:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:3.0:1784044398.334074:0:18933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397a8a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ffd836bb-8324-4bbb-bdb8-ace806f205ee+5:2408:x1870705565251584:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 73us (379us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044398.334095:0:18933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 27 00000100:00100000:3.0:1784044398.334114:0:18933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 28 00000100:00100000:3.0:1784044398.334121:0:18933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397a8a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:35f5085c-0464-4087-9b4b-890cdd0735b4+5:2408:x1870705565252096:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:3.0:1784044398.334146:0:18933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397a8a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:35f5085c-0464-4087-9b4b-890cdd0735b4+5:2408:x1870705565252096:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 25us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044398.334152:0:18933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 28 00000100:00100000:3.0:1784044398.334163:0:18933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 29 00000100:00100000:3.0:1784044398.334168:0:18933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3947ee9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ffd836bb-8324-4bbb-bdb8-ace806f205ee+5:2408:x1870705565251456:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:0.0:1784044398.334870:0:18706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 30 00000100:00100000:0.0:1784044398.334886:0:18706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39503bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:35f5085c-0464-4087-9b4b-890cdd0735b4+5:2408:x1870705565251968:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:0.0:1784044398.334924:0:18706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39503bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:35f5085c-0464-4087-9b4b-890cdd0735b4+5:2408:x1870705565251968:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 45us (1080us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044398.334930:0:18706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 30 00000100:00100000:2.0:1784044398.335642:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565251072 00000100:00100000:2.0:1784044398.335650:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565251072 00000100:00100000:2.0:1784044398.335702:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 173 00000100:00100000:2.0:1784044398.335709:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38437a7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cf001828-7720-4c65-ba45-a14bcd113197+13:2408:x1870705565251072:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:2.0:1784044398.335746:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38437a7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cf001828-7720-4c65-ba45-a14bcd113197+13:2408:x1870705565251072:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 39us (2502us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044398.335753:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 173 00000100:00100000:2.0:1784044398.335795:0:18572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565251328 00000100:00100000:2.0:1784044398.335799:0:18572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565251328 00000100:00100000:2.0:1784044398.335829:0:18572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565251840 00000100:00100000:2.0:1784044398.335832:0:18572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565251840 00000100:00100000:2.0:1784044398.335845:0:18572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565251200 00000100:00100000:2.0:1784044398.335848:0:18572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565251200 00000100:00100000:2.0:1784044398.335860:0:18572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705565251712 00000100:00100000:2.0:1784044398.335876:0:18572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705565251712 00000100:00100000:2.0:1784044398.335894:0:18572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 78 00000100:00100000:2.0:1784044398.335899:0:18572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397a8a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ffd836bb-8324-4bbb-bdb8-ace806f205ee+5:2408:x1870705565251328:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:2.0:1784044398.335927:0:18572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397a8a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ffd836bb-8324-4bbb-bdb8-ace806f205ee+5:2408:x1870705565251328:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 28us (2264us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044398.335933:0:18572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 78 00000100:00100000:2.0:1784044398.335945:0:18572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 79 00000100:00100000:2.0:1784044398.335951:0:18572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397a8a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35f5085c-0464-4087-9b4b-890cdd0735b4+5:2408:x1870705565251840:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:2.0:1784044398.335973:0:18572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397a8a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35f5085c-0464-4087-9b4b-890cdd0735b4+5:2408:x1870705565251840:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 22us (2256us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044398.335979:0:18572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 79 00000100:00100000:2.0:1784044398.335991:0:18572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 80 00000100:00100000:2.0:1784044398.335997:0:18572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b397a8a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ffd836bb-8324-4bbb-bdb8-ace806f205ee+22:2408:x1870705565251200:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:2.0:1784044398.336022:0:18572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b397a8a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ffd836bb-8324-4bbb-bdb8-ace806f205ee+22:2408:x1870705565251200:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 26us (2250us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044398.336028:0:18572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 80 00000100:00100000:2.0:1784044398.336040:0:18572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 81 00000100:00100000:2.0:1784044398.336046:0:18572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39503bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35f5085c-0464-4087-9b4b-890cdd0735b4+6:2408:x1870705565251712:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:2.0:1784044398.336069:0:18572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39503bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35f5085c-0464-4087-9b4b-890cdd0735b4+6:2408:x1870705565251712:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 23us (2256us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044398.336092:0:18572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 81 00000100:00080000:2.0:1784044398.336120:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1784044398.336123:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1784044398.336126:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1784044398.336129:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784044398.336776:0:18933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3947ee9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ffd836bb-8324-4bbb-bdb8-ace806f205ee+5:2408:x1870705565251456:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 2603us (2979us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044398.336793:0:18933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 29 00010000:00010000:3.0:1784044398.616605:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784044398.671521:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b38427b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1870705581074688:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784044398.671701:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044398.672195:0:18709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581074688 00000100:00100000:2.0:1784044398.672203:0:18709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581074688 00000100:00100000:2.0:1784044398.672270:0:18709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1784044398.672279:0:18709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39503bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1870705581074688:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1784044398.672311:0:18709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1784044398.672426:0:18709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39503bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1870705581074688:12345-0@lo:13:osp-pre-0-0.0 Request processed in 147us (725us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044398.672434:0:18709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:0.0:1784044398.675080:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784044398.676154:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b38427b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1870705581074688:0@lo:13:osp-pre-0-0.0 00000001:02000400:1.0:1784044399.274442:0:20381:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00010000:00010000:1.0:1784044399.629709:0:20228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784044399.703999:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784044399.704023:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1870705581074816:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1784044399.704099:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044399.704305:0:18709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581074816 00000100:00100000:0.0:1784044399.704313:0:18709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581074816 00000100:00100000:0.0:1784044399.704376:0:18709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1784044399.704386:0:18709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843d4c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1870705581074816:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1784044399.704447:0:18709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1784044399.704497:0:18709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843d4c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1870705581074816:12345-0@lo:13:osp-pre-0-1.0 Request processed in 112us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044399.704504:0:18709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:2.0:1784044399.705237:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784044399.707933:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1870705581074816:0@lo:13:osp-pre-0-1.0 00000040:00080000:3.0:1784044400.606487:0:17952:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1784044400.657556:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784044400.717444:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1870705581075200:0@lo:400:kworker.0 00000100:00100000:2.0:1784044400.717530:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044400.717579:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843e0f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1870705581075712:0@lo:400:kworker.0 00000100:00100000:2.0:1784044400.717620:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044400.717646:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843e0e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1870705581076224:0@lo:400:kworker.0 00000100:00100000:2.0:1784044400.717670:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044400.717727:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1784044400.717732:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1870705581075328:0@lo:400:kworker.0 00000100:00100000:2.0:1784044400.717755:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044400.717777:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843e0f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1870705581075840:0@lo:400:kworker.0 00000100:00100000:2.0:1784044400.717798:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044400.717816:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843e0e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3640:1870705581076352:0@lo:400:kworker.0 00000100:00100000:2.0:1784044400.717838:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784044400.717867:0:18708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581075200 00000100:00100000:2.0:1784044400.717875:0:18708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581075200 00000100:00100000:2.0:1784044400.717920:0:18708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581075712 00000100:00100000:2.0:1784044400.717922:0:18708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581075712 00000100:00100000:2.0:1784044400.717934:0:18708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581075328 00000100:00100000:2.0:1784044400.717936:0:18708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581075328 00000100:00100000:2.0:1784044400.717947:0:18708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581075840 00000100:00100000:2.0:1784044400.717949:0:18708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581075840 00000100:00100000:2.0:1784044400.717966:0:18708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1784044400.717975:0:18708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843e0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1870705581075200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784044400.718032:0:18708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843e0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1870705581075200:12345-0@lo:400:kworker.0 Request processed in 57us (502us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044400.718040:0:18708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1784044400.718057:0:18708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1784044400.718063:0:18708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843e0c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1870705581075712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784044400.718087:0:18708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843e0c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1870705581075712:12345-0@lo:400:kworker.0 Request processed in 24us (467us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044400.718092:0:18708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1784044400.718103:0:18708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1784044400.718109:0:18708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843e0d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1870705581075328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784044400.718145:0:18708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843e0d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1870705581075328:12345-0@lo:400:kworker.0 Request processed in 36us (389us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044400.718150:0:18708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1784044400.718160:0:18708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1784044400.718166:0:18708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843e0d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1870705581075840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784044400.718216:0:18708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843e0d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1870705581075840:12345-0@lo:400:kworker.0 Request processed in 50us (417us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044400.718222:0:18708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1784044400.718241:0:18572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581076224 00000100:00100000:2.0:1784044400.718245:0:18572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581076224 00000100:00100000:2.0:1784044400.718270:0:18572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581076352 00000100:00100000:2.0:1784044400.718272:0:18572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581076352 00000100:00100000:2.0:1784044400.718288:0:18572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1784044400.718294:0:18572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843e0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1870705581076224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784044400.718319:0:18572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843e0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1870705581076224:12345-0@lo:400:kworker.0 Request processed in 25us (647us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044400.718325:0:18572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1784044400.718335:0:18572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1784044400.718340:0:18572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843e0ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1870705581076352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784044400.718364:0:18572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843e0ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1870705581076352:12345-0@lo:400:kworker.0 Request processed in 24us (525us total) trans 0 rc 0/0 00000100:00100000:2.0:1784044400.718369:0:18572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00080000:2.0:1784044400.718391:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1784044400.718394:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1784044400.718397:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1784044400.718399:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784044400.718423:0:3640:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934598 gen 2 00000004:00080000:2.0:1784044400.718433:0:3640:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b38427b6a00, transno 8589934596 00000004:00080000:2.0:1784044400.718442:0:3640:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934598 committed transno 8589934598 00000100:00100000:2.0:1784044400.718465:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1870705581075328:0@lo:400:kworker.0 00000100:00100000:2.0:1784044400.718479:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843e0f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1870705581075840:0@lo:400:kworker.0 00000100:00100000:2.0:1784044400.718487:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843e0e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3640:1870705581076352:0@lo:400:kworker.0 00000100:00100000:2.0:1784044400.718496:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1870705581075200:0@lo:400:kworker.0 00000100:00100000:2.0:1784044400.718504:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843e0f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1870705581075712:0@lo:400:kworker.0 00010000:00080000:2.0:1784044400.718516:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b3843e0e300 x1870705581076224/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044416 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784044400.718525:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843e0e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1870705581076224:0@lo:400:kworker.0 00000100:00100000:0.0:1784044400.719264:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:99a46fb7-9af9-40f1-9c76-329d6781ee81:3638:1870705581074944:0@lo:400:kworker.0 00000100:00100000:0.0:1784044400.719306:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044400.719350:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843e0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1870705581075456:0@lo:400:kworker.0 00000100:00100000:0.0:1784044400.719374:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044400.719399:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843e0ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1870705581075968:0@lo:400:kworker.0 00000100:00100000:1.0:1784044400.719404:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581075456 00000100:00100000:1.0:1784044400.719409:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581075456 00000100:00100000:0.0:1784044400.719431:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784044400.719440:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581075968 00000100:00100000:1.0:1784044400.719442:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581075968 00000100:00100000:0.0:1784044400.719448:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843e0f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3638:1870705581076480:0@lo:400:kworker.0 00000100:00100000:0.0:1784044400.719469:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044400.719490:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:0.0:1784044400.719497:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843d4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1870705581075072:0@lo:400:kworker.0 00000100:00100000:0.0:1784044400.719520:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044400.719537:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843e0c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1870705581075584:0@lo:400:kworker.0 00000100:00100000:0.0:1784044400.719558:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044400.719580:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843e0c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1870705581076096:0@lo:400:kworker.0 00000100:00100000:3.0:1784044400.719612:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581076480 00000100:00100000:0.0:1784044400.719612:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044400.719616:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581076480 00000100:00100000:0.0:1784044400.719623:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b39503bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1870705581076608:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1784044400.719645:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581076096 00000100:00100000:0.0:1784044400.719645:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044400.719648:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581076096 00000100:00100000:3.0:1784044400.719664:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1784044400.719671:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38427b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1870705581075456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044400.719721:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38427b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1870705581075456:12345-0@lo:400:kworker.0 Request processed in 50us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044400.719728:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1784044400.719743:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1784044400.719760:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38427b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1870705581075968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044400.719789:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38427b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1870705581075968:12345-0@lo:400:kworker.0 Request processed in 40us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044400.719795:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1784044400.719807:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1784044400.719812:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38427b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1870705581076480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044400.719838:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38427b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1870705581076480:12345-0@lo:400:kworker.0 Request processed in 26us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044400.719844:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1784044400.719855:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1784044400.719861:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38427b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1870705581076096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044400.719898:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38427b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1870705581076096:12345-0@lo:400:kworker.0 Request processed in 37us (284us total) trans 0 rc 0/0 00000100:00100000:3.0:1784044400.719903:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00080000:3.0:1784044400.719917:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1784044400.719920:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1784044400.719940:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843e0c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1870705581076096:0@lo:400:kworker.0 00000100:00100000:3.0:1784044400.719949:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843e0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1870705581075456:0@lo:400:kworker.0 00000100:00100000:3.0:1784044400.719956:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843e0ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1870705581075968:0@lo:400:kworker.0 00010000:00080000:3.0:1784044400.719965:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b3843e0f100 x1870705581076480/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784044416 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784044400.719973:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843e0f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3638:1870705581076480:0@lo:400:kworker.0 00000100:00100000:0.0:1784044400.720020:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581074944 00000100:00100000:0.0:1784044400.720024:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581074944 00000100:00100000:0.0:1784044400.720058:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1784044400.720064:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b3843df9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99a46fb7-9af9-40f1-9c76-329d6781ee81+24:3638:x1870705581074944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784044400.720093:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b3843df9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:99a46fb7-9af9-40f1-9c76-329d6781ee81+24:3638:x1870705581074944:12345-0@lo:400:kworker.0 Request processed in 29us (786us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044400.720099:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1784044400.720130:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581075072 00000100:00100000:0.0:1784044400.720133:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581075072 00000100:00100000:0.0:1784044400.720149:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581075584 00000100:00100000:0.0:1784044400.720151:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581075584 00000100:00100000:0.0:1784044400.720163:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1784044400.720168:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38427b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1870705581075072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044400.720214:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:99a46fb7-9af9-40f1-9c76-329d6781ee81:3638:1870705581074944:0@lo:400:kworker.0 00000100:00100000:0.0:1784044400.720218:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38427b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1870705581075072:12345-0@lo:400:kworker.0 Request processed in 49us (697us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044400.720223:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1784044400.720235:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1784044400.720239:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843d4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1870705581075072:0@lo:400:kworker.0 00000100:00100000:0.0:1784044400.720240:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38427b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1870705581075584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784044400.720254:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1784044400.720263:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b38427b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1870705581076736:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1784044400.720285:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784044400.720287:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38427b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1870705581075584:12345-0@lo:400:kworker.0 Request processed in 47us (728us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044400.720293:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1784044400.720302:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581076736 00000100:00100000:0.0:1784044400.720304:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581076736 00000100:00100000:0.0:1784044400.720316:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1784044400.720319:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843e0c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1870705581075584:0@lo:400:kworker.0 00000100:00100000:0.0:1784044400.720321:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39503bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1870705581076736:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1784044400.721147:0:17206:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:0.0:1784044400.721228:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39503bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1870705581076736:12345-0@lo:41:osp-pre-0-1.0 Request processed in 904us (940us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044400.721236:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1784044400.721271:0:18709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581076608 00000100:00100000:0.0:1784044400.721276:0:18709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581076608 00000100:00100000:0.0:1784044400.721305:0:18709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1784044400.721311:0:18709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b38427b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1870705581076608:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1784044400.723994:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843e0e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1870705581076864:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784044400.724079:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044400.724150:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b38427b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1870705581076736:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1784044400.724203:0:18710:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:3.0:1784044400.724212:0:18710:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00000100:00100000:3.0:1784044400.724356:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b3843e0f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1870705581076992:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1784044400.724385:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784044400.724431:0:18710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581076864 00000100:00100000:3.0:1784044400.724436:0:18710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581076864 00002000:00000024:0.0:1784044400.724504:0:18709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 26324672 pending 0 free 3915857920 avail 3684335616 00000100:00100000:3.0:1784044400.724543:0:20400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1784044400.724552:0:20400:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39503bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1870705581076864:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784044400.724557:0:18709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b38427b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1870705581076608:12345-0@lo:13:osp-pre-1-1.0 Request processed in 3246us (4911us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044400.724563:0:18709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00002000:00000024:3.0:1784044400.724569:0:20400:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 26324672 pending 0 free 3915857920 avail 3684335616 00000100:00100000:3.0:1784044400.724611:0:20400:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39503bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1870705581076864:12345-0@lo:13:osp-pre-1-0.0 Request processed in 48us (520us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044400.724616:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b39503bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1870705581076608:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1784044400.724617:0:20400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1784044400.724644:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843e0e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1870705581076864:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784044400.725493:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870705581076992 00000100:00100000:0.0:1784044400.725500:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870705581076992 00000100:00100000:0.0:1784044400.725538:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1784044400.725545:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b39503bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1870705581076992:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1784044400.725570:0:17206:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1784044400.728629:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b39503bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1870705581076992:12345-0@lo:41:osp-pre-1-0.0 Request processed in 3053us (4212us total) trans 0 rc 0/0 00000100:00100000:0.0:1784044400.728647:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1784044400.728861:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b3843e0f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1870705581076992:0@lo:41:osp-pre-1-0.0 Debug log: 45368 lines, 45368 kept, 0 dropped, 0 bad.